2024-09-15T22:54:42.855 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T22:54:42.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:54:42.959 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906293 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/blogbench}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906293' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8921c8ef947807b717db041d85f0761b7914d5fc subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJkMGW5zobvjT0REPO5rmNIzyVWBIwbcdFQBNwIafz/WQCFK2t8lzvvHukgc4anppIKQUjTF2UPFMW/fCtaSguE= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMsosJj0cg0zQIg1qGgu41Au4chf+OhcxRLcG4b7vVWM8x86bEVre3+ibSBk7fkuYGxEg74nHfc6XXOIhvO8dpQ= smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCmGl8ZTWoZ8qNHED2M1WsanUosh6mQsNRKfA2LV2HRIOOCDuC7KZOPiYfmU4wzyCviP8SKPnSWyonAS6+gijxk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T22:54:42.959 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T22:54:42.960 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T22:54:42.960 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T22:54:42.962 INFO:teuthology.task.internal:Checking packages... 2024-09-15T22:54:42.983 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T22:54:42.983 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T22:54:42.983 INFO:teuthology.packaging:ref: None 2024-09-15T22:54:42.983 INFO:teuthology.packaging:tag: None 2024-09-15T22:54:42.983 INFO:teuthology.packaging:branch: squid 2024-09-15T22:54:42.983 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:54:42.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-15T22:54:43.194 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-15T22:54:43.196 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T22:54:43.203 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T22:54:43.203 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T22:54:43.216 INFO:teuthology.task.internal:Saving configuration 2024-09-15T22:54:43.235 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T22:54:43.241 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T22:54:43.266 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906293', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:49:42.602252', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJkMGW5zobvjT0REPO5rmNIzyVWBIwbcdFQBNwIafz/WQCFK2t8lzvvHukgc4anppIKQUjTF2UPFMW/fCtaSguE='} 2024-09-15T22:54:43.288 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906293', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:49:42.603459', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMsosJj0cg0zQIg1qGgu41Au4chf+OhcxRLcG4b7vVWM8x86bEVre3+ibSBk7fkuYGxEg74nHfc6XXOIhvO8dpQ='} 2024-09-15T22:54:43.311 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906293', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:49:42.600850', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCmGl8ZTWoZ8qNHED2M1WsanUosh6mQsNRKfA2LV2HRIOOCDuC7KZOPiYfmU4wzyCviP8SKPnSWyonAS6+gijxk='} 2024-09-15T22:54:43.311 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T22:54:43.317 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-15T22:54:43.317 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-15T22:54:43.317 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-15T22:54:43.318 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T22:54:43.397 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f05e1097be0>, signals=[15]) 2024-09-15T22:54:43.397 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T22:54:43.403 INFO:teuthology.task.internal:Opening connections... 2024-09-15T22:54:43.403 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-09-15T22:54:43.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:54:43.485 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T22:54:43.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:54:43.562 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-09-15T22:54:43.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:54:43.636 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T22:54:43.643 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-09-15T22:54:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-09-15T22:54:43.662 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-09-15T22:54:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-09-15T22:54:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-09-15T22:54:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-09-15T22:54:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:54:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-09-15T22:54:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:54:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:54:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-09-15T22:54:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:54:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:54:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:54:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:54:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:54:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:54:43.720 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-09-15T22:54:43.738 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-15T22:54:43.756 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-15T22:54:43.757 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-15T22:54:43.815 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-09-15T22:54:43.815 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-09-15T22:54:43.815 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-09-15T22:54:43.815 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:54:43.815 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-09-15T22:54:43.815 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:54:43.815 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:54:43.815 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-09-15T22:54:43.815 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:54:43.815 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:54:43.815 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:54:43.815 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:54:43.816 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:54:43.816 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:54:43.816 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-15T22:54:43.838 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-09-15T22:54:43.856 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-09-15T22:54:43.857 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-09-15T22:54:43.914 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-09-15T22:54:43.914 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-09-15T22:54:43.915 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-09-15T22:54:43.915 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-09-15T22:54:43.915 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-09-15T22:54:43.915 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-09-15T22:54:43.915 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T22:54:43.915 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-09-15T22:54:43.915 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-09-15T22:54:43.915 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T22:54:43.915 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-09-15T22:54:43.915 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T22:54:43.915 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T22:54:43.915 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T22:54:43.916 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-09-15T22:54:43.938 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T22:54:43.948 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T22:54:43.953 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T22:54:43.953 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:54:43.955 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:54:43.958 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:54:43.974 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T22:54:43.979 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T22:54:43.980 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:54:44.013 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:54:44.015 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:54:44.116 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T22:54:44.190 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T22:54:44.204 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-15T22:54:44.204 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-15T22:54:44.205 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:54:44.205 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:54:44.205 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:54:44.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:54:44.222 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-15T22:54:44.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:54:44.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:54:44.224 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-15T22:54:44.225 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-15T22:54:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-503.el9.x86_64 2024-09-15T22:54:44.280 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.14.0-503.el9.x86_64 2024-09-15T22:54:44.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2024-09-15T22:54:44.282 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-503.el9.x86_64 2024-09-15T22:54:44.282 INFO:teuthology.task.kernel:Running kernel on smithi145: 5.14.0-503.el9.x86_64 2024-09-15T22:54:44.282 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum install -y kernel 2024-09-15T22:54:44.283 INFO:teuthology.orchestra.run.smithi112.stdout:5.14.0-503.el9.x86_64 2024-09-15T22:54:44.283 INFO:teuthology.task.kernel:Running kernel on smithi112: 5.14.0-503.el9.x86_64 2024-09-15T22:54:44.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum install -y kernel 2024-09-15T22:54:46.797 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-15T22:54:46.899 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.2 MB 00:00 2024-09-15T22:54:48.196 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.2 MB 00:02 2024-09-15T22:54:48.531 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-15T22:54:48.833 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-15T22:54:53.149 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.5 MB 00:00 2024-09-15T22:54:53.172 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 20 MB 00:03 2024-09-15T22:54:53.175 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-15T22:54:54.610 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 104 kB/s | 19 kB 00:00 2024-09-15T22:54:54.666 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-15T22:54:55.714 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-15T22:54:55.787 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-15T22:54:58.122 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 6.5 MB 00:01 2024-09-15T22:55:00.466 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-15T22:55:01.159 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-15T22:55:01.386 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-15T22:55:01.543 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-15T22:55:03.132 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T22:55:03.132 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T22:55:03.232 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-15T22:55:03.239 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-15T22:55:03.239 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-09-15T22:55:03.239 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-15T22:55:03.239 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-15T22:55:03.239 INFO:teuthology.orchestra.run.smithi145.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T22:55:03.239 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-15T22:55:03.239 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T22:55:03.239 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T22:55:03.239 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T22:55:03.240 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T22:55:03.240 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-15T22:55:03.240 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-15T22:55:03.240 INFO:teuthology.orchestra.run.smithi145.stdout:Install 4 Packages 2024-09-15T22:55:03.240 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T22:55:03.240 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 79 M 2024-09-15T22:55:03.240 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 126 M 2024-09-15T22:55:03.241 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-15T22:55:03.492 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T22:55:03.493 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T22:55:03.583 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-15T22:55:03.590 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-15T22:55:03.590 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-15T22:55:03.590 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-15T22:55:03.590 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-15T22:55:03.590 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T22:55:03.590 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-15T22:55:03.590 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T22:55:03.591 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T22:55:03.591 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T22:55:03.591 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T22:55:03.591 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-15T22:55:03.591 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-15T22:55:03.591 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-09-15T22:55:03.591 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T22:55:03.592 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 79 M 2024-09-15T22:55:03.592 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 126 M 2024-09-15T22:55:03.592 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-15T22:55:03.838 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 174 kB/s | 23 kB 00:00 2024-09-15T22:55:03.894 INFO:teuthology.orchestra.run.smithi145.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 43 kB/s | 23 kB 00:00 2024-09-15T22:55:04.313 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-15T22:55:04.769 INFO:teuthology.orchestra.run.smithi145.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-15T22:55:04.913 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-15T22:55:05.180 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 21 MB/s | 29 MB 00:01 2024-09-15T22:55:05.181 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:55:05.181 INFO:teuthology.orchestra.run.smithi002.stdout:Total 50 MB/s | 79 MB 00:01 2024-09-15T22:55:05.411 INFO:teuthology.orchestra.run.smithi145.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-15T22:55:05.891 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-15T22:55:06.111 INFO:teuthology.orchestra.run.smithi145.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-15T22:55:06.111 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:55:06.112 INFO:teuthology.orchestra.run.smithi145.stdout:Total 27 MB/s | 79 MB 00:02 2024-09-15T22:55:06.253 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-15T22:55:06.253 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-15T22:55:06.795 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-15T22:55:07.091 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-09-15T22:55:07.178 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-15T22:55:07.178 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-15T22:55:07.251 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-15T22:55:07.251 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-15T22:55:08.114 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-15T22:55:08.115 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-15T22:55:09.072 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T22:55:09.072 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T22:55:09.177 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-15T22:55:09.186 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-15T22:55:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-09-15T22:55:09.186 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-15T22:55:09.186 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-15T22:55:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T22:55:09.186 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-15T22:55:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T22:55:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T22:55:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T22:55:09.186 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:55:09.186 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-15T22:55:09.186 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-15T22:55:09.187 INFO:teuthology.orchestra.run.smithi112.stdout:Install 4 Packages 2024-09-15T22:55:09.187 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:55:09.187 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 79 M 2024-09-15T22:55:09.187 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 126 M 2024-09-15T22:55:09.187 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-15T22:55:09.551 INFO:teuthology.orchestra.run.smithi112.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 267 kB/s | 23 kB 00:00 2024-09-15T22:55:09.816 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-15T22:55:10.506 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:55:10.561 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-15T22:55:10.588 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:55:11.202 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:55:11.286 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:55:12.176 INFO:teuthology.orchestra.run.smithi112.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.8 MB/s | 16 MB 00:02 2024-09-15T22:55:13.368 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:55:13.492 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:55:13.693 INFO:teuthology.orchestra.run.smithi112.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.9 MB/s | 29 MB 00:04 2024-09-15T22:55:14.081 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:55:14.215 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:55:14.560 INFO:teuthology.orchestra.run.smithi112.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.8 MB/s | 35 MB 00:05 2024-09-15T22:55:14.560 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:55:14.561 INFO:teuthology.orchestra.run.smithi112.stdout:Total 15 MB/s | 79 MB 00:05 2024-09-15T22:55:15.243 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-15T22:55:15.604 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-15T22:55:15.604 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-15T22:55:16.571 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-15T22:55:16.571 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-15T22:55:18.614 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:55:18.659 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:55:19.002 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-15T22:55:19.031 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:55:19.065 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:55:19.671 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:55:19.761 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:55:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:55:22.708 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:55:23.803 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:55:23.924 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:55:27.557 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:55:27.598 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:55:32.470 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:56:02.144 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:56:02.193 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:56:02.518 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:56:02.518 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:56:02.518 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:56:02.518 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:56:02.702 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:56:02.744 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:56:03.093 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:56:03.093 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:56:03.093 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:56:03.093 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:56:03.377 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:56:03.377 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T22:56:03.377 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-15T22:56:03.377 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T22:56:03.377 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T22:56:03.377 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T22:56:03.377 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T22:56:03.377 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T22:56:03.378 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-15T22:56:03.734 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:56:03.810 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:56:03.811 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:56:03.811 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T22:56:03.811 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T22:56:03.811 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T22:56:03.811 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-15T22:56:03.811 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi145.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T22:56:03.811 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:56:03.869 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:56:03.869 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:56:03.870 DEBUG:teuthology.orchestra.run.smithi145:> sudo rpm -qi grub2-tools 2024-09-15T22:56:03.901 INFO:teuthology.orchestra.run.smithi145.stdout:Name : grub2-tools 2024-09-15T22:56:03.901 INFO:teuthology.orchestra.run.smithi145.stdout:Epoch : 1 2024-09-15T22:56:03.901 INFO:teuthology.orchestra.run.smithi145.stdout:Version : 2.06 2024-09-15T22:56:03.901 INFO:teuthology.orchestra.run.smithi145.stdout:Release : 82.el9 2024-09-15T22:56:03.901 INFO:teuthology.orchestra.run.smithi145.stdout:Architecture: x86_64 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout:Group : Unspecified 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout:Size : 8274670 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout:License : GPLv3+ 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout:Packager : builder@centos.org 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout:Vendor : CentOS 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout:Summary : Support tools for GRUB. 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout:Description : 2024-09-15T22:56:03.902 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T22:56:03.903 INFO:teuthology.orchestra.run.smithi145.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T22:56:03.903 INFO:teuthology.orchestra.run.smithi145.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T22:56:03.903 INFO:teuthology.orchestra.run.smithi145.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T22:56:03.903 INFO:teuthology.orchestra.run.smithi145.stdout:hardware devices. 2024-09-15T22:56:03.903 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T22:56:03.903 INFO:teuthology.orchestra.run.smithi145.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T22:56:03.904 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T22:56:03.904 INFO:teuthology.task.kernel:Updating grub on smithi145 to boot 5.14.0-505.el9.x86_64 2024-09-15T22:56:03.904 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T22:56:03.948 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:56:03.948 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T22:56:03.948 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-15T22:56:03.948 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T22:56:03.948 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T22:56:03.948 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T22:56:03.949 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T22:56:03.949 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T22:56:03.949 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-15T22:56:04.273 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:56:04.367 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:56:04.367 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:56:04.367 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T22:56:04.367 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T22:56:04.367 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T22:56:04.368 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-15T22:56:04.368 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T22:56:04.368 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:56:04.426 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:56:04.426 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:56:04.427 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-09-15T22:56:04.461 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-09-15T22:56:04.461 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-09-15T22:56:04.461 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 82.el9 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8274670 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T22:56:04.462 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-09-15T22:56:04.463 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-09-15T22:56:04.463 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T22:56:04.463 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T22:56:04.463 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T22:56:04.463 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T22:56:04.463 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-09-15T22:56:04.463 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T22:56:04.463 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T22:56:04.464 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T22:56:04.464 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 5.14.0-505.el9.x86_64 2024-09-15T22:56:04.464 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T22:56:04.572 INFO:teuthology.orchestra.run.smithi145.stderr:Generating grub configuration file ... 2024-09-15T22:56:05.031 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-09-15T22:56:05.893 INFO:teuthology.orchestra.run.smithi145.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T22:56:05.922 INFO:teuthology.orchestra.run.smithi145.stderr:done 2024-09-15T22:56:05.924 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-09-15T22:56:05.940 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.gr3A3jJGOL 2024-09-15T22:56:05.940 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gr3A3jJGOL 2024-09-15T22:56:06.011 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.gr3A3jJGOL 2024-09-15T22:56:06.150 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.gr3A3jJGOL is 6KB 2024-09-15T22:56:06.198 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.gr3A3jJGOL 2024-09-15T22:56:06.213 DEBUG:teuthology.orchestra.run.smithi145:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T22:56:06.276 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T22:56:06.276 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T22:56:06.276 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T22:56:06.276 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T22:56:06.278 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T22:56:06.390 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T22:56:06.412 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-09-15T22:56:06.414 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-15T22:56:06.429 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.vsctxdpkC5 2024-09-15T22:56:06.430 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vsctxdpkC5 2024-09-15T22:56:06.432 DEBUG:teuthology.orchestra.run.smithi145:> sudo shutdown -r now 2024-09-15T22:56:06.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.vsctxdpkC5 2024-09-15T22:56:06.644 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.vsctxdpkC5 is 6KB 2024-09-15T22:56:06.664 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.vsctxdpkC5 2024-09-15T22:56:06.678 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T22:56:06.750 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T22:56:06.750 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T22:56:06.751 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T22:56:06.751 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T22:56:06.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T22:56:06.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-09-15T22:56:10.579 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:56:10.618 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:56:10.944 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:56:10.945 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T22:56:10.945 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T22:56:10.945 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T22:56:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T22:56:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:56:11.858 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-15T22:56:11.858 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T22:56:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T22:56:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T22:56:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T22:56:11.859 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:56:11.859 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-15T22:56:12.203 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:56:12.293 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:56:12.293 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:56:12.293 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T22:56:12.293 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T22:56:12.293 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T22:56:12.293 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-15T22:56:12.293 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T22:56:12.294 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T22:56:12.351 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T22:56:12.351 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T22:56:12.351 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -qi grub2-tools 2024-09-15T22:56:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:Name : grub2-tools 2024-09-15T22:56:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:Epoch : 1 2024-09-15T22:56:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:Version : 2.06 2024-09-15T22:56:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:Release : 82.el9 2024-09-15T22:56:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: x86_64 2024-09-15T22:56:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T22:56:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:Group : Unspecified 2024-09-15T22:56:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:Size : 8274670 2024-09-15T22:56:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:License : GPLv3+ 2024-09-15T22:56:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T22:56:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T22:56:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T22:56:12.383 INFO:teuthology.orchestra.run.smithi112.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T22:56:12.384 INFO:teuthology.orchestra.run.smithi112.stdout:Packager : builder@centos.org 2024-09-15T22:56:12.384 INFO:teuthology.orchestra.run.smithi112.stdout:Vendor : CentOS 2024-09-15T22:56:12.384 INFO:teuthology.orchestra.run.smithi112.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T22:56:12.384 INFO:teuthology.orchestra.run.smithi112.stdout:Summary : Support tools for GRUB. 2024-09-15T22:56:12.384 INFO:teuthology.orchestra.run.smithi112.stdout:Description : 2024-09-15T22:56:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:56:12.384 INFO:teuthology.orchestra.run.smithi112.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T22:56:12.384 INFO:teuthology.orchestra.run.smithi112.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T22:56:12.384 INFO:teuthology.orchestra.run.smithi112.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T22:56:12.384 INFO:teuthology.orchestra.run.smithi112.stdout:hardware devices. 2024-09-15T22:56:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T22:56:12.384 INFO:teuthology.orchestra.run.smithi112.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T22:56:12.385 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T22:56:12.385 INFO:teuthology.task.kernel:Updating grub on smithi112 to boot 5.14.0-505.el9.x86_64 2024-09-15T22:56:12.386 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T22:56:13.075 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-09-15T22:56:14.354 INFO:teuthology.orchestra.run.smithi112.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T22:56:14.375 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-09-15T22:56:14.377 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-15T22:56:14.393 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.YIaAgd2eYN 2024-09-15T22:56:14.393 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YIaAgd2eYN 2024-09-15T22:56:14.460 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.YIaAgd2eYN 2024-09-15T22:56:14.601 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.YIaAgd2eYN is 6KB 2024-09-15T22:56:14.650 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.YIaAgd2eYN 2024-09-15T22:56:14.665 DEBUG:teuthology.orchestra.run.smithi112:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T22:56:14.727 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T22:56:14.728 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T22:56:14.728 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T22:56:14.728 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T22:56:14.729 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T22:56:14.884 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-09-15T22:56:36.453 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-15T22:56:36.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-15T22:56:36.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:56:36.903 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-15T22:56:36.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-15T22:56:36.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:56:44.895 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-15T22:56:44.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T22:56:44.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:56:54.845 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-15T22:56:55.361 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-09-15T22:57:03.293 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-15T22:57:03.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-15T22:57:03.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:57:04.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-15T22:57:04.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:57:06.909 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-15T22:57:12.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T22:57:12.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:57:15.361 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-15T22:57:18.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-15T22:57:18.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:57:27.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T22:57:27.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:57:37.345 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-15T22:57:45.789 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-15T22:57:52.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-15T22:57:52.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:57:52.708 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-15T22:57:53.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-15T22:57:53.487 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-505.el9.x86_64"... 2024-09-15T22:57:53.488 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-15T22:57:53.504 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-505.el9.x86_64 2024-09-15T22:57:53.504 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T22:57:53.504 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:57:53.504 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T22:57:54.506 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-15T22:57:54.506 DEBUG:teuthology.orchestra.run.smithi145:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T22:57:54.580 INFO:teuthology.orchestra.run.smithi145.stdout:ttyS1 2024-09-15T22:57:54.608 DEBUG:teuthology.parallel:result is None 2024-09-15T22:58:00.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T22:58:00.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:58:01.165 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-15T22:58:01.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T22:58:01.581 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-15T22:58:01.581 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-15T22:58:01.595 INFO:teuthology.orchestra.run.smithi112.stdout:5.14.0-505.el9.x86_64 2024-09-15T22:58:01.595 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T22:58:01.595 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:58:01.595 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T22:58:02.596 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-15T22:58:02.596 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T22:58:02.704 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-09-15T22:58:02.723 DEBUG:teuthology.parallel:result is None 2024-09-15T22:58:04.365 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T22:58:16.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-15T22:58:16.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:58:16.628 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-15T22:58:16.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-15T22:58:16.957 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-15T22:58:16.957 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-15T22:58:16.973 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-505.el9.x86_64 2024-09-15T22:58:16.973 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T22:58:16.974 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:58:16.974 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T22:58:17.974 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-15T22:58:17.974 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T22:58:18.051 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2024-09-15T22:58:18.080 DEBUG:teuthology.parallel:result is None 2024-09-15T22:58:18.080 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T22:58:18.086 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T22:58:18.086 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:58:18.089 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:58:18.092 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:58:18.111 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T22:58:18.158 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T22:58:18.166 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T22:58:18.166 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:58:18.168 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:58:18.171 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:58:18.233 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T22:58:18.242 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T22:58:18.242 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:58:18.245 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:58:18.247 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:58:18.278 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:58:18.289 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:58:18.293 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:58:18.296 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:58:18.305 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:58:18.308 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:58:18.310 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T22:58:18.317 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T22:58:18.317 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:58:18.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:58:18.337 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:58:18.365 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T22:58:18.373 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T22:58:18.373 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:58:18.403 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:58:18.405 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:58:18.422 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:58:18.502 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:58:18.553 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:58:18.636 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:58:18.678 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T22:58:18.678 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:58:18.744 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:58:18.789 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:58:18.865 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:58:18.909 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:58:18.951 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T22:58:18.951 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:58:19.019 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:58:19.062 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:58:19.118 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:58:19.199 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:58:19.246 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-15T22:58:19.246 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:58:19.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-09-15T22:58:19.314 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-15T22:58:19.317 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2024-09-15T22:58:19.354 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:58:19.369 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:58:19.404 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:58:19.880 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T22:58:19.887 INFO:teuthology.task.internal:Starting timer... 2024-09-15T22:58:19.887 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T22:58:19.918 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T22:58:19.929 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-15T22:58:19.929 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-09-15T22:58:19.987 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-09-15T22:58:19.988 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2024-09-15T22:58:20.035 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2024-09-15T22:58:20.037 DEBUG:teuthology.orchestra.run.smithi145:> sudo service auditd rotate 2024-09-15T22:58:20.077 INFO:teuthology.orchestra.run.smithi145.stdout:Rotating logs: 2024-09-15T22:58:20.079 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T22:58:20.079 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-09-15T22:58:20.110 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-09-15T22:58:20.111 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2024-09-15T22:58:20.131 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2024-09-15T22:58:20.131 DEBUG:teuthology.orchestra.run.smithi145:> /usr/sbin/getenforce 2024-09-15T22:58:20.157 INFO:teuthology.orchestra.run.smithi145.stdout:Permissive 2024-09-15T22:58:20.157 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi112.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi145.front.sepia.ceph.com': 'permissive'} 2024-09-15T22:58:20.158 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:58:20.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:58:20.186 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:58:20.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:58:20.216 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:58:20.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:58:20.244 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T22:58:20.244 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:58:20.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:58:20.308 DEBUG:teuthology.orchestra.run.smithi145:> sudo /usr/sbin/setenforce permissive 2024-09-15T22:58:20.342 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T22:58:20.350 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-15T22:58:20.353 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-15T22:58:20.461 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T22:58:20.472 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T22:58:20.473 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi112.front.sepia.ceph.com,smithi145.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T23:02:09.346 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com')] 2024-09-15T23:02:09.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-15T23:02:09.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:02:09.432 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-15T23:02:09.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-15T23:02:09.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T23:02:09.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:02:09.594 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-15T23:02:09.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-15T23:02:09.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-15T23:02:09.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:02:09.754 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-15T23:02:09.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-15T23:02:09.835 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T23:02:09.846 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T23:02:09.846 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T23:02:09.847 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:02:09.849 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T23:02:09.849 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:02:09.852 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T23:02:09.852 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:02:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T23:02:09.882 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T23:02:09.898 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T23:02:09.899 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T23:02:09.907 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T23:02:09.922 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T23:02:09.924 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2024-09-15T23:02:09.927 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-09-15T23:02:09.936 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2024-09-15T23:02:09.939 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-09-15T23:02:09.948 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: ntpd: command not found 2024-09-15T23:02:09.950 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T23:02:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T23:02:09.959 INFO:teuthology.orchestra.run.smithi145.stdout:506 Cannot talk to daemon 2024-09-15T23:02:09.965 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T23:02:09.970 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T23:02:09.974 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T23:02:09.988 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T23:02:10.028 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:02:10.032 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:02:10.032 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-15T23:02:10.032 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:02:10.032 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:02:10.032 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:02:10.032 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:02:10.038 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:02:10.044 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:02:10.044 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-15T23:02:10.044 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:02:10.044 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:02:10.045 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:02:10.045 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:02:10.045 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:02:10.050 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:02:10.050 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-09-15T23:02:10.050 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:02:10.050 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:02:10.050 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:02:10.050 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:02:10.050 INFO:teuthology.run_tasks:Running task install... 2024-09-15T23:02:10.057 DEBUG:teuthology.task.install:project ceph 2024-09-15T23:02:10.058 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T23:02:10.058 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T23:02:10.058 INFO:teuthology.task.install:Using flavor: default 2024-09-15T23:02:10.064 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T23:02:10.065 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T23:02:10.065 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T23:02:10.066 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:02:10.068 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T23:02:10.068 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:02:10.069 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T23:02:10.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:02:10.216 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T23:02:10.216 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T23:02:10.220 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T23:02:10.220 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T23:02:10.224 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T23:02:10.225 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T23:02:10.326 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T23:02:10.326 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:02:10.326 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T23:02:10.331 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T23:02:10.332 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:02:10.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T23:02:10.337 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T23:02:10.338 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-15T23:02:10.338 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T23:02:10.353 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T23:02:10.354 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T23:02:10.360 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T23:02:10.360 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T23:02:10.364 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T23:02:10.364 DEBUG:teuthology.orchestra.run.smithi145:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T23:02:10.422 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T23:02:10.426 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T23:02:10.429 DEBUG:teuthology.orchestra.run.smithi145:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T23:02:10.499 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T23:02:10.500 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T23:02:10.505 DEBUG:teuthology.orchestra.run.smithi145:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T23:02:10.564 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-09-15T23:02:10.565 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2024-09-15T23:02:10.566 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-09-15T23:02:10.567 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2024-09-15T23:02:10.569 INFO:teuthology.orchestra.run.smithi145.stdout:check_obsoletes = 1 2024-09-15T23:02:10.571 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum clean all 2024-09-15T23:02:10.800 INFO:teuthology.orchestra.run.smithi145.stdout:45 files removed 2024-09-15T23:02:10.801 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-09-15T23:02:10.805 INFO:teuthology.orchestra.run.smithi112.stdout:45 files removed 2024-09-15T23:02:10.827 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T23:02:10.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T23:02:10.834 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T23:02:11.386 INFO:teuthology.orchestra.run.smithi145.stdout:ceph packages for x86_64 306 kB/s | 83 kB 00:00 2024-09-15T23:02:11.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 321 kB/s | 83 kB 00:00 2024-09-15T23:02:11.399 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 299 kB/s | 83 kB 00:00 2024-09-15T23:02:11.669 INFO:teuthology.orchestra.run.smithi145.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-15T23:02:11.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-15T23:02:11.685 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-15T23:02:11.945 INFO:teuthology.orchestra.run.smithi145.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-15T23:02:11.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-15T23:02:11.969 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-15T23:02:12.482 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-15T23:02:13.837 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-15T23:02:15.025 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-15T23:02:15.605 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-15T23:02:16.718 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.2 MB 00:04 2024-09-15T23:02:18.403 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-15T23:02:19.792 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 6.5 MB 00:00 2024-09-15T23:02:19.997 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-15T23:02:21.585 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 19 kB 00:00 2024-09-15T23:02:21.890 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 19 kB 00:00 2024-09-15T23:02:22.737 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-15T23:02:22.997 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-15T23:02:23.061 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-15T23:02:24.588 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-15T23:02:25.500 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-15T23:02:28.426 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-15T23:02:28.604 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-15T23:02:30.768 INFO:teuthology.orchestra.run.smithi145.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:02:30.769 INFO:teuthology.orchestra.run.smithi145.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:02:30.781 INFO:teuthology.orchestra.run.smithi145.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T23:02:30.781 INFO:teuthology.orchestra.run.smithi145.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T23:02:30.782 INFO:teuthology.orchestra.run.smithi145.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T23:02:30.783 INFO:teuthology.orchestra.run.smithi145.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T23:02:30.785 INFO:teuthology.orchestra.run.smithi145.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T23:02:30.787 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T23:02:30.788 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T23:02:30.851 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-15T23:02:30.876 INFO:teuthology.orchestra.run.smithi145.stdout:====================================================================================== 2024-09-15T23:02:30.876 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-15T23:02:30.876 INFO:teuthology.orchestra.run.smithi145.stdout:====================================================================================== 2024-09-15T23:02:30.876 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-15T23:02:30.876 INFO:teuthology.orchestra.run.smithi145.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T23:02:30.876 INFO:teuthology.orchestra.run.smithi145.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T23:02:30.876 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T23:02:30.876 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T23:02:30.877 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T23:02:30.877 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T23:02:30.877 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T23:02:30.877 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T23:02:30.877 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T23:02:30.877 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T23:02:30.877 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T23:02:30.877 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T23:02:30.877 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T23:02:30.877 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T23:02:30.877 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T23:02:30.877 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T23:02:30.878 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T23:02:30.878 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T23:02:30.878 INFO:teuthology.orchestra.run.smithi145.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T23:02:30.878 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T23:02:30.878 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T23:02:30.878 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T23:02:30.878 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T23:02:30.878 INFO:teuthology.orchestra.run.smithi145.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T23:02:30.878 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T23:02:30.878 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T23:02:30.878 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T23:02:30.878 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T23:02:30.879 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T23:02:30.879 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T23:02:30.879 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T23:02:30.879 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T23:02:30.879 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T23:02:30.879 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T23:02:30.879 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T23:02:30.879 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T23:02:30.879 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T23:02:30.879 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2024-09-15T23:02:30.879 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T23:02:30.879 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T23:02:30.880 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T23:02:30.880 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T23:02:30.880 INFO:teuthology.orchestra.run.smithi145.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T23:02:30.880 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T23:02:30.880 INFO:teuthology.orchestra.run.smithi145.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T23:02:30.880 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T23:02:30.880 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-15T23:02:30.880 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T23:02:30.880 INFO:teuthology.orchestra.run.smithi145.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T23:02:30.880 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T23:02:30.880 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T23:02:30.881 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T23:02:30.881 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T23:02:30.881 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T23:02:30.881 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T23:02:30.881 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T23:02:30.881 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T23:02:30.881 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T23:02:30.881 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T23:02:30.881 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T23:02:30.881 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T23:02:30.881 INFO:teuthology.orchestra.run.smithi145.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T23:02:30.881 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T23:02:30.881 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T23:02:30.882 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T23:02:30.882 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T23:02:30.882 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T23:02:30.882 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T23:02:30.882 INFO:teuthology.orchestra.run.smithi145.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T23:02:30.882 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T23:02:30.882 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T23:02:30.882 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T23:02:30.882 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T23:02:30.882 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T23:02:30.882 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T23:02:30.882 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T23:02:30.882 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T23:02:30.883 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T23:02:30.883 INFO:teuthology.orchestra.run.smithi145.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T23:02:30.883 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T23:02:30.883 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T23:02:30.883 INFO:teuthology.orchestra.run.smithi145.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T23:02:30.883 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T23:02:30.883 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T23:02:30.883 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T23:02:30.883 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T23:02:30.883 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T23:02:30.883 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T23:02:30.883 INFO:teuthology.orchestra.run.smithi145.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T23:02:30.884 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T23:02:30.884 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T23:02:30.884 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T23:02:30.884 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T23:02:30.884 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T23:02:30.884 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T23:02:30.884 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T23:02:30.884 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T23:02:30.884 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T23:02:30.884 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T23:02:30.884 INFO:teuthology.orchestra.run.smithi145.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T23:02:30.884 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T23:02:30.884 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T23:02:30.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T23:02:30.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T23:02:30.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T23:02:30.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T23:02:30.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T23:02:30.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T23:02:30.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T23:02:30.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T23:02:30.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T23:02:30.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T23:02:30.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T23:02:30.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T23:02:30.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T23:02:30.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T23:02:30.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T23:02:30.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T23:02:30.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T23:02:30.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T23:02:30.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T23:02:30.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T23:02:30.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T23:02:30.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T23:02:30.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T23:02:30.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T23:02:30.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T23:02:30.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T23:02:30.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T23:02:30.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T23:02:30.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T23:02:30.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T23:02:30.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T23:02:30.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T23:02:30.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T23:02:30.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T23:02:30.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T23:02:30.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T23:02:30.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T23:02:30.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T23:02:30.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T23:02:30.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T23:02:30.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T23:02:30.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T23:02:30.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T23:02:30.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T23:02:30.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T23:02:30.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T23:02:30.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout:Installing weak dependencies: 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout:====================================================================================== 2024-09-15T23:02:30.889 INFO:teuthology.orchestra.run.smithi145.stdout:Install 148 Packages 2024-09-15T23:02:30.890 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 8 Packages 2024-09-15T23:02:30.890 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:02:30.890 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 226 M 2024-09-15T23:02:30.890 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-15T23:02:30.981 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 8.5 kB/s | 1.7 kB 00:00 2024-09-15T23:02:31.005 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:02:31.006 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:02:31.018 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T23:02:31.018 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T23:02:31.019 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T23:02:31.020 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T23:02:31.022 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T23:02:31.025 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T23:02:31.025 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T23:02:31.091 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-15T23:02:31.116 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-15T23:02:31.116 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-15T23:02:31.116 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-15T23:02:31.116 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-15T23:02:31.116 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T23:02:31.116 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T23:02:31.116 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T23:02:31.116 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T23:02:31.116 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T23:02:31.117 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T23:02:31.117 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T23:02:31.117 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T23:02:31.117 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T23:02:31.117 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T23:02:31.117 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T23:02:31.117 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T23:02:31.117 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T23:02:31.117 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T23:02:31.117 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T23:02:31.117 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T23:02:31.117 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T23:02:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T23:02:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T23:02:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T23:02:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T23:02:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T23:02:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T23:02:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T23:02:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T23:02:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T23:02:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T23:02:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T23:02:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T23:02:31.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T23:02:31.119 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T23:02:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T23:02:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T23:02:31.120 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-15T23:02:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T23:02:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T23:02:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T23:02:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T23:02:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T23:02:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T23:02:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T23:02:31.122 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T23:02:31.122 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T23:02:31.122 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T23:02:31.122 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T23:02:31.122 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T23:02:31.122 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T23:02:31.122 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T23:02:31.122 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T23:02:31.122 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T23:02:31.122 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T23:02:31.122 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T23:02:31.122 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T23:02:31.122 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T23:02:31.123 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T23:02:31.124 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T23:02:31.124 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T23:02:31.124 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T23:02:31.124 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T23:02:31.124 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T23:02:31.124 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T23:02:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T23:02:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T23:02:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T23:02:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T23:02:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T23:02:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T23:02:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T23:02:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T23:02:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T23:02:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T23:02:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T23:02:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T23:02:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T23:02:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T23:02:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T23:02:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T23:02:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T23:02:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T23:02:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T23:02:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T23:02:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T23:02:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T23:02:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T23:02:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T23:02:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T23:02:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T23:02:31.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T23:02:31.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T23:02:31.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T23:02:31.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T23:02:31.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T23:02:31.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T23:02:31.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T23:02:31.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T23:02:31.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T23:02:31.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T23:02:31.128 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T23:02:31.128 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T23:02:31.128 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T23:02:31.129 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T23:02:31.129 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T23:02:31.129 INFO:teuthology.orchestra.run.smithi002.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T23:02:31.129 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T23:02:31.129 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T23:02:31.129 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-09-15T23:02:31.129 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T23:02:31.129 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:02:31.129 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-15T23:02:31.129 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-15T23:02:31.129 INFO:teuthology.orchestra.run.smithi002.stdout:Install 148 Packages 2024-09-15T23:02:31.129 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 8 Packages 2024-09-15T23:02:31.129 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:02:31.130 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 226 M 2024-09-15T23:02:31.130 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-15T23:02:31.326 INFO:teuthology.orchestra.run.smithi145.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 53 kB/s | 6.5 kB 00:00 2024-09-15T23:02:31.520 INFO:teuthology.orchestra.run.smithi145.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 4.5 MB/s | 896 kB 00:00 2024-09-15T23:02:31.587 INFO:teuthology.orchestra.run.smithi145.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 2.1 MB/s | 145 kB 00:00 2024-09-15T23:02:31.754 INFO:teuthology.orchestra.run.smithi145.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 9.8 MB/s | 5.4 MB 00:00 2024-09-15T23:02:32.071 INFO:teuthology.orchestra.run.smithi002.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 38 kB/s | 6.5 kB 00:00 2024-09-15T23:02:32.072 INFO:teuthology.orchestra.run.smithi145.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-15T23:02:32.072 INFO:teuthology.orchestra.run.smithi145.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 11 MB/s | 1.5 MB 00:00 2024-09-15T23:02:32.205 INFO:teuthology.orchestra.run.smithi145.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-15T23:02:32.463 INFO:teuthology.orchestra.run.smithi002.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 1.5 MB/s | 896 kB 00:00 2024-09-15T23:02:32.555 INFO:teuthology.orchestra.run.smithi002.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.5 MB/s | 145 kB 00:00 2024-09-15T23:02:32.588 INFO:teuthology.orchestra.run.smithi145.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 15 MB/s | 21 MB 00:01 2024-09-15T23:02:32.622 INFO:teuthology.orchestra.run.smithi145.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 763 kB/s | 25 kB 00:00 2024-09-15T23:02:32.947 INFO:teuthology.orchestra.run.smithi145.stdout:(10/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 16 MB/s | 17 MB 00:01 2024-09-15T23:02:33.064 INFO:teuthology.orchestra.run.smithi145.stdout:(11/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 12 MB/s | 11 MB 00:00 2024-09-15T23:02:33.089 INFO:teuthology.orchestra.run.smithi145.stdout:(12/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 1.6 MB/s | 228 kB 00:00 2024-09-15T23:02:33.105 INFO:teuthology.orchestra.run.smithi002.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 3.9 MB/s | 5.4 MB 00:01 2024-09-15T23:02:33.114 INFO:teuthology.orchestra.run.smithi145.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 540 kB/s | 27 kB 00:00 2024-09-15T23:02:33.140 INFO:teuthology.orchestra.run.smithi145.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 630 kB/s | 32 kB 00:00 2024-09-15T23:02:33.155 INFO:teuthology.orchestra.run.smithi002.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 4.0 MB/s | 2.4 MB 00:00 2024-09-15T23:02:33.173 INFO:teuthology.orchestra.run.smithi145.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 751 kB 00:00 2024-09-15T23:02:33.198 INFO:teuthology.orchestra.run.smithi145.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.7 MB/s | 163 kB 00:00 2024-09-15T23:02:33.224 INFO:teuthology.orchestra.run.smithi145.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T23:02:33.249 INFO:teuthology.orchestra.run.smithi145.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 9.9 MB/s | 506 kB 00:00 2024-09-15T23:02:33.308 INFO:teuthology.orchestra.run.smithi145.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 772 kB/s | 45 kB 00:00 2024-09-15T23:02:33.333 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:02:33.334 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:02:33.345 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T23:02:33.345 INFO:teuthology.orchestra.run.smithi112.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T23:02:33.346 INFO:teuthology.orchestra.run.smithi112.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T23:02:33.347 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T23:02:33.349 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T23:02:33.351 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T23:02:33.352 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T23:02:33.383 INFO:teuthology.orchestra.run.smithi145.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.8 MB/s | 136 kB 00:00 2024-09-15T23:02:33.397 INFO:teuthology.orchestra.run.smithi002.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 5.2 MB/s | 1.5 MB 00:00 2024-09-15T23:02:33.413 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-15T23:02:33.430 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-15T23:02:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-15T23:02:33.431 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-15T23:02:33.431 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-15T23:02:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T23:02:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T23:02:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T23:02:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T23:02:33.431 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T23:02:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T23:02:33.432 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T23:02:33.433 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T23:02:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T23:02:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T23:02:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T23:02:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T23:02:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T23:02:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T23:02:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T23:02:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T23:02:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T23:02:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T23:02:33.434 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T23:02:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T23:02:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T23:02:33.435 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T23:02:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T23:02:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T23:02:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T23:02:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T23:02:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T23:02:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T23:02:33.436 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T23:02:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T23:02:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T23:02:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T23:02:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T23:02:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T23:02:33.437 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2024-09-15T23:02:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T23:02:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T23:02:33.437 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T23:02:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T23:02:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T23:02:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T23:02:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T23:02:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T23:02:33.438 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-15T23:02:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T23:02:33.438 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T23:02:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T23:02:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T23:02:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T23:02:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T23:02:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T23:02:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T23:02:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T23:02:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T23:02:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T23:02:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T23:02:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T23:02:33.439 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T23:02:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T23:02:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T23:02:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T23:02:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T23:02:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T23:02:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T23:02:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T23:02:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T23:02:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T23:02:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T23:02:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T23:02:33.440 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T23:02:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T23:02:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T23:02:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T23:02:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T23:02:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T23:02:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T23:02:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T23:02:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T23:02:33.441 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T23:02:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T23:02:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T23:02:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T23:02:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T23:02:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T23:02:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T23:02:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T23:02:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T23:02:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T23:02:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T23:02:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T23:02:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T23:02:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T23:02:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T23:02:33.443 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T23:02:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T23:02:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T23:02:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T23:02:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T23:02:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T23:02:33.444 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T23:02:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T23:02:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T23:02:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T23:02:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T23:02:33.445 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T23:02:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T23:02:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T23:02:33.446 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T23:02:33.447 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T23:02:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T23:02:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T23:02:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T23:02:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T23:02:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T23:02:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T23:02:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T23:02:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T23:02:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T23:02:33.448 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T23:02:33.449 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T23:02:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T23:02:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T23:02:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T23:02:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T23:02:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T23:02:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T23:02:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T23:02:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T23:02:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T23:02:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T23:02:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T23:02:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T23:02:33.450 INFO:teuthology.orchestra.run.smithi112.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T23:02:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T23:02:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T23:02:33.451 INFO:teuthology.orchestra.run.smithi112.stdout:Installing weak dependencies: 2024-09-15T23:02:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T23:02:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:02:33.451 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-15T23:02:33.451 INFO:teuthology.orchestra.run.smithi112.stdout:====================================================================================== 2024-09-15T23:02:33.451 INFO:teuthology.orchestra.run.smithi112.stdout:Install 148 Packages 2024-09-15T23:02:33.451 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 8 Packages 2024-09-15T23:02:33.451 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:02:33.452 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 226 M 2024-09-15T23:02:33.452 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-15T23:02:33.492 INFO:teuthology.orchestra.run.smithi145.stdout:(21/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 20 MB/s | 5.3 MB 00:00 2024-09-15T23:02:33.517 INFO:teuthology.orchestra.run.smithi145.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.2 MB/s | 161 kB 00:00 2024-09-15T23:02:33.559 INFO:teuthology.orchestra.run.smithi145.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 4.7 MB/s | 320 kB 00:00 2024-09-15T23:02:33.584 INFO:teuthology.orchestra.run.smithi145.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 4.4 MB/s | 300 kB 00:00 2024-09-15T23:02:33.610 INFO:teuthology.orchestra.run.smithi145.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T23:02:33.651 INFO:teuthology.orchestra.run.smithi145.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-15T23:02:33.735 INFO:teuthology.orchestra.run.smithi145.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.0 MB/s | 170 kB 00:00 2024-09-15T23:02:33.810 INFO:teuthology.orchestra.run.smithi145.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-15T23:02:33.827 INFO:teuthology.orchestra.run.smithi145.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 347 kB/s | 32 kB 00:00 2024-09-15T23:02:33.833 INFO:teuthology.orchestra.run.smithi112.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 40 kB/s | 6.5 kB 00:00 2024-09-15T23:02:33.861 INFO:teuthology.orchestra.run.smithi145.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.8 MB/s | 146 kB 00:00 2024-09-15T23:02:34.103 INFO:teuthology.orchestra.run.smithi145.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 13 MB/s | 3.6 MB 00:00 2024-09-15T23:02:34.170 INFO:teuthology.orchestra.run.smithi145.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 3.7 MB/s | 249 kB 00:00 2024-09-15T23:02:34.229 INFO:teuthology.orchestra.run.smithi145.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 850 kB/s | 49 kB 00:00 2024-09-15T23:02:34.346 INFO:teuthology.orchestra.run.smithi145.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 15 MB/s | 7.4 MB 00:00 2024-09-15T23:02:34.355 INFO:teuthology.orchestra.run.smithi002.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 3.9 MB/s | 4.7 MB 00:01 2024-09-15T23:02:34.362 INFO:teuthology.orchestra.run.smithi145.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 123 kB/s | 16 kB 00:00 2024-09-15T23:02:34.396 INFO:teuthology.orchestra.run.smithi145.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.6 MB/s | 285 kB 00:00 2024-09-15T23:02:34.455 INFO:teuthology.orchestra.run.smithi145.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 8.1 MB/s | 765 kB 00:00 2024-09-15T23:02:34.471 INFO:teuthology.orchestra.run.smithi145.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 243 kB/s | 18 kB 00:00 2024-09-15T23:02:34.833 INFO:teuthology.orchestra.run.smithi112.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 896 kB/s | 896 kB 00:00 2024-09-15T23:02:34.938 INFO:teuthology.orchestra.run.smithi145.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 171 kB/s | 80 kB 00:00 2024-09-15T23:02:34.991 INFO:teuthology.orchestra.run.smithi112.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 918 kB/s | 145 kB 00:00 2024-09-15T23:02:35.181 INFO:teuthology.orchestra.run.smithi145.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 791 kB/s | 191 kB 00:00 2024-09-15T23:02:35.214 INFO:teuthology.orchestra.run.smithi145.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-15T23:02:35.648 INFO:teuthology.orchestra.run.smithi145.stdout:(42/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 16 MB/s | 49 MB 00:03 2024-09-15T23:02:35.673 INFO:teuthology.orchestra.run.smithi145.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 514 kB/s | 253 kB 00:00 2024-09-15T23:02:35.707 INFO:teuthology.orchestra.run.smithi145.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 2.5 MB/s | 1.2 MB 00:00 2024-09-15T23:02:35.756 INFO:teuthology.orchestra.run.smithi002.stdout:(8/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86_ 7.1 MB/s | 17 MB 00:02 2024-09-15T23:02:35.767 INFO:teuthology.orchestra.run.smithi112.stdout:(4/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 10 MB/s | 21 MB 00:02 2024-09-15T23:02:35.790 INFO:teuthology.orchestra.run.smithi145.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-15T23:02:35.806 INFO:teuthology.orchestra.run.smithi002.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 507 kB/s | 25 kB 00:00 2024-09-15T23:02:35.832 INFO:teuthology.orchestra.run.smithi145.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 996 kB/s | 125 kB 00:00 2024-09-15T23:02:35.850 INFO:teuthology.orchestra.run.smithi112.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 18 MB/s | 1.5 MB 00:00 2024-09-15T23:02:35.908 INFO:teuthology.orchestra.run.smithi145.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-15T23:02:36.033 INFO:teuthology.orchestra.run.smithi145.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-15T23:02:36.050 INFO:teuthology.orchestra.run.smithi112.stdout:(6/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 24 MB/s | 4.7 MB 00:00 2024-09-15T23:02:36.091 INFO:teuthology.orchestra.run.smithi145.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-15T23:02:36.106 INFO:teuthology.orchestra.run.smithi002.stdout:(10/156): ceph-common-19.1.1-326.g8921c8ef.el9. 4.8 MB/s | 21 MB 00:04 2024-09-15T23:02:36.117 INFO:teuthology.orchestra.run.smithi145.stdout:(50/156): python3-ply-3.11-14.el9.noarch.rpm 227 kB/s | 106 kB 00:00 2024-09-15T23:02:36.142 INFO:teuthology.orchestra.run.smithi145.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-15T23:02:36.159 INFO:teuthology.orchestra.run.smithi112.stdout:(7/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 2.2 MB/s | 5.4 MB 00:02 2024-09-15T23:02:36.173 INFO:teuthology.orchestra.run.smithi002.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.4 MB/s | 228 kB 00:00 2024-09-15T23:02:36.176 INFO:teuthology.orchestra.run.smithi145.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-09-15T23:02:36.201 INFO:teuthology.orchestra.run.smithi145.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-15T23:02:36.226 INFO:teuthology.orchestra.run.smithi112.stdout:(8/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 1.9 MB/s | 2.4 MB 00:01 2024-09-15T23:02:36.240 INFO:teuthology.orchestra.run.smithi002.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 405 kB/s | 27 kB 00:00 2024-09-15T23:02:36.242 INFO:teuthology.orchestra.run.smithi145.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-15T23:02:36.276 INFO:teuthology.orchestra.run.smithi112.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 504 kB/s | 25 kB 00:00 2024-09-15T23:02:36.301 INFO:teuthology.orchestra.run.smithi145.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-09-15T23:02:36.326 INFO:teuthology.orchestra.run.smithi145.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-15T23:02:36.360 INFO:teuthology.orchestra.run.smithi145.stdout:(57/156): flex-2.6.4-9.el9.x86_64.rpm 1.3 MB/s | 313 kB 00:00 2024-09-15T23:02:36.386 INFO:teuthology.orchestra.run.smithi145.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-15T23:02:36.390 INFO:teuthology.orchestra.run.smithi002.stdout:(13/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 5.2 MB/s | 11 MB 00:02 2024-09-15T23:02:36.402 INFO:teuthology.orchestra.run.smithi145.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-09-15T23:02:36.407 INFO:teuthology.orchestra.run.smithi002.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 190 kB/s | 32 kB 00:00 2024-09-15T23:02:36.445 INFO:teuthology.orchestra.run.smithi145.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 585 kB/s | 24 kB 00:00 2024-09-15T23:02:36.466 INFO:teuthology.orchestra.run.smithi002.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.7 MB/s | 163 kB 00:00 2024-09-15T23:02:36.470 INFO:teuthology.orchestra.run.smithi145.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-15T23:02:36.487 INFO:teuthology.orchestra.run.smithi145.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-15T23:02:36.516 INFO:teuthology.orchestra.run.smithi002.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T23:02:36.520 INFO:teuthology.orchestra.run.smithi145.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-15T23:02:36.546 INFO:teuthology.orchestra.run.smithi145.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-15T23:02:36.550 INFO:teuthology.orchestra.run.smithi002.stdout:(17/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 4.6 MB/s | 751 kB 00:00 2024-09-15T23:02:36.563 INFO:teuthology.orchestra.run.smithi145.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 921 kB/s | 38 kB 00:00 2024-09-15T23:02:36.588 INFO:teuthology.orchestra.run.smithi145.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-15T23:02:36.618 INFO:teuthology.orchestra.run.smithi112.stdout:(10/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 30 MB/s | 17 MB 00:00 2024-09-15T23:02:36.625 INFO:teuthology.orchestra.run.smithi002.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 4.6 MB/s | 506 kB 00:00 2024-09-15T23:02:36.668 INFO:teuthology.orchestra.run.smithi112.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 4.5 MB/s | 228 kB 00:00 2024-09-15T23:02:36.675 INFO:teuthology.orchestra.run.smithi002.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 907 kB/s | 45 kB 00:00 2024-09-15T23:02:36.688 INFO:teuthology.orchestra.run.smithi145.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-15T23:02:36.710 INFO:teuthology.orchestra.run.smithi112.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 650 kB/s | 27 kB 00:00 2024-09-15T23:02:36.739 INFO:teuthology.orchestra.run.smithi145.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-15T23:02:36.752 INFO:teuthology.orchestra.run.smithi112.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 760 kB/s | 32 kB 00:00 2024-09-15T23:02:36.769 INFO:teuthology.orchestra.run.smithi002.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.4 MB/s | 136 kB 00:00 2024-09-15T23:02:36.772 INFO:teuthology.orchestra.run.smithi145.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-15T23:02:36.797 INFO:teuthology.orchestra.run.smithi145.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-15T23:02:36.811 INFO:teuthology.orchestra.run.smithi112.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 751 kB 00:00 2024-09-15T23:02:36.819 INFO:teuthology.orchestra.run.smithi002.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 3.2 MB/s | 161 kB 00:00 2024-09-15T23:02:36.861 INFO:teuthology.orchestra.run.smithi112.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 3.2 MB/s | 163 kB 00:00 2024-09-15T23:02:36.864 INFO:teuthology.orchestra.run.smithi145.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-15T23:02:36.887 INFO:teuthology.orchestra.run.smithi002.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 4.7 MB/s | 320 kB 00:00 2024-09-15T23:02:36.898 INFO:teuthology.orchestra.run.smithi145.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-15T23:02:36.912 INFO:teuthology.orchestra.run.smithi112.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T23:02:36.931 INFO:teuthology.orchestra.run.smithi145.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-15T23:02:36.954 INFO:teuthology.orchestra.run.smithi002.stdout:(23/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 4.4 MB/s | 300 kB 00:00 2024-09-15T23:02:36.962 INFO:teuthology.orchestra.run.smithi112.stdout:(17/156): libradosstriper1-19.1.1-326.g8921c8ef 9.9 MB/s | 506 kB 00:00 2024-09-15T23:02:36.965 INFO:teuthology.orchestra.run.smithi145.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-15T23:02:37.004 INFO:teuthology.orchestra.run.smithi002.stdout:(24/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 2.0 MB/s | 99 kB 00:00 2024-09-15T23:02:37.041 INFO:teuthology.orchestra.run.smithi145.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-15T23:02:37.066 INFO:teuthology.orchestra.run.smithi145.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-15T23:02:37.079 INFO:teuthology.orchestra.run.smithi002.stdout:(25/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-15T23:02:37.099 INFO:teuthology.orchestra.run.smithi145.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-15T23:02:37.116 INFO:teuthology.orchestra.run.smithi145.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-15T23:02:37.133 INFO:teuthology.orchestra.run.smithi145.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 572 kB/s | 19 kB 00:00 2024-09-15T23:02:37.162 INFO:teuthology.orchestra.run.smithi112.stdout:(18/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 27 MB/s | 5.3 MB 00:00 2024-09-15T23:02:37.204 INFO:teuthology.orchestra.run.smithi112.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 1.1 MB/s | 45 kB 00:00 2024-09-15T23:02:37.208 INFO:teuthology.orchestra.run.smithi145.stdout:(80/156): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-09-15T23:02:37.234 INFO:teuthology.orchestra.run.smithi145.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-09-15T23:02:37.254 INFO:teuthology.orchestra.run.smithi112.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 2.7 MB/s | 136 kB 00:00 2024-09-15T23:02:37.259 INFO:teuthology.orchestra.run.smithi145.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-15T23:02:37.284 INFO:teuthology.orchestra.run.smithi145.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-15T23:02:37.304 INFO:teuthology.orchestra.run.smithi112.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 3.2 MB/s | 161 kB 00:00 2024-09-15T23:02:37.309 INFO:teuthology.orchestra.run.smithi145.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-15T23:02:37.335 INFO:teuthology.orchestra.run.smithi145.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-15T23:02:37.346 INFO:teuthology.orchestra.run.smithi002.stdout:(26/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 6.7 MB/s | 5.3 MB 00:00 2024-09-15T23:02:37.355 INFO:teuthology.orchestra.run.smithi112.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 6.3 MB/s | 320 kB 00:00 2024-09-15T23:02:37.360 INFO:teuthology.orchestra.run.smithi145.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-15T23:02:37.385 INFO:teuthology.orchestra.run.smithi145.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-15T23:02:37.396 INFO:teuthology.orchestra.run.smithi002.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 3.4 MB/s | 170 kB 00:00 2024-09-15T23:02:37.410 INFO:teuthology.orchestra.run.smithi145.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-15T23:02:37.413 INFO:teuthology.orchestra.run.smithi112.stdout:(23/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.0 MB/s | 300 kB 00:00 2024-09-15T23:02:37.436 INFO:teuthology.orchestra.run.smithi145.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-15T23:02:37.438 INFO:teuthology.orchestra.run.smithi002.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 766 kB/s | 32 kB 00:00 2024-09-15T23:02:37.461 INFO:teuthology.orchestra.run.smithi145.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-15T23:02:37.472 INFO:teuthology.orchestra.run.smithi112.stdout:(24/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.7 MB/s | 99 kB 00:00 2024-09-15T23:02:37.486 INFO:teuthology.orchestra.run.smithi145.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-15T23:02:37.497 INFO:teuthology.orchestra.run.smithi002.stdout:(29/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 7.4 MB/s | 3.1 MB 00:00 2024-09-15T23:02:37.522 INFO:teuthology.orchestra.run.smithi002.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 1.7 MB/s | 146 kB 00:00 2024-09-15T23:02:37.523 INFO:teuthology.orchestra.run.smithi112.stdout:(25/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T23:02:37.570 INFO:teuthology.orchestra.run.smithi145.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-15T23:02:37.596 INFO:teuthology.orchestra.run.smithi145.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-15T23:02:37.621 INFO:teuthology.orchestra.run.smithi145.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-15T23:02:37.646 INFO:teuthology.orchestra.run.smithi145.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-15T23:02:37.671 INFO:teuthology.orchestra.run.smithi145.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-15T23:02:37.673 INFO:teuthology.orchestra.run.smithi112.stdout:(26/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 21 MB/s | 3.1 MB 00:00 2024-09-15T23:02:37.697 INFO:teuthology.orchestra.run.smithi145.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-15T23:02:37.723 INFO:teuthology.orchestra.run.smithi112.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-15T23:02:37.730 INFO:teuthology.orchestra.run.smithi145.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-15T23:02:37.756 INFO:teuthology.orchestra.run.smithi145.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-09-15T23:02:37.757 INFO:teuthology.orchestra.run.smithi112.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 952 kB/s | 32 kB 00:00 2024-09-15T23:02:37.781 INFO:teuthology.orchestra.run.smithi145.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-15T23:02:37.798 INFO:teuthology.orchestra.run.smithi145.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-15T23:02:37.815 INFO:teuthology.orchestra.run.smithi112.stdout:(29/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.5 MB/s | 146 kB 00:00 2024-09-15T23:02:37.823 INFO:teuthology.orchestra.run.smithi145.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-15T23:02:37.966 INFO:teuthology.orchestra.run.smithi112.stdout:(30/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 24 MB/s | 3.6 MB 00:00 2024-09-15T23:02:37.981 INFO:teuthology.orchestra.run.smithi002.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 7.4 MB/s | 3.6 MB 00:00 2024-09-15T23:02:38.065 INFO:teuthology.orchestra.run.smithi145.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-15T23:02:38.131 INFO:teuthology.orchestra.run.smithi002.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 1.6 MB/s | 249 kB 00:00 2024-09-15T23:02:38.149 INFO:teuthology.orchestra.run.smithi145.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.5 MB/s | 548 kB 00:00 2024-09-15T23:02:38.181 INFO:teuthology.orchestra.run.smithi002.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 990 kB/s | 49 kB 00:00 2024-09-15T23:02:38.207 INFO:teuthology.orchestra.run.smithi145.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.0 MB/s | 308 kB 00:00 2024-09-15T23:02:38.224 INFO:teuthology.orchestra.run.smithi145.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-15T23:02:38.224 INFO:teuthology.orchestra.run.smithi112.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 29 MB/s | 7.4 MB 00:00 2024-09-15T23:02:38.232 INFO:teuthology.orchestra.run.smithi002.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 330 kB/s | 16 kB 00:00 2024-09-15T23:02:38.274 INFO:teuthology.orchestra.run.smithi112.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 4.9 MB/s | 249 kB 00:00 2024-09-15T23:02:38.299 INFO:teuthology.orchestra.run.smithi002.stdout:(35/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.2 MB/s | 285 kB 00:00 2024-09-15T23:02:38.325 INFO:teuthology.orchestra.run.smithi112.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 990 kB/s | 49 kB 00:00 2024-09-15T23:02:38.375 INFO:teuthology.orchestra.run.smithi112.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 328 kB/s | 16 kB 00:00 2024-09-15T23:02:38.415 INFO:teuthology.orchestra.run.smithi002.stdout:(36/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 6.4 MB/s | 765 kB 00:00 2024-09-15T23:02:38.425 INFO:teuthology.orchestra.run.smithi112.stdout:(35/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.6 MB/s | 285 kB 00:00 2024-09-15T23:02:38.458 INFO:teuthology.orchestra.run.smithi002.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 438 kB/s | 18 kB 00:00 2024-09-15T23:02:38.458 INFO:teuthology.orchestra.run.smithi145.stdout:(107/156): lua-devel-5.4.4-4.el9.x86_64.rpm 34 kB/s | 22 kB 00:00 2024-09-15T23:02:38.492 INFO:teuthology.orchestra.run.smithi112.stdout:(36/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 11 MB/s | 765 kB 00:00 2024-09-15T23:02:38.516 INFO:teuthology.orchestra.run.smithi145.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 449 kB/s | 26 kB 00:00 2024-09-15T23:02:38.534 INFO:teuthology.orchestra.run.smithi112.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 438 kB/s | 18 kB 00:00 2024-09-15T23:02:38.541 INFO:teuthology.orchestra.run.smithi145.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-15T23:02:38.567 INFO:teuthology.orchestra.run.smithi002.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 7.1 MB/s | 7.4 MB 00:01 2024-09-15T23:02:38.609 INFO:teuthology.orchestra.run.smithi145.stdout:(110/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-15T23:02:38.633 INFO:teuthology.orchestra.run.smithi145.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 734 kB/s | 67 kB 00:00 2024-09-15T23:02:38.668 INFO:teuthology.orchestra.run.smithi145.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-15T23:02:38.676 INFO:teuthology.orchestra.run.smithi112.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-15T23:02:38.708 INFO:teuthology.orchestra.run.smithi002.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 319 kB/s | 80 kB 00:00 2024-09-15T23:02:38.709 INFO:teuthology.orchestra.run.smithi145.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-15T23:02:38.726 INFO:teuthology.orchestra.run.smithi145.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-15T23:02:38.743 INFO:teuthology.orchestra.run.smithi145.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-15T23:02:38.768 INFO:teuthology.orchestra.run.smithi145.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-15T23:02:38.792 INFO:teuthology.orchestra.run.smithi002.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-15T23:02:38.802 INFO:teuthology.orchestra.run.smithi145.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-09-15T23:02:38.827 INFO:teuthology.orchestra.run.smithi145.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-15T23:02:38.833 INFO:teuthology.orchestra.run.smithi002.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-15T23:02:38.859 INFO:teuthology.orchestra.run.smithi002.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-15T23:02:38.861 INFO:teuthology.orchestra.run.smithi145.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-15T23:02:38.903 INFO:teuthology.orchestra.run.smithi145.stdout:(120/156): protobuf-compiler-3.14.0-13.el9.x86_ 799 kB/s | 863 kB 00:01 2024-09-15T23:02:38.909 INFO:teuthology.orchestra.run.smithi002.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-15T23:02:38.918 INFO:teuthology.orchestra.run.smithi112.stdout:(39/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 3.8 MB/s | 11 MB 00:02 2024-09-15T23:02:38.928 INFO:teuthology.orchestra.run.smithi145.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-09-15T23:02:38.943 INFO:teuthology.orchestra.run.smithi002.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-15T23:02:38.951 INFO:teuthology.orchestra.run.smithi112.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-15T23:02:38.962 INFO:teuthology.orchestra.run.smithi145.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.2 MB/s | 220 kB 00:00 2024-09-15T23:02:38.968 INFO:teuthology.orchestra.run.smithi002.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-15T23:02:38.987 INFO:teuthology.orchestra.run.smithi145.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 460 kB/s | 11 kB 00:00 2024-09-15T23:02:39.002 INFO:teuthology.orchestra.run.smithi002.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-15T23:02:39.010 INFO:teuthology.orchestra.run.smithi112.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-09-15T23:02:39.013 INFO:teuthology.orchestra.run.smithi145.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 715 kB/s | 18 kB 00:00 2024-09-15T23:02:39.027 INFO:teuthology.orchestra.run.smithi002.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-15T23:02:39.046 INFO:teuthology.orchestra.run.smithi145.stdout:(125/156): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-09-15T23:02:39.072 INFO:teuthology.orchestra.run.smithi145.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 394 kB/s | 23 kB 00:00 2024-09-15T23:02:39.097 INFO:teuthology.orchestra.run.smithi145.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-15T23:02:39.111 INFO:teuthology.orchestra.run.smithi112.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-15T23:02:39.122 INFO:teuthology.orchestra.run.smithi145.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 394 kB/s | 20 kB 00:00 2024-09-15T23:02:39.136 INFO:teuthology.orchestra.run.smithi112.stdout:(43/156): libquadmath-11.5.0-2.el9.x86_64.rpm 880 kB/s | 191 kB 00:00 2024-09-15T23:02:39.156 INFO:teuthology.orchestra.run.smithi145.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-15T23:02:39.161 INFO:teuthology.orchestra.run.smithi112.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-15T23:02:39.186 INFO:teuthology.orchestra.run.smithi112.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-15T23:02:39.212 INFO:teuthology.orchestra.run.smithi112.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-15T23:02:39.214 INFO:teuthology.orchestra.run.smithi145.stdout:(130/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-09-15T23:02:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-15T23:02:39.239 INFO:teuthology.orchestra.run.smithi145.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 946 kB/s | 79 kB 00:00 2024-09-15T23:02:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-15T23:02:39.253 INFO:teuthology.orchestra.run.smithi112.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-15T23:02:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-15T23:02:39.282 INFO:teuthology.orchestra.run.smithi145.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-15T23:02:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-15T23:02:39.306 INFO:teuthology.orchestra.run.smithi145.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 865 kB/s | 58 kB 00:00 2024-09-15T23:02:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-15T23:02:39.332 INFO:teuthology.orchestra.run.smithi145.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-15T23:02:39.354 INFO:teuthology.orchestra.run.smithi002.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-15T23:02:39.357 INFO:teuthology.orchestra.run.smithi145.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-15T23:02:39.383 INFO:teuthology.orchestra.run.smithi145.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-15T23:02:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-15T23:02:39.417 INFO:teuthology.orchestra.run.smithi145.stdout:(137/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-09-15T23:02:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 269 kB/s | 11 kB 00:00 2024-09-15T23:02:39.441 INFO:teuthology.orchestra.run.smithi145.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2024-09-15T23:02:39.467 INFO:teuthology.orchestra.run.smithi145.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-15T23:02:39.488 INFO:teuthology.orchestra.run.smithi002.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-09-15T23:02:39.492 INFO:teuthology.orchestra.run.smithi145.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-15T23:02:39.515 INFO:teuthology.orchestra.run.smithi002.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-15T23:02:39.517 INFO:teuthology.orchestra.run.smithi145.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-15T23:02:39.539 INFO:teuthology.orchestra.run.smithi002.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-15T23:02:39.559 INFO:teuthology.orchestra.run.smithi145.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 808 kB/s | 74 kB 00:00 2024-09-15T23:02:39.581 INFO:teuthology.orchestra.run.smithi002.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-15T23:02:39.584 INFO:teuthology.orchestra.run.smithi145.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-15T23:02:39.618 INFO:teuthology.orchestra.run.smithi145.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-15T23:02:39.622 INFO:teuthology.orchestra.run.smithi002.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-15T23:02:39.643 INFO:teuthology.orchestra.run.smithi145.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-15T23:02:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 367 kB/s | 24 kB 00:00 2024-09-15T23:02:39.668 INFO:teuthology.orchestra.run.smithi145.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T23:02:39.690 INFO:teuthology.orchestra.run.smithi002.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-15T23:02:39.693 INFO:teuthology.orchestra.run.smithi145.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-15T23:02:39.715 INFO:teuthology.orchestra.run.smithi002.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-15T23:02:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-15T23:02:39.752 INFO:teuthology.orchestra.run.smithi145.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-15T23:02:39.766 INFO:teuthology.orchestra.run.smithi002.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-15T23:02:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 40 MB/s | 4.9 MB 00:00 2024-09-15T23:02:39.950 INFO:teuthology.orchestra.run.smithi002.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-09-15T23:02:39.994 INFO:teuthology.orchestra.run.smithi145.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-15T23:02:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-15T23:02:40.043 INFO:teuthology.orchestra.run.smithi002.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-15T23:02:40.053 INFO:teuthology.orchestra.run.smithi145.stdout:(150/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 8.8 MB/s | 3.2 MB 00:00 2024-09-15T23:02:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-15T23:02:40.070 INFO:teuthology.orchestra.run.smithi112.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 803 kB/s | 689 kB 00:00 2024-09-15T23:02:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-15T23:02:40.218 INFO:teuthology.orchestra.run.smithi002.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 33 MB/s | 5.8 MB 00:00 2024-09-15T23:02:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 808 kB/s | 87 kB 00:00 2024-09-15T23:02:40.246 INFO:teuthology.orchestra.run.smithi112.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 951 kB/s | 943 kB 00:00 2024-09-15T23:02:40.279 INFO:teuthology.orchestra.run.smithi145.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 181 kB/s | 41 kB 00:00 2024-09-15T23:02:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-15T23:02:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-09-15T23:02:40.403 INFO:teuthology.orchestra.run.smithi002.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-15T23:02:40.436 INFO:teuthology.orchestra.run.smithi002.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-15T23:02:40.462 INFO:teuthology.orchestra.run.smithi002.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-09-15T23:02:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-15T23:02:40.504 INFO:teuthology.orchestra.run.smithi145.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 3.1 MB/s | 2.3 MB 00:00 2024-09-15T23:02:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-15T23:02:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-09-15T23:02:40.571 INFO:teuthology.orchestra.run.smithi145.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 852 kB/s | 249 kB 00:00 2024-09-15T23:02:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-15T23:02:40.638 INFO:teuthology.orchestra.run.smithi145.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-15T23:02:40.771 INFO:teuthology.orchestra.run.smithi145.stdout:(155/156): NetworkManager-libnm-1.49.90-1.el9.x 2.3 MB/s | 1.8 MB 00:00 2024-09-15T23:02:40.788 INFO:teuthology.orchestra.run.smithi112.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 149 kB/s | 107 kB 00:00 2024-09-15T23:02:40.813 INFO:teuthology.orchestra.run.smithi112.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 38 kB/s | 22 kB 00:00 2024-09-15T23:02:41.030 INFO:teuthology.orchestra.run.smithi002.stdout:(83/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 9.3 MB/s | 49 MB 00:05 2024-09-15T23:02:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 485 kB/s | 222 kB 00:00 2024-09-15T23:02:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.4 MB/s | 5.1 MB 00:00 2024-09-15T23:02:41.156 INFO:teuthology.orchestra.run.smithi002.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-09-15T23:02:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 462 kB/s | 77 kB 00:00 2024-09-15T23:02:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-15T23:02:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:(89/156): python3-protobuf-3.14.0-13.el9.noarch 2.2 MB/s | 269 kB 00:00 2024-09-15T23:02:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-15T23:02:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-15T23:02:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:(92/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-15T23:02:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2024-09-15T23:02:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-15T23:02:41.380 INFO:teuthology.orchestra.run.smithi112.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 58 kB/s | 33 kB 00:00 2024-09-15T23:02:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-15T23:02:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-15T23:02:41.450 INFO:teuthology.orchestra.run.smithi002.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-15T23:02:41.492 INFO:teuthology.orchestra.run.smithi002.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-09-15T23:02:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 864 kB/s | 58 kB 00:00 2024-09-15T23:02:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-15T23:02:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-15T23:02:41.580 INFO:teuthology.orchestra.run.smithi112.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 396 kB/s | 313 kB 00:00 2024-09-15T23:02:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-15T23:02:41.763 INFO:teuthology.orchestra.run.smithi145.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-15T23:02:41.770 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:02:41.770 INFO:teuthology.orchestra.run.smithi145.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-15T23:02:41.852 INFO:teuthology.orchestra.run.smithi002.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-15T23:02:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-09-15T23:02:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-15T23:02:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 581 kB/s | 19 kB 00:00 2024-09-15T23:02:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.7 MB/s | 308 kB 00:00 2024-09-15T23:02:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-15T23:02:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-15T23:02:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-15T23:02:42.089 INFO:teuthology.orchestra.run.smithi112.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-15T23:02:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-15T23:02:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-15T23:02:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-15T23:02:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T23:02:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-15T23:02:42.314 INFO:teuthology.orchestra.run.smithi002.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-15T23:02:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:(117/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-09-15T23:02:42.415 INFO:teuthology.orchestra.run.smithi112.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-09-15T23:02:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:(118/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.7 MB/s | 4.4 MB 00:00 2024-09-15T23:02:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-09-15T23:02:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.3 MB/s | 303 kB 00:00 2024-09-15T23:02:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-15T23:02:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:(122/156): python3-cherrypy-18.6.1-2.el9.noarch 1.7 MB/s | 358 kB 00:00 2024-09-15T23:02:42.574 INFO:teuthology.orchestra.run.smithi002.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-09-15T23:02:42.589 INFO:teuthology.orchestra.run.smithi112.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 22 kB/s | 11 kB 00:00 2024-09-15T23:02:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 254 kB/s | 11 kB 00:00 2024-09-15T23:02:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2024-09-15T23:02:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 396 kB/s | 23 kB 00:00 2024-09-15T23:02:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 331 kB/s | 19 kB 00:00 2024-09-15T23:02:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-15T23:02:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T23:02:42.759 INFO:teuthology.orchestra.run.smithi002.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-15T23:02:42.785 INFO:teuthology.orchestra.run.smithi002.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T23:02:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-15T23:02:42.844 INFO:teuthology.orchestra.run.smithi002.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-15T23:02:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-09-15T23:02:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-15T23:02:42.936 INFO:teuthology.orchestra.run.smithi002.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 558 kB/s | 28 kB 00:00 2024-09-15T23:02:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-15T23:02:42.977 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-15T23:02:42.987 INFO:teuthology.orchestra.run.smithi002.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-15T23:02:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-15T23:02:43.038 INFO:teuthology.orchestra.run.smithi002.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-15T23:02:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-15T23:02:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-15T23:02:43.123 INFO:teuthology.orchestra.run.smithi112.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 226 kB/s | 160 kB 00:00 2024-09-15T23:02:43.128 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-15T23:02:43.128 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-15T23:02:43.138 INFO:teuthology.orchestra.run.smithi002.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-15T23:02:43.148 INFO:teuthology.orchestra.run.smithi112.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 81 kB/s | 45 kB 00:00 2024-09-15T23:02:43.164 INFO:teuthology.orchestra.run.smithi002.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-15T23:02:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-15T23:02:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-15T23:02:43.256 INFO:teuthology.orchestra.run.smithi002.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-15T23:02:43.306 INFO:teuthology.orchestra.run.smithi002.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-15T23:02:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:(149/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 9.7 MB/s | 3.2 MB 00:00 2024-09-15T23:02:43.632 INFO:teuthology.orchestra.run.smithi002.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 7.1 MB/s | 2.3 MB 00:00 2024-09-15T23:02:43.682 INFO:teuthology.orchestra.run.smithi002.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 819 kB/s | 41 kB 00:00 2024-09-15T23:02:43.732 INFO:teuthology.orchestra.run.smithi002.stdout:(152/156): librados2-19.1.1-326.g8921c8ef.el9.x 6.7 MB/s | 3.4 MB 00:00 2024-09-15T23:02:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 3.2 MB/s | 249 kB 00:00 2024-09-15T23:02:43.867 INFO:teuthology.orchestra.run.smithi002.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 6.3 MB/s | 1.8 MB 00:00 2024-09-15T23:02:43.907 INFO:teuthology.orchestra.run.smithi112.stdout:(59/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 6.4 MB/s | 49 MB 00:07 2024-09-15T23:02:43.908 INFO:teuthology.orchestra.run.smithi002.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-09-15T23:02:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 4.3 MB/s | 1.4 MB 00:00 2024-09-15T23:02:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:02:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:Total 17 MB/s | 226 MB 00:12 2024-09-15T23:02:44.399 INFO:teuthology.orchestra.run.smithi112.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 465 kB/s | 581 kB 00:01 2024-09-15T23:02:44.432 INFO:teuthology.orchestra.run.smithi112.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 47 kB/s | 24 kB 00:00 2024-09-15T23:02:44.466 INFO:teuthology.orchestra.run.smithi112.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 494 kB/s | 662 kB 00:01 2024-09-15T23:02:44.974 INFO:teuthology.orchestra.run.smithi112.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-15T23:02:45.200 INFO:teuthology.orchestra.run.smithi112.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 257 kB/s | 188 kB 00:00 2024-09-15T23:02:45.233 INFO:teuthology.orchestra.run.smithi112.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 365 kB/s | 292 kB 00:00 2024-09-15T23:02:45.334 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-15T23:02:45.367 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-15T23:02:45.367 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-15T23:02:45.505 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-15T23:02:45.505 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-15T23:02:45.550 INFO:teuthology.orchestra.run.smithi112.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 67 kB/s | 38 kB 00:00 2024-09-15T23:02:46.317 INFO:teuthology.orchestra.run.smithi112.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.5 MB/s | 4.9 MB 00:01 2024-09-15T23:02:46.392 INFO:teuthology.orchestra.run.smithi112.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-15T23:02:46.618 INFO:teuthology.orchestra.run.smithi112.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-09-15T23:02:47.101 INFO:teuthology.orchestra.run.smithi112.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 194 kB/s | 137 kB 00:00 2024-09-15T23:02:47.235 INFO:teuthology.orchestra.run.smithi112.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 992 kB/s | 910 kB 00:00 2024-09-15T23:02:47.856 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-15T23:02:47.857 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-15T23:02:47.877 INFO:teuthology.orchestra.run.smithi112.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 136 kB/s | 87 kB 00:00 2024-09-15T23:02:48.085 INFO:teuthology.orchestra.run.smithi112.stdout:(73/156): postgresql-server-13.16-1.el9.x86_64. 4.0 MB/s | 5.8 MB 00:01 2024-09-15T23:02:48.227 INFO:teuthology.orchestra.run.smithi112.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 918 kB/s | 1.0 MB 00:01 2024-09-15T23:02:48.711 INFO:teuthology.orchestra.run.smithi112.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 98 kB/s | 61 kB 00:00 2024-09-15T23:02:49.094 INFO:teuthology.orchestra.run.smithi112.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 282 kB/s | 245 kB 00:00 2024-09-15T23:02:49.603 INFO:teuthology.orchestra.run.smithi112.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 278 kB/s | 248 kB 00:00 2024-09-15T23:02:49.678 INFO:teuthology.orchestra.run.smithi112.stdout:(78/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.3 MB/s | 6.0 MB 00:01 2024-09-15T23:02:49.703 INFO:teuthology.orchestra.run.smithi112.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 42 kB/s | 26 kB 00:00 2024-09-15T23:02:50.112 INFO:teuthology.orchestra.run.smithi112.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 38 kB/s | 19 kB 00:00 2024-09-15T23:02:50.312 INFO:teuthology.orchestra.run.smithi112.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 57 kB/s | 35 kB 00:00 2024-09-15T23:02:50.463 INFO:teuthology.orchestra.run.smithi112.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 220 kB/s | 172 kB 00:00 2024-09-15T23:02:51.188 INFO:teuthology.orchestra.run.smithi112.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 286 kB/s | 250 kB 00:00 2024-09-15T23:02:51.296 INFO:teuthology.orchestra.run.smithi112.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 267 kB/s | 222 kB 00:00 2024-09-15T23:02:51.692 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-15T23:02:51.817 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T23:02:51.856 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T23:02:51.863 INFO:teuthology.orchestra.run.smithi112.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 114 kB/s | 77 kB 00:00 2024-09-15T23:02:51.889 INFO:teuthology.orchestra.run.smithi112.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 71 kB/s | 42 kB 00:00 2024-09-15T23:02:51.909 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T23:02:51.942 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T23:02:51.976 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T23:02:52.037 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T23:02:52.376 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T23:02:52.485 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:02:52.616 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:02:52.630 INFO:teuthology.orchestra.run.smithi112.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 214 kB/s | 159 kB 00:00 2024-09-15T23:02:52.644 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:02:52.736 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:02:52.747 INFO:teuthology.orchestra.run.smithi112.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 305 kB/s | 269 kB 00:00 2024-09-15T23:02:52.772 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:02:52.954 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T23:02:53.026 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T23:02:53.057 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:02:53.144 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:02:53.164 INFO:teuthology.orchestra.run.smithi112.stdout:(89/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.7 MB/s | 5.1 MB 00:03 2024-09-15T23:02:53.166 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:02:53.229 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:02:53.259 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:02:53.285 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:02:53.398 INFO:teuthology.orchestra.run.smithi112.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 78 kB/s | 51 kB 00:00 2024-09-15T23:02:53.477 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:02:53.498 INFO:teuthology.orchestra.run.smithi112.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 322 kB/s | 279 kB 00:00 2024-09-15T23:02:53.683 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:02:53.799 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T23:02:53.807 INFO:teuthology.orchestra.run.smithi112.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 84 kB/s | 54 kB 00:00 2024-09-15T23:02:53.926 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:02:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:02:54.082 INFO:teuthology.orchestra.run.smithi112.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 71 kB/s | 42 kB 00:00 2024-09-15T23:02:54.231 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:02:54.349 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T23:02:54.412 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-15T23:02:54.415 INFO:teuthology.orchestra.run.smithi112.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 73 kB/s | 44 kB 00:00 2024-09-15T23:02:54.442 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T23:02:54.472 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T23:02:54.506 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T23:02:54.537 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T23:02:54.571 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T23:02:54.579 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T23:02:54.624 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T23:02:54.648 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T23:02:54.665 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T23:02:54.689 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T23:02:54.708 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T23:02:54.714 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T23:02:54.741 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T23:02:54.768 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T23:02:54.772 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T23:02:54.824 INFO:teuthology.orchestra.run.smithi112.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 298 kB/s | 221 kB 00:00 2024-09-15T23:02:54.836 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T23:02:54.891 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T23:02:54.922 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T23:02:54.965 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T23:02:54.983 INFO:teuthology.orchestra.run.smithi112.stdout:(96/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-15T23:02:55.008 INFO:teuthology.orchestra.run.smithi112.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 61 kB/s | 36 kB 00:00 2024-09-15T23:02:55.049 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T23:02:55.084 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T23:02:55.128 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T23:02:55.129 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T23:02:55.156 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T23:02:55.225 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T23:02:55.271 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T23:02:55.323 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:02:55.345 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T23:02:55.477 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T23:02:55.500 INFO:teuthology.orchestra.run.smithi112.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 70 kB/s | 47 kB 00:00 2024-09-15T23:02:55.539 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T23:02:55.584 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:02:55.608 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:02:55.625 INFO:teuthology.orchestra.run.smithi112.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 94 kB/s | 58 kB 00:00 2024-09-15T23:02:55.701 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:02:55.729 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:02:55.775 INFO:teuthology.orchestra.run.smithi112.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 384 kB/s | 304 kB 00:00 2024-09-15T23:02:55.930 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T23:02:55.977 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T23:02:56.003 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:02:56.055 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T23:02:56.109 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:02:56.138 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:02:56.143 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T23:02:56.181 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T23:02:56.192 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:02:56.217 INFO:teuthology.orchestra.run.smithi112.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 134 kB/s | 96 kB 00:00 2024-09-15T23:02:56.222 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:02:56.223 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T23:02:56.245 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:02:56.262 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T23:02:56.292 INFO:teuthology.orchestra.run.smithi112.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 298 kB/s | 22 kB 00:00 2024-09-15T23:02:56.304 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T23:02:56.318 INFO:teuthology.orchestra.run.smithi112.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 92 kB/s | 64 kB 00:00 2024-09-15T23:02:56.351 INFO:teuthology.orchestra.run.smithi112.stdout:(104/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-15T23:02:56.392 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:02:56.418 INFO:teuthology.orchestra.run.smithi112.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 4.6 MB/s | 308 kB 00:00 2024-09-15T23:02:56.443 INFO:teuthology.orchestra.run.smithi112.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-09-15T23:02:56.449 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T23:02:56.469 INFO:teuthology.orchestra.run.smithi112.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-09-15T23:02:56.498 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T23:02:56.502 INFO:teuthology.orchestra.run.smithi112.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-09-15T23:02:56.527 INFO:teuthology.orchestra.run.smithi112.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-09-15T23:02:56.552 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T23:02:56.561 INFO:teuthology.orchestra.run.smithi112.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-15T23:02:56.563 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:02:56.595 INFO:teuthology.orchestra.run.smithi112.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-15T23:02:56.620 INFO:teuthology.orchestra.run.smithi112.stdout:(112/156): liboath-2.6.7-2.el9.x86_64.rpm 414 kB/s | 49 kB 00:00 2024-09-15T23:02:56.624 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T23:02:56.665 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T23:02:56.695 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T23:02:56.696 INFO:teuthology.orchestra.run.smithi112.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-15T23:02:56.701 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T23:02:56.712 INFO:teuthology.orchestra.run.smithi112.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-15T23:02:56.746 INFO:teuthology.orchestra.run.smithi112.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-15T23:02:56.747 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T23:02:56.763 INFO:teuthology.orchestra.run.smithi112.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-09-15T23:02:56.785 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T23:02:56.793 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:02:56.827 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T23:02:56.869 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T23:02:56.880 INFO:teuthology.orchestra.run.smithi112.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 106 kB/s | 14 kB 00:00 2024-09-15T23:02:56.897 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:02:56.964 INFO:teuthology.orchestra.run.smithi112.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 857 kB/s | 172 kB 00:00 2024-09-15T23:02:56.997 INFO:teuthology.orchestra.run.smithi112.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-15T23:02:57.004 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T23:02:57.022 INFO:teuthology.orchestra.run.smithi112.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-15T23:02:57.048 INFO:teuthology.orchestra.run.smithi112.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 8.7 MB/s | 220 kB 00:00 2024-09-15T23:02:57.054 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T23:02:57.073 INFO:teuthology.orchestra.run.smithi112.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-15T23:02:57.095 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T23:02:57.114 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:02:57.128 INFO:teuthology.orchestra.run.smithi112.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 194 kB/s | 11 kB 00:00 2024-09-15T23:02:57.157 INFO:teuthology.orchestra.run.smithi112.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 625 kB/s | 18 kB 00:00 2024-09-15T23:02:57.182 INFO:teuthology.orchestra.run.smithi112.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-15T23:02:57.197 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T23:02:57.207 INFO:teuthology.orchestra.run.smithi112.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-15T23:02:57.225 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T23:02:57.229 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T23:02:57.266 INFO:teuthology.orchestra.run.smithi112.stdout:(127/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2024-09-15T23:02:57.286 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T23:02:57.291 INFO:teuthology.orchestra.run.smithi112.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-09-15T23:02:57.319 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T23:02:57.320 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T23:02:57.325 INFO:teuthology.orchestra.run.smithi112.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-15T23:02:57.344 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T23:02:57.361 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T23:02:57.392 INFO:teuthology.orchestra.run.smithi112.stdout:(130/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-09-15T23:02:57.396 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T23:02:57.417 INFO:teuthology.orchestra.run.smithi112.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 859 kB/s | 79 kB 00:00 2024-09-15T23:02:57.439 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T23:02:57.442 INFO:teuthology.orchestra.run.smithi112.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-15T23:02:57.468 INFO:teuthology.orchestra.run.smithi112.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-15T23:02:57.471 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T23:02:57.493 INFO:teuthology.orchestra.run.smithi112.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-15T23:02:57.518 INFO:teuthology.orchestra.run.smithi112.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-15T23:02:57.522 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T23:02:57.543 INFO:teuthology.orchestra.run.smithi112.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-15T23:02:57.562 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T23:02:57.569 INFO:teuthology.orchestra.run.smithi112.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-15T23:02:57.570 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T23:02:57.602 INFO:teuthology.orchestra.run.smithi112.stdout:(138/156): python3-kubernetes-26.1.0-2.el9.noar 3.0 MB/s | 1.0 MB 00:00 2024-09-15T23:02:57.613 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T23:02:57.614 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T23:02:57.627 INFO:teuthology.orchestra.run.smithi112.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-15T23:02:57.653 INFO:teuthology.orchestra.run.smithi112.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-15T23:02:57.655 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T23:02:57.682 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T23:02:57.687 INFO:teuthology.orchestra.run.smithi112.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-15T23:02:57.712 INFO:teuthology.orchestra.run.smithi112.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 889 kB/s | 74 kB 00:00 2024-09-15T23:02:57.737 INFO:teuthology.orchestra.run.smithi112.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-15T23:02:57.753 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T23:02:57.770 INFO:teuthology.orchestra.run.smithi112.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-15T23:02:57.795 INFO:teuthology.orchestra.run.smithi112.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 348 kB/s | 20 kB 00:00 2024-09-15T23:02:57.814 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T23:02:57.820 INFO:teuthology.orchestra.run.smithi112.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T23:02:57.844 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T23:02:57.854 INFO:teuthology.orchestra.run.smithi112.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-15T23:02:57.887 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T23:02:57.904 INFO:teuthology.orchestra.run.smithi112.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-15T23:02:57.966 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T23:02:57.998 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T23:02:58.018 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T23:02:58.042 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T23:02:58.070 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T23:02:58.086 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T23:02:58.125 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T23:02:58.151 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T23:02:58.164 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T23:02:58.194 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T23:02:58.201 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T23:02:58.204 INFO:teuthology.orchestra.run.smithi112.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 8.9 MB/s | 3.4 MB 00:00 2024-09-15T23:02:58.228 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T23:02:58.254 INFO:teuthology.orchestra.run.smithi112.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 6.6 MB/s | 2.3 MB 00:00 2024-09-15T23:02:58.262 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T23:02:58.280 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T23:02:58.304 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T23:02:58.305 INFO:teuthology.orchestra.run.smithi112.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 813 kB/s | 41 kB 00:00 2024-09-15T23:02:58.338 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T23:02:58.364 INFO:teuthology.orchestra.run.smithi112.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-15T23:02:58.424 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T23:02:58.429 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T23:02:58.455 INFO:teuthology.orchestra.run.smithi112.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-15T23:02:58.480 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T23:02:58.493 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T23:02:58.524 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T23:02:58.573 INFO:teuthology.orchestra.run.smithi112.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-09-15T23:02:58.623 INFO:teuthology.orchestra.run.smithi112.stdout:(155/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 4.1 MB/s | 3.2 MB 00:00 2024-09-15T23:02:58.628 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T23:02:58.664 INFO:teuthology.orchestra.run.smithi112.stdout:(156/156): NetworkManager-libnm-1.49.90-1.el9.x 3.9 MB/s | 1.8 MB 00:00 2024-09-15T23:02:58.671 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:02:58.671 INFO:teuthology.orchestra.run.smithi112.stdout:Total 9.0 MB/s | 226 MB 00:25 2024-09-15T23:02:58.691 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T23:02:59.036 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T23:02:59.128 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T23:02:59.162 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T23:02:59.205 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T23:02:59.242 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T23:02:59.285 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T23:02:59.407 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T23:02:59.457 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T23:02:59.465 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T23:02:59.489 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T23:02:59.521 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T23:02:59.577 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T23:02:59.586 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T23:02:59.635 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T23:02:59.651 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T23:02:59.680 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T23:02:59.688 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T23:02:59.725 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T23:02:59.766 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T23:02:59.772 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T23:02:59.815 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T23:02:59.816 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T23:02:59.861 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T23:02:59.872 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-15T23:02:59.901 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T23:03:00.001 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T23:03:00.022 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-15T23:03:00.022 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-15T23:03:00.031 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T23:03:00.044 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T23:03:00.085 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T23:03:00.109 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T23:03:00.127 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T23:03:00.235 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T23:03:00.269 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T23:03:00.318 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T23:03:00.359 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T23:03:00.383 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T23:03:00.485 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T23:03:00.619 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T23:03:00.759 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T23:03:00.812 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T23:03:00.849 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T23:03:00.881 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T23:03:00.890 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T23:03:00.930 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T23:03:00.970 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T23:03:00.999 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T23:03:01.026 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T23:03:01.059 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T23:03:01.102 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T23:03:01.143 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T23:03:01.237 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T23:03:01.283 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T23:03:01.313 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T23:03:01.421 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T23:03:01.482 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T23:03:02.118 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T23:03:02.201 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T23:03:02.229 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T23:03:02.246 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T23:03:02.263 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T23:03:02.294 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T23:03:02.328 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T23:03:02.432 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T23:03:02.477 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-15T23:03:02.477 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-15T23:03:02.492 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T23:03:02.537 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T23:03:02.572 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T23:03:02.609 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:03:02.628 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T23:03:02.664 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T23:03:02.700 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:03:02.730 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T23:03:02.841 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T23:03:02.856 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T23:03:02.886 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T23:03:02.958 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T23:03:03.254 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T23:03:03.378 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:03:03.449 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:03:03.471 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T23:03:03.664 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T23:03:03.781 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T23:03:05.107 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T23:03:05.198 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T23:03:05.226 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T23:03:05.259 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T23:03:05.585 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T23:03:05.621 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:03:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:03:05.739 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:03:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T23:03:05.777 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:03:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T23:03:06.300 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T23:03:06.326 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:03:06.333 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:03:06.365 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:03:06.405 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:03:06.426 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T23:03:06.444 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:03:06.444 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T23:03:06.444 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T23:03:06.444 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:03:06.483 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:03:08.753 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-15T23:03:08.877 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T23:03:08.921 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T23:03:08.985 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T23:03:09.019 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T23:03:09.045 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T23:03:09.096 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T23:03:09.353 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:03:09.389 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:03:09.441 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T23:03:09.579 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:03:09.701 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:03:09.730 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:03:09.821 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:03:09.858 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:03:09.971 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:03:10.009 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:03:10.045 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T23:03:10.102 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:03:10.103 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T23:03:10.103 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T23:03:10.103 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:03:10.113 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T23:03:10.135 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:03:10.142 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:03:10.246 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:03:10.268 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:03:10.331 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:03:10.353 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:03:10.376 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:03:10.571 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:03:10.787 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:03:10.917 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T23:03:11.032 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:03:11.093 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:03:11.322 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:03:11.432 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T23:03:11.528 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T23:03:11.566 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T23:03:11.599 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T23:03:11.664 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T23:03:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T23:03:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T23:03:11.809 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T23:03:11.843 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T23:03:11.870 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T23:03:11.947 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T23:03:12.009 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T23:03:12.040 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T23:03:12.083 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T23:03:12.159 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T23:03:12.397 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T23:03:12.537 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T23:03:12.574 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T23:03:12.644 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T23:03:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T23:03:12.780 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T23:03:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T23:03:12.974 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T23:03:13.503 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T23:03:13.596 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T23:03:13.624 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T23:03:13.667 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T23:03:13.705 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T23:03:13.747 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T23:03:13.920 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T23:03:13.983 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T23:03:14.046 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T23:03:14.119 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T23:03:14.150 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T23:03:14.187 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T23:03:14.233 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T23:03:14.278 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T23:03:14.320 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T23:03:14.380 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T23:03:14.523 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T23:03:14.565 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T23:03:14.606 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T23:03:14.708 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T23:03:14.740 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T23:03:14.780 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T23:03:14.808 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T23:03:14.833 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T23:03:14.932 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T23:03:15.058 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T23:03:15.090 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T23:03:15.118 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T23:03:15.171 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T23:03:15.207 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T23:03:15.248 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T23:03:15.278 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T23:03:15.313 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T23:03:15.369 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T23:03:15.403 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T23:03:15.438 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T23:03:15.524 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T23:03:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T23:03:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T23:03:15.718 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T23:03:15.767 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T23:03:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T23:03:16.555 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T23:03:16.589 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T23:03:16.689 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T23:03:16.744 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T23:03:16.789 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T23:03:16.877 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T23:03:16.916 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T23:03:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T23:03:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T23:03:17.231 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T23:03:17.891 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T23:03:18.004 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T23:03:18.179 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:03:18.179 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /sys 2024-09-15T23:03:18.179 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /proc 2024-09-15T23:03:18.179 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /mnt 2024-09-15T23:03:18.179 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /var/tmp 2024-09-15T23:03:18.179 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /home 2024-09-15T23:03:18.179 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /root 2024-09-15T23:03:18.179 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /tmp 2024-09-15T23:03:18.179 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:03:18.351 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:03:18.367 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:03:18.367 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:18.367 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T23:03:18.367 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:03:19.249 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T23:03:19.342 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T23:03:19.378 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T23:03:19.419 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T23:03:19.735 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T23:03:19.782 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:03:19.856 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:03:19.872 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:03:19.887 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T23:03:19.898 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:03:19.898 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:19.898 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T23:03:19.898 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:03:19.899 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:03:19.899 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:03:19.923 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T23:03:20.122 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:03:20.145 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:03:20.145 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:20.145 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T23:03:20.146 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:03:20.146 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:03:20.146 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:03:20.402 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T23:03:20.427 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:03:20.497 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:03:20.520 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T23:03:20.581 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:03:20.604 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:03:20.604 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:20.604 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T23:03:20.605 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:03:20.605 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:03:20.605 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:03:20.711 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T23:03:20.759 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T23:03:20.815 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T23:03:21.001 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T23:03:21.057 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T23:03:21.135 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T23:03:21.223 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T23:03:21.354 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T23:03:21.414 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T23:03:21.447 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T23:03:21.475 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T23:03:21.879 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:03:21.907 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:03:21.938 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T23:03:21.999 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T23:03:22.030 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:03:22.296 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:03:22.296 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-09-15T23:03:22.296 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-09-15T23:03:22.296 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-09-15T23:03:22.297 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-09-15T23:03:22.297 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-09-15T23:03:22.297 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-09-15T23:03:22.297 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-09-15T23:03:22.297 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:03:22.473 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:03:22.491 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:03:22.491 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:22.491 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T23:03:22.491 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:03:22.751 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:03:22.783 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:03:23.072 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:03:23.107 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:03:23.329 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:03:23.369 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:03:23.450 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:03:23.451 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T23:03:23.451 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T23:03:23.451 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:03:23.488 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:03:24.017 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:03:24.046 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:03:24.046 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:24.046 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T23:03:24.046 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:03:24.046 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:03:24.046 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:03:24.067 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:03:24.090 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:03:24.193 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:03:24.284 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:03:24.310 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:03:24.310 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:24.310 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T23:03:24.310 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:03:24.310 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:03:24.310 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:03:24.357 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T23:03:24.384 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:03:24.408 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:03:24.408 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:24.408 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T23:03:24.408 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:03:24.408 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:03:24.408 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:03:24.460 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:03:24.471 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:03:24.569 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T23:03:24.620 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T23:03:24.769 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:03:24.796 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:03:24.796 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:24.796 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T23:03:24.796 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:03:24.796 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:03:24.796 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:03:24.908 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T23:03:24.966 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T23:03:25.030 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T23:03:25.226 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T23:03:25.287 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T23:03:25.368 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T23:03:25.465 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T23:03:25.542 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T23:03:25.570 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:03:25.593 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:03:25.593 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:25.593 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T23:03:25.594 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:03:25.594 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:03:25.594 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:03:25.610 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T23:03:25.637 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:03:25.654 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T23:03:25.660 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:03:25.660 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:25.660 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T23:03:25.660 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:03:25.685 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T23:03:25.712 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T23:03:25.713 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:03:25.736 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:03:25.736 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:25.736 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T23:03:25.736 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:03:25.737 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:03:25.737 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:03:26.039 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:03:26.063 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:03:26.063 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:26.063 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T23:03:26.064 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:03:26.064 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:03:26.064 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:03:26.137 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:03:26.170 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:03:26.202 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T23:03:26.267 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T23:03:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:03:27.404 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:03:27.452 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:03:28.471 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:03:28.502 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:03:28.612 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:03:28.784 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T23:03:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:03:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:03:28.839 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:28.839 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T23:03:28.839 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:03:28.839 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:03:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:03:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:03:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:03:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T23:03:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T23:03:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T23:03:30.074 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:03:30.099 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:03:30.099 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:30.099 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T23:03:30.100 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:03:30.100 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:03:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:03:30.142 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:03:30.166 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:03:30.167 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:30.167 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T23:03:30.167 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:03:30.217 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:03:30.242 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:03:30.242 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:30.243 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T23:03:30.243 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:03:30.243 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:03:30.243 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:03:30.559 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:03:30.585 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:03:30.585 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:30.585 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T23:03:30.585 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:03:30.585 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:03:30.585 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:03:30.633 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T23:03:30.676 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T23:03:30.732 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T23:03:30.764 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T23:03:30.792 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T23:03:30.992 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T23:03:31.038 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T23:03:31.069 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T23:03:31.098 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T23:03:31.145 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T23:03:31.750 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:03:31.792 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:03:31.813 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:03:32.643 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T23:03:32.730 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T23:03:32.768 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T23:03:32.861 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T23:03:32.899 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T23:03:32.925 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T23:03:32.951 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T23:03:32.951 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:03:33.035 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:03:33.035 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:03:33.119 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:03:33.144 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T23:03:33.149 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:03:33.149 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:03:33.337 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:03:33.337 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:03:33.429 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:03:33.503 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:03:35.321 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:03:35.321 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2024-09-15T23:03:35.321 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2024-09-15T23:03:35.321 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2024-09-15T23:03:35.321 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2024-09-15T23:03:35.321 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2024-09-15T23:03:35.321 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /root 2024-09-15T23:03:35.321 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2024-09-15T23:03:35.321 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:03:35.430 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T23:03:35.480 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T23:03:35.491 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:03:35.507 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:03:35.508 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:35.508 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T23:03:35.508 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:03:35.521 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T23:03:35.554 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T23:03:35.579 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T23:03:35.776 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T23:03:35.817 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T23:03:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T23:03:35.878 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T23:03:35.915 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T23:03:36.556 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:03:36.596 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:03:36.618 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:03:36.977 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:03:37.003 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:03:37.004 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:37.004 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T23:03:37.004 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:03:37.004 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:03:37.004 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:03:37.228 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:03:37.251 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:03:37.251 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:37.251 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T23:03:37.251 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:03:37.251 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:03:37.252 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:03:37.544 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T23:03:37.643 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T23:03:37.679 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:03:37.687 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T23:03:37.702 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:03:37.703 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:37.703 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T23:03:37.703 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:03:37.703 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:03:37.703 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:03:37.785 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T23:03:37.816 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T23:03:37.820 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T23:03:37.846 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T23:03:37.865 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T23:03:37.872 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T23:03:37.872 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:03:37.921 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T23:03:37.948 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:03:37.948 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:03:38.015 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:03:38.032 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T23:03:38.038 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:03:38.038 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:03:38.107 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T23:03:38.162 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T23:03:38.225 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:03:38.226 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:03:38.240 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T23:03:38.310 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:03:38.329 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T23:03:38.378 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:03:38.469 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T23:03:38.519 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T23:03:38.552 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T23:03:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T23:03:38.962 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:03:38.995 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:03:39.027 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T23:03:39.089 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T23:03:39.118 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:03:39.433 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:03:39.433 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T23:03:39.433 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T23:03:39.433 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T23:03:39.434 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T23:03:39.434 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T23:03:39.434 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T23:03:39.434 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T23:03:39.434 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:03:39.434 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:03:39.434 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:03:39.434 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T23:03:39.434 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T23:03:39.434 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:03:39.434 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T23:03:39.434 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T23:03:39.434 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T23:03:39.435 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T23:03:39.435 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T23:03:39.435 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T23:03:39.435 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T23:03:39.435 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T23:03:39.435 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T23:03:39.435 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T23:03:39.435 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T23:03:39.435 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T23:03:39.435 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T23:03:39.435 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T23:03:39.435 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T23:03:39.435 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T23:03:39.436 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T23:03:39.436 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T23:03:39.436 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T23:03:39.436 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T23:03:39.436 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T23:03:39.436 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T23:03:39.436 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T23:03:39.436 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T23:03:39.436 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T23:03:39.436 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T23:03:39.436 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T23:03:39.436 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T23:03:39.436 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T23:03:39.437 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T23:03:39.437 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T23:03:39.437 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T23:03:39.437 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T23:03:39.437 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T23:03:39.437 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T23:03:39.437 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T23:03:39.437 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T23:03:39.437 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T23:03:39.437 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T23:03:39.437 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T23:03:39.437 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T23:03:39.437 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T23:03:39.438 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T23:03:39.438 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T23:03:39.438 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T23:03:39.438 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T23:03:39.438 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T23:03:39.438 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T23:03:39.438 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T23:03:39.438 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T23:03:39.438 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T23:03:39.438 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T23:03:39.438 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T23:03:39.438 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T23:03:39.439 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T23:03:39.440 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T23:03:39.440 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T23:03:39.440 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T23:03:39.440 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T23:03:39.440 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T23:03:39.440 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T23:03:39.440 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T23:03:39.440 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T23:03:39.440 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T23:03:39.440 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T23:03:39.440 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T23:03:39.440 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T23:03:39.441 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T23:03:39.442 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T23:03:39.443 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T23:03:39.443 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T23:03:39.443 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T23:03:39.443 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T23:03:39.443 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T23:03:39.443 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T23:03:39.443 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T23:03:39.443 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T23:03:39.443 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T23:03:39.443 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T23:03:39.443 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T23:03:39.443 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T23:03:39.443 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T23:03:39.444 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T23:03:39.444 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T23:03:39.444 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T23:03:39.444 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T23:03:39.444 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T23:03:39.444 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T23:03:39.444 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T23:03:39.444 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T23:03:39.444 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T23:03:39.444 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T23:03:39.444 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T23:03:39.444 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T23:03:39.444 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T23:03:39.445 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T23:03:39.445 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T23:03:39.445 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T23:03:39.445 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T23:03:39.445 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T23:03:39.445 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T23:03:39.445 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T23:03:39.445 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T23:03:39.445 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T23:03:39.445 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T23:03:39.445 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T23:03:39.445 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T23:03:39.445 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T23:03:39.446 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T23:03:39.446 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T23:03:39.446 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T23:03:40.159 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:03:40.203 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:03:41.160 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:03:41.179 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:03:41.282 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:03:41.462 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T23:03:41.489 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:03:41.513 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:03:41.513 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:41.513 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T23:03:41.513 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:03:41.513 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:03:41.513 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:03:41.564 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:03:41.576 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:03:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T23:03:41.728 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T23:03:42.023 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:03:42.024 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:03:42.024 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2024-09-15T23:03:42.024 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T23:03:42.024 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T23:03:42.024 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T23:03:42.024 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T23:03:42.024 INFO:teuthology.orchestra.run.smithi145.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.025 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.025 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T23:03:42.025 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T23:03:42.025 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-15T23:03:42.025 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T23:03:42.025 INFO:teuthology.orchestra.run.smithi145.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T23:03:42.025 INFO:teuthology.orchestra.run.smithi145.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T23:03:42.025 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T23:03:42.025 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.025 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:42.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:42.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:42.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:42.026 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:42.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:42.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:42.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.027 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:42.027 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:42.028 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.028 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.028 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:42.028 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T23:03:42.028 INFO:teuthology.orchestra.run.smithi145.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T23:03:42.028 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T23:03:42.028 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T23:03:42.029 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T23:03:42.030 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T23:03:42.030 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.030 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.030 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T23:03:42.030 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.030 INFO:teuthology.orchestra.run.smithi145.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T23:03:42.030 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T23:03:42.030 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T23:03:42.030 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T23:03:42.030 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T23:03:42.030 INFO:teuthology.orchestra.run.smithi145.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T23:03:42.030 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T23:03:42.030 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T23:03:42.031 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T23:03:42.031 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T23:03:42.031 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T23:03:42.031 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T23:03:42.031 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T23:03:42.031 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T23:03:42.031 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T23:03:42.031 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T23:03:42.032 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T23:03:42.032 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T23:03:42.032 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T23:03:42.032 INFO:teuthology.orchestra.run.smithi145.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T23:03:42.032 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T23:03:42.032 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T23:03:42.032 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T23:03:42.032 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.032 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.032 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.033 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T23:03:42.033 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T23:03:42.033 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T23:03:42.033 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T23:03:42.033 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T23:03:42.033 INFO:teuthology.orchestra.run.smithi145.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T23:03:42.033 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T23:03:42.033 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T23:03:42.033 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T23:03:42.033 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T23:03:42.033 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T23:03:42.033 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T23:03:42.034 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T23:03:42.034 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T23:03:42.034 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T23:03:42.034 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T23:03:42.034 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T23:03:42.034 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T23:03:42.034 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T23:03:42.034 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T23:03:42.034 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T23:03:42.034 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T23:03:42.034 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T23:03:42.034 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T23:03:42.034 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T23:03:42.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T23:03:42.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T23:03:42.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T23:03:42.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T23:03:42.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T23:03:42.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T23:03:42.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T23:03:42.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T23:03:42.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T23:03:42.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T23:03:42.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T23:03:42.035 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T23:03:42.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T23:03:42.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T23:03:42.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T23:03:42.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T23:03:42.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T23:03:42.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T23:03:42.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T23:03:42.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T23:03:42.036 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T23:03:42.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T23:03:42.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T23:03:42.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T23:03:42.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T23:03:42.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T23:03:42.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T23:03:42.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T23:03:42.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T23:03:42.037 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T23:03:42.037 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T23:03:42.037 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T23:03:42.037 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T23:03:42.037 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.038 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.038 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:42.038 INFO:teuthology.orchestra.run.smithi145.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T23:03:42.038 INFO:teuthology.orchestra.run.smithi145.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T23:03:42.038 INFO:teuthology.orchestra.run.smithi145.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T23:03:42.038 INFO:teuthology.orchestra.run.smithi145.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T23:03:42.038 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T23:03:42.038 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T23:03:42.039 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T23:03:42.039 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:03:42.039 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-15T23:03:42.426 DEBUG:teuthology.parallel:result is None 2024-09-15T23:03:42.649 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T23:03:42.675 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:03:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:03:42.699 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:42.699 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T23:03:42.699 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:03:42.699 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:03:42.699 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:03:42.751 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:03:42.774 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:03:42.774 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:42.774 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T23:03:42.774 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:03:42.818 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:03:42.841 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:03:42.841 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:42.841 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T23:03:42.841 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:03:42.842 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:03:42.842 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:03:43.152 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:03:43.175 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:03:43.175 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:03:43.175 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T23:03:43.175 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:03:43.176 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:03:43.176 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:03:43.880 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:03:43.880 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T23:03:43.880 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T23:03:43.880 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T23:03:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T23:03:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T23:03:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T23:03:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T23:03:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:03:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:03:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:03:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T23:03:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T23:03:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:03:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T23:03:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T23:03:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T23:03:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T23:03:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T23:03:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T23:03:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T23:03:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T23:03:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T23:03:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T23:03:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T23:03:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T23:03:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T23:03:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T23:03:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T23:03:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T23:03:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T23:03:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T23:03:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T23:03:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T23:03:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T23:03:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T23:03:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T23:03:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T23:03:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T23:03:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T23:03:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T23:03:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T23:03:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T23:03:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T23:03:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T23:03:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T23:03:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T23:03:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T23:03:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T23:03:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T23:03:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T23:03:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T23:03:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T23:03:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T23:03:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T23:03:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T23:03:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T23:03:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T23:03:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T23:03:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T23:03:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T23:03:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T23:03:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T23:03:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T23:03:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T23:03:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T23:03:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T23:03:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T23:03:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T23:03:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T23:03:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T23:03:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T23:03:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T23:03:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T23:03:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T23:03:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T23:03:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T23:03:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T23:03:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T23:03:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T23:03:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T23:03:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T23:03:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T23:03:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T23:03:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T23:03:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T23:03:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T23:03:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T23:03:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T23:03:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T23:03:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T23:03:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T23:03:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T23:03:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T23:03:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T23:03:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T23:03:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T23:03:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T23:03:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T23:03:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T23:03:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T23:03:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T23:03:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T23:03:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T23:03:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T23:03:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T23:03:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T23:03:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T23:03:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T23:03:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T23:03:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T23:03:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T23:03:46.795 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:03:46.795 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:03:46.795 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-09-15T23:03:46.795 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T23:03:46.795 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T23:03:46.795 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T23:03:46.795 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T23:03:46.795 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.795 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.796 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T23:03:46.796 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T23:03:46.796 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-15T23:03:46.796 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T23:03:46.796 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T23:03:46.796 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T23:03:46.796 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T23:03:46.796 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.796 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.796 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.796 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.796 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:46.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:46.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:46.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:46.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:46.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:46.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:46.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T23:03:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T23:03:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T23:03:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T23:03:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T23:03:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T23:03:46.798 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T23:03:46.799 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T23:03:46.799 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T23:03:46.799 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T23:03:46.799 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T23:03:46.799 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.799 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.799 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.799 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T23:03:46.799 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T23:03:46.799 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T23:03:46.799 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T23:03:46.799 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T23:03:46.799 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T23:03:46.800 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.801 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.802 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.802 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T23:03:46.802 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T23:03:46.802 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T23:03:46.802 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T23:03:46.802 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T23:03:46.802 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T23:03:46.802 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T23:03:46.802 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T23:03:46.802 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T23:03:46.802 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T23:03:46.802 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T23:03:46.802 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T23:03:46.803 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T23:03:46.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T23:03:46.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T23:03:46.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T23:03:46.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T23:03:46.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T23:03:46.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T23:03:46.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T23:03:46.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T23:03:46.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T23:03:46.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T23:03:46.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T23:03:46.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T23:03:46.804 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T23:03:46.805 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T23:03:46.806 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T23:03:46.807 INFO:teuthology.orchestra.run.smithi002.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T23:03:46.807 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T23:03:46.807 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T23:03:46.807 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T23:03:46.807 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:03:46.807 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-15T23:03:47.239 DEBUG:teuthology.parallel:result is None 2024-09-15T23:03:47.764 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T23:03:47.805 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T23:03:47.846 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T23:03:47.878 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T23:03:47.905 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T23:03:48.108 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T23:03:48.152 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T23:03:48.182 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T23:03:48.211 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T23:03:48.266 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T23:03:48.899 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:03:48.938 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:03:48.959 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:03:49.787 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T23:03:49.867 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T23:03:49.915 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T23:03:50.014 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T23:03:50.046 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T23:03:50.071 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T23:03:50.099 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T23:03:50.100 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:03:50.181 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:03:50.181 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:03:50.265 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:03:50.290 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T23:03:50.295 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:03:50.296 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:03:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:03:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:03:50.560 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:03:50.625 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:03:56.313 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:03:56.313 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T23:03:56.313 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T23:03:56.313 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T23:03:56.313 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T23:03:56.313 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T23:03:56.313 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T23:03:56.314 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T23:03:56.314 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:03:56.314 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:03:56.314 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:03:56.314 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T23:03:56.314 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T23:03:56.314 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:03:56.314 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T23:03:56.314 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T23:03:56.314 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T23:03:56.314 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T23:03:56.314 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T23:03:56.314 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T23:03:56.315 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T23:03:56.315 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T23:03:56.315 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T23:03:56.315 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T23:03:56.315 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T23:03:56.315 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T23:03:56.330 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T23:03:56.330 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T23:03:56.330 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T23:03:56.331 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T23:03:56.331 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T23:03:56.331 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T23:03:56.331 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T23:03:56.331 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T23:03:56.331 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T23:03:56.331 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T23:03:56.331 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T23:03:56.331 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T23:03:56.331 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T23:03:56.331 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T23:03:56.331 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T23:03:56.331 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T23:03:56.332 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T23:03:56.332 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T23:03:56.332 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T23:03:56.332 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T23:03:56.332 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T23:03:56.332 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T23:03:56.332 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T23:03:56.332 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T23:03:56.332 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T23:03:56.332 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T23:03:56.332 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T23:03:56.332 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T23:03:56.333 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T23:03:56.333 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T23:03:56.333 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T23:03:56.333 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T23:03:56.333 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T23:03:56.333 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T23:03:56.333 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T23:03:56.333 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T23:03:56.333 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T23:03:56.333 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T23:03:56.333 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T23:03:56.333 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T23:03:56.333 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T23:03:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T23:03:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T23:03:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T23:03:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T23:03:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T23:03:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T23:03:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T23:03:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T23:03:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T23:03:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T23:03:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T23:03:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T23:03:56.334 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T23:03:56.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T23:03:56.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T23:03:56.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T23:03:56.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T23:03:56.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T23:03:56.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T23:03:56.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T23:03:56.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T23:03:56.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T23:03:56.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T23:03:56.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T23:03:56.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T23:03:56.335 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T23:03:56.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T23:03:56.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T23:03:56.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T23:03:56.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T23:03:56.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T23:03:56.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T23:03:56.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T23:03:56.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T23:03:56.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T23:03:56.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T23:03:56.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T23:03:56.336 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T23:03:56.337 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T23:03:56.337 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T23:03:56.337 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T23:03:56.337 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T23:03:56.337 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T23:03:56.337 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T23:03:56.337 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T23:03:56.337 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T23:03:56.337 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T23:03:56.338 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T23:03:56.338 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T23:03:56.338 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T23:03:56.338 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T23:03:56.338 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T23:03:56.338 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T23:03:56.338 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T23:03:56.338 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T23:03:56.338 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T23:03:56.338 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T23:03:56.338 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T23:03:56.338 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T23:03:56.338 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T23:03:56.339 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T23:03:56.339 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T23:03:56.339 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T23:03:56.339 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T23:03:56.339 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T23:03:56.339 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T23:03:56.339 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T23:03:56.339 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T23:03:56.339 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T23:03:56.339 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T23:03:56.340 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T23:03:56.340 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T23:03:56.340 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T23:03:56.340 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T23:03:56.340 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T23:03:56.340 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T23:03:56.340 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T23:03:56.340 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T23:03:56.340 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T23:03:56.340 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T23:03:56.340 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T23:03:56.340 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T23:03:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T23:03:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T23:03:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T23:03:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T23:03:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T23:03:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T23:03:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T23:03:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T23:03:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T23:03:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T23:03:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T23:03:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T23:03:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T23:03:56.342 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T23:03:56.342 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T23:03:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:03:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:03:58.680 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2024-09-15T23:03:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T23:03:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T23:03:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T23:03:58.680 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T23:03:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T23:03:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T23:03:58.681 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-15T23:03:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T23:03:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T23:03:58.681 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T23:03:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T23:03:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:58.682 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.683 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:03:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T23:03:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T23:03:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T23:03:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T23:03:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T23:03:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T23:03:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T23:03:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T23:03:58.684 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T23:03:58.685 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T23:03:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T23:03:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T23:03:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T23:03:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T23:03:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T23:03:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T23:03:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T23:03:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T23:03:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T23:03:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T23:03:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T23:03:58.686 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T23:03:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T23:03:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T23:03:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T23:03:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T23:03:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T23:03:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T23:03:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T23:03:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T23:03:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T23:03:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T23:03:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.687 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T23:03:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T23:03:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T23:03:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T23:03:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T23:03:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T23:03:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T23:03:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T23:03:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T23:03:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T23:03:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T23:03:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T23:03:58.688 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T23:03:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T23:03:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T23:03:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T23:03:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T23:03:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T23:03:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T23:03:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T23:03:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T23:03:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T23:03:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T23:03:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T23:03:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T23:03:58.689 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T23:03:58.690 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T23:03:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T23:03:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T23:03:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T23:03:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T23:03:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T23:03:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T23:03:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T23:03:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T23:03:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T23:03:58.691 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T23:03:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T23:03:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T23:03:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T23:03:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T23:03:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T23:03:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T23:03:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T23:03:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T23:03:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:03:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T23:03:58.692 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T23:03:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T23:03:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T23:03:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T23:03:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T23:03:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T23:03:58.693 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:03:58.693 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-15T23:03:59.124 DEBUG:teuthology.parallel:result is None 2024-09-15T23:03:59.125 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:03:59.273 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T23:03:59.300 INFO:teuthology.orchestra.run.smithi002.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T23:03:59.301 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T23:03:59.301 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T23:03:59.303 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:03:59.439 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T23:03:59.462 INFO:teuthology.orchestra.run.smithi112.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T23:03:59.462 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T23:03:59.462 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T23:03:59.464 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:03:59.601 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T23:03:59.628 INFO:teuthology.orchestra.run.smithi145.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T23:03:59.628 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T23:03:59.628 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T23:03:59.630 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T23:03:59.630 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:03:59.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T23:03:59.664 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:03:59.664 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T23:03:59.693 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-15T23:03:59.693 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T23:03:59.724 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T23:03:59.724 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:03:59.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T23:03:59.756 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T23:03:59.826 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:03:59.826 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T23:03:59.852 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T23:03:59.918 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-15T23:03:59.919 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T23:03:59.950 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T23:04:00.019 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T23:04:00.020 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:04:00.020 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T23:04:00.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T23:04:00.120 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:04:00.121 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T23:04:00.146 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T23:04:00.211 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-15T23:04:00.212 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T23:04:00.238 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T23:04:00.302 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T23:04:00.303 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:04:00.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T23:04:00.329 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T23:04:00.395 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:04:00.395 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T23:04:00.423 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T23:04:00.488 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-15T23:04:00.489 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T23:04:00.514 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T23:04:00.579 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-15T23:04:00.682 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-15T23:04:00.683 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:04:00.683 INFO:tasks.cephadm:Cluster fsid is cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:04:00.683 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-15T23:04:00.683 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.2', 'mon.b': '172.21.15.112', 'mon.c': '172.21.15.145'} 2024-09-15T23:04:00.683 INFO:tasks.cephadm:First mon is mon.a on smithi002 2024-09-15T23:04:00.683 INFO:tasks.cephadm:First mgr is x 2024-09-15T23:04:00.684 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-15T23:04:00.684 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname $(hostname -s) 2024-09-15T23:04:00.710 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname $(hostname -s) 2024-09-15T23:04:00.735 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname $(hostname -s) 2024-09-15T23:04:00.760 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-15T23:04:00.761 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:04:00.898 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56081/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-326-g8921c8ef', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-326.g8921c8ef'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-15 16:06:42.385367', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-15T23:04:01.044 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref squid, sha1 8921c8ef947807b717db041d85f0761b7914d5fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:04:01.046 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T23:04:01.046 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T23:04:01.046 DEBUG:teuthology.orchestra.run.smithi002:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T23:04:01.425 INFO:teuthology.orchestra.run.smithi002.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 23:04 /home/ubuntu/cephtest/cephadm 2024-09-15T23:04:01.426 DEBUG:teuthology.orchestra.run.smithi112:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T23:04:01.800 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 23:04 /home/ubuntu/cephtest/cephadm 2024-09-15T23:04:01.801 DEBUG:teuthology.orchestra.run.smithi145:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T23:04:02.165 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 23:04 /home/ubuntu/cephtest/cephadm 2024-09-15T23:04:02.165 DEBUG:teuthology.orchestra.run.smithi002:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T23:04:02.186 DEBUG:teuthology.orchestra.run.smithi112:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T23:04:02.207 DEBUG:teuthology.orchestra.run.smithi145:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T23:04:02.245 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc on all hosts... 2024-09-15T23:04:02.245 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T23:04:02.248 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T23:04:02.251 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T23:04:03.815 INFO:teuthology.orchestra.run.smithi145.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T23:04:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T23:04:03.971 INFO:teuthology.orchestra.run.smithi112.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T23:04:31.002 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:04:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:04:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T23:04:31.002 INFO:teuthology.orchestra.run.smithi112.stdout: "repo_digests": [ 2024-09-15T23:04:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T23:04:31.003 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-15T23:04:31.003 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:04:35.342 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-15T23:04:35.343 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:04:35.343 INFO:teuthology.orchestra.run.smithi145.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T23:04:35.343 INFO:teuthology.orchestra.run.smithi145.stdout: "repo_digests": [ 2024-09-15T23:04:35.343 INFO:teuthology.orchestra.run.smithi145.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T23:04:35.343 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-15T23:04:35.343 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-15T23:04:35.895 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-15T23:04:35.896 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:04:35.896 INFO:teuthology.orchestra.run.smithi002.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T23:04:35.896 INFO:teuthology.orchestra.run.smithi002.stdout: "repo_digests": [ 2024-09-15T23:04:35.896 INFO:teuthology.orchestra.run.smithi002.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T23:04:35.896 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-15T23:04:35.896 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-15T23:04:35.923 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph 2024-09-15T23:04:35.971 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph 2024-09-15T23:04:36.006 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph 2024-09-15T23:04:36.035 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /etc/ceph 2024-09-15T23:04:36.062 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /etc/ceph 2024-09-15T23:04:36.091 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /etc/ceph 2024-09-15T23:04:36.117 INFO:tasks.cephadm:Writing seed config... 2024-09-15T23:04:36.118 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-15T23:04:36.118 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-15T23:04:36.119 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-15T23:04:36.119 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-15T23:04:36.119 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-15T23:04:36.119 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-15T23:04:36.119 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-15T23:04:36.119 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-15T23:04:36.119 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-15T23:04:36.119 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-15T23:04:36.119 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-15T23:04:36.119 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-15T23:04:36.119 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-15T23:04:36.120 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-15T23:04:36.120 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-15T23:04:36.120 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-15T23:04:36.120 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-15T23:04:36.120 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-15T23:04:36.120 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-15T23:04:36.120 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-15T23:04:36.120 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-15T23:04:36.120 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-15T23:04:36.120 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-15T23:04:36.120 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-15T23:04:36.120 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-15T23:04:36.120 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-15T23:04:36.121 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-15T23:04:36.121 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-15T23:04:36.121 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-15T23:04:36.121 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-15T23:04:36.121 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-15T23:04:36.121 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-15T23:04:36.121 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-15T23:04:36.121 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-15T23:04:36.121 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-15T23:04:36.121 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-15T23:04:36.121 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-15T23:04:36.121 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-15T23:04:36.122 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-15T23:04:36.122 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-15T23:04:36.122 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-15T23:04:36.122 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-15T23:04:36.122 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-15T23:04:36.122 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-15T23:04:36.122 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-15T23:04:36.122 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-15T23:04:36.123 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:04:36.123 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-15T23:04:36.140 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = cb7ab3ae-73b6-11ef-bceb-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-15T23:04:36.141 DEBUG:teuthology.orchestra.run.smithi002:mon.a> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.a.service 2024-09-15T23:04:36.183 DEBUG:teuthology.orchestra.run.smithi002:mgr.x> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.x.service 2024-09-15T23:04:36.228 INFO:tasks.cephadm:Bootstrapping... 2024-09-15T23:04:36.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc -v bootstrap --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.2 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:04:36.437 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:04:36.437 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc', '-v', 'bootstrap', '--fsid', 'cb7ab3ae-73b6-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.2', '--skip-admin-label'] 2024-09-15T23:04:36.438 INFO:teuthology.orchestra.run.smithi002.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-15T23:04:36.438 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying podman|docker is present... 2024-09-15T23:04:36.461 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-15T23:04:36.462 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying lvm2 is present... 2024-09-15T23:04:36.462 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying time synchronization is in place... 2024-09-15T23:04:36.470 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T23:04:36.470 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T23:04:36.476 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T23:04:36.476 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-15T23:04:36.483 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-15T23:04:36.489 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-15T23:04:36.490 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-15T23:04:36.490 INFO:teuthology.orchestra.run.smithi002.stdout:Repeating the final host check... 2024-09-15T23:04:36.512 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-15T23:04:36.512 INFO:teuthology.orchestra.run.smithi002.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-15T23:04:36.512 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl is present 2024-09-15T23:04:36.512 INFO:teuthology.orchestra.run.smithi002.stdout:lvcreate is present 2024-09-15T23:04:36.519 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T23:04:36.519 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T23:04:36.526 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T23:04:36.526 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-15T23:04:36.533 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-15T23:04:36.539 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-15T23:04:36.540 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-15T23:04:36.540 INFO:teuthology.orchestra.run.smithi002.stdout:Host looks OK 2024-09-15T23:04:36.540 INFO:teuthology.orchestra.run.smithi002.stdout:Cluster fsid: cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:04:36.540 INFO:teuthology.orchestra.run.smithi002.stdout:Acquiring lock 140292019188736 on /run/cephadm/cb7ab3ae-73b6-11ef-bceb-c7b262605968.lock 2024-09-15T23:04:36.540 INFO:teuthology.orchestra.run.smithi002.stdout:Lock 140292019188736 acquired on /run/cephadm/cb7ab3ae-73b6-11ef-bceb-c7b262605968.lock 2024-09-15T23:04:36.540 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 3300 ... 2024-09-15T23:04:36.541 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 6789 ... 2024-09-15T23:04:36.541 INFO:teuthology.orchestra.run.smithi002.stdout:Base mon IP(s) is [172.21.15.2:3300, 172.21.15.2:6789], mon addrv is [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-15T23:04:36.544 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.2 metric 100 2024-09-15T23:04:36.545 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.2 metric 100 2024-09-15T23:04:36.547 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-15T23:04:36.547 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-15T23:04:36.547 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1753sec hoplimit 64 pref medium 2024-09-15T23:04:36.550 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-15T23:04:36.550 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-15T23:04:36.550 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T23:04:36.550 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-15T23:04:36.551 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-15T23:04:36.551 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T23:04:36.551 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-15T23:04:36.551 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-15T23:04:36.551 INFO:teuthology.orchestra.run.smithi002.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-15T23:04:36.551 INFO:teuthology.orchestra.run.smithi002.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-15T23:04:36.551 INFO:teuthology.orchestra.run.smithi002.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T23:04:37.007 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T23:04:37.007 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T23:04:37.008 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Getting image source signatures 2024-09-15T23:04:37.008 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:c0574da0c3174f3dc49daa274908f97d06456bd6a3cfab87e94022c1369a83a6 2024-09-15T23:04:37.008 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-15T23:04:37.008 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying config sha256:f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T23:04:37.008 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-15T23:04:38.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph: stdout ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T23:04:38.011 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph version: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T23:04:38.011 INFO:teuthology.orchestra.run.smithi002.stdout:Extracting ceph user uid/gid from container image... 2024-09-15T23:04:38.973 INFO:teuthology.orchestra.run.smithi002.stdout:stat: stdout 167 167 2024-09-15T23:04:38.974 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial keys... 2024-09-15T23:04:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAHaOdmvH7IEBAA3kExTupdTwj2hyiMBVtczw== 2024-09-15T23:04:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAIaOdmwUEiCBAAUeG5dOYppKb/IyD/LKi8mw== 2024-09-15T23:04:41.714 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAJaOdmileMCRAAUtsqCmh+7cySWzWLmpU4Nw== 2024-09-15T23:04:41.715 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial monmap... 2024-09-15T23:04:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T23:04:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-15T23:04:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:04:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T23:04:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool for a [v2:172.21.15.2:3300,v1:172.21.15.2:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T23:04:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-09-15T23:04:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: set fsid to cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:04:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T23:04:42.690 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:04:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mon... 2024-09-15T23:04:43.643 INFO:teuthology.orchestra.run.smithi002.stdout:create mon.a on 2024-09-15T23:04:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-15T23:04:44.006 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-15T23:04:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968.target. 2024-09-15T23:04:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968.target. 2024-09-15T23:04:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.a 2024-09-15T23:04:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-15T23:04:44.642 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968.target.wants/ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@.service. 2024-09-15T23:04:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T23:04:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-15T23:04:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T23:04:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-15T23:04:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-15T23:04:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T23:04:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon to start... 2024-09-15T23:04:45.169 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon... 2024-09-15T23:04:46.201 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:46 smithi002 ceph-mon[30657]: from='client.? 172.21.15.2:0/935470368' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-15T23:04:46.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout cluster: 2024-09-15T23:04:46.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout id: cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:04:46.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-15T23:04:46.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-15T23:04:46.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout services: 2024-09-15T23:04:46.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.540043s) 2024-09-15T23:04:46.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-15T23:04:46.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-15T23:04:46.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-15T23:04:46.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout data: 2024-09-15T23:04:46.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-15T23:04:46.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-15T23:04:46.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-15T23:04:46.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pgs: 2024-09-15T23:04:46.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-15T23:04:46.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.568+0000 7ff264979640 1 Processor -- start 2024-09-15T23:04:46.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.568+0000 7ff264979640 1 -- start start 2024-09-15T23:04:46.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.569+0000 7ff264979640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 0x7ff2601061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:46.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.569+0000 7ff264979640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff26007bd90 con 0x7ff260105de0 2024-09-15T23:04:46.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.569+0000 7ff25e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 0x7ff2601061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:46.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.569+0000 7ff25e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 0x7ff2601061e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59948/0 (socket says 172.21.15.2:59948) 2024-09-15T23:04:46.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.569+0000 7ff25e59c640 1 -- 172.21.15.2:0/165380051 learned_addr learned my addr 172.21.15.2:0/165380051 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:04:46.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.569+0000 7ff25e59c640 1 -- 172.21.15.2:0/165380051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff260106720 con 0x7ff260105de0 2024-09-15T23:04:46.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.571+0000 7ff25e59c640 1 --2- 172.21.15.2:0/165380051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 0x7ff2601061e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff250009820 tx=0x7ff25002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4032b6ec82772fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:46.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.572+0000 7ff25d59a640 1 -- 172.21.15.2:0/165380051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff250037070 con 0x7ff260105de0 2024-09-15T23:04:46.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.572+0000 7ff25d59a640 1 -- 172.21.15.2:0/165380051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff250032440 con 0x7ff260105de0 2024-09-15T23:04:46.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.572+0000 7ff25d59a640 1 -- 172.21.15.2:0/165380051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff250032740 con 0x7ff260105de0 2024-09-15T23:04:46.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.572+0000 7ff264979640 1 -- 172.21.15.2:0/165380051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 msgr2=0x7ff2601061e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:46.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.572+0000 7ff264979640 1 --2- 172.21.15.2:0/165380051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 0x7ff2601061e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff250009820 tx=0x7ff25002a270 comp rx=0 tx=0).stop 2024-09-15T23:04:46.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.572+0000 7ff264979640 1 -- 172.21.15.2:0/165380051 shutdown_connections 2024-09-15T23:04:46.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.572+0000 7ff264979640 1 --2- 172.21.15.2:0/165380051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 0x7ff2601061e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:46.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.572+0000 7ff264979640 1 -- 172.21.15.2:0/165380051 >> 172.21.15.2:0/165380051 conn(0x7ff260101bb0 msgr2=0x7ff260103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:46.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.572+0000 7ff264979640 1 -- 172.21.15.2:0/165380051 shutdown_connections 2024-09-15T23:04:46.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.572+0000 7ff264979640 1 -- 172.21.15.2:0/165380051 wait complete. 2024-09-15T23:04:46.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.573+0000 7ff264979640 1 Processor -- start 2024-09-15T23:04:46.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.573+0000 7ff264979640 1 -- start start 2024-09-15T23:04:46.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.573+0000 7ff264979640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 0x7ff26019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:46.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.573+0000 7ff264979640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff260106b40 con 0x7ff260105de0 2024-09-15T23:04:46.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.573+0000 7ff25e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 0x7ff26019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:46.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.573+0000 7ff25e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 0x7ff26019ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59952/0 (socket says 172.21.15.2:59952) 2024-09-15T23:04:46.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.573+0000 7ff25e59c640 1 -- 172.21.15.2:0/935470368 learned_addr learned my addr 172.21.15.2:0/935470368 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:04:46.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.574+0000 7ff25e59c640 1 -- 172.21.15.2:0/935470368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26019d380 con 0x7ff260105de0 2024-09-15T23:04:46.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.574+0000 7ff25e59c640 1 --2- 172.21.15.2:0/935470368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 0x7ff26019ce40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff2500090b0 tx=0x7ff2500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:46.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.574+0000 7ff2577fe640 1 -- 172.21.15.2:0/935470368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff250041070 con 0x7ff260105de0 2024-09-15T23:04:46.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.574+0000 7ff2577fe640 1 -- 172.21.15.2:0/935470368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25003c7a0 con 0x7ff260105de0 2024-09-15T23:04:46.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.574+0000 7ff264979640 1 -- 172.21.15.2:0/935470368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26019d610 con 0x7ff260105de0 2024-09-15T23:04:46.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.574+0000 7ff2577fe640 1 -- 172.21.15.2:0/935470368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff250037040 con 0x7ff260105de0 2024-09-15T23:04:46.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.574+0000 7ff264979640 1 -- 172.21.15.2:0/935470368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2601a0300 con 0x7ff260105de0 2024-09-15T23:04:46.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.574+0000 7ff2577fe640 1 -- 172.21.15.2:0/935470368 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff250044070 con 0x7ff260105de0 2024-09-15T23:04:46.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.574+0000 7ff2577fe640 1 -- 172.21.15.2:0/935470368 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff25003d3f0 con 0x7ff260105de0 2024-09-15T23:04:46.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.575+0000 7ff264979640 1 -- 172.21.15.2:0/935470368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff260106260 con 0x7ff260105de0 2024-09-15T23:04:46.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.578+0000 7ff2577fe640 1 -- 172.21.15.2:0/935470368 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff250046450 con 0x7ff260105de0 2024-09-15T23:04:46.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.639+0000 7ff264979640 1 -- 172.21.15.2:0/935470368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7ff2601a0850 con 0x7ff260105de0 2024-09-15T23:04:46.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.639+0000 7ff2577fe640 1 -- 172.21.15.2:0/935470368 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7ff250046630 con 0x7ff260105de0 2024-09-15T23:04:46.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.640+0000 7ff264979640 1 -- 172.21.15.2:0/935470368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 msgr2=0x7ff26019ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:46.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.640+0000 7ff264979640 1 --2- 172.21.15.2:0/935470368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 0x7ff26019ce40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff2500090b0 tx=0x7ff2500046c0 comp rx=0 tx=0).stop 2024-09-15T23:04:46.225 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.640+0000 7ff264979640 1 -- 172.21.15.2:0/935470368 shutdown_connections 2024-09-15T23:04:46.225 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.640+0000 7ff264979640 1 --2- 172.21.15.2:0/935470368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff260105de0 0x7ff26019ce40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:46.226 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.640+0000 7ff264979640 1 -- 172.21.15.2:0/935470368 >> 172.21.15.2:0/935470368 conn(0x7ff260101bb0 msgr2=0x7ff260193400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:46.226 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.640+0000 7ff264979640 1 -- 172.21.15.2:0/935470368 shutdown_connections 2024-09-15T23:04:46.226 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:45.640+0000 7ff264979640 1 -- 172.21.15.2:0/935470368 wait complete. 2024-09-15T23:04:46.226 INFO:teuthology.orchestra.run.smithi002.stdout:mon is available 2024-09-15T23:04:46.226 INFO:teuthology.orchestra.run.smithi002.stdout:Assimilating anything we can from ceph.conf... 2024-09-15T23:04:47.231 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-15T23:04:47.231 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T23:04:47.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:04:47.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-15T23:04:47.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T23:04:47.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T23:04:47.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T23:04:47.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T23:04:47.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-15T23:04:47.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T23:04:47.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T23:04:47.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-15T23:04:47.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T23:04:47.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T23:04:47.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T23:04:47.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T23:04:47.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T23:04:47.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T23:04:47.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.607+0000 7f56fc021640 1 Processor -- start 2024-09-15T23:04:47.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.608+0000 7f56fc021640 1 -- start start 2024-09-15T23:04:47.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.608+0000 7f56fc021640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 0x7f56f407c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.608+0000 7f56fc021640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56f407c860 con 0x7f56f407de30 2024-09-15T23:04:47.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.608+0000 7f56f9dbd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 0x7f56f407c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.608+0000 7f56f9dbd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 0x7f56f407c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40922/0 (socket says 172.21.15.2:40922) 2024-09-15T23:04:47.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.608+0000 7f56f9dbd640 1 -- 172.21.15.2:0/2145066701 learned_addr learned my addr 172.21.15.2:0/2145066701 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:04:47.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.608+0000 7f56f9dbd640 1 -- 172.21.15.2:0/2145066701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f407c9e0 con 0x7f56f407de30 2024-09-15T23:04:47.237 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.609+0000 7f56f9dbd640 1 --2- 172.21.15.2:0/2145066701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 0x7f56f407c290 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009820 tx=0x7f56f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81f34f5f1229f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:47.237 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.609+0000 7f56f8dbb640 1 -- 172.21.15.2:0/2145066701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56f0037070 con 0x7f56f407de30 2024-09-15T23:04:47.237 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.609+0000 7f56f8dbb640 1 -- 172.21.15.2:0/2145066701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f0032440 con 0x7f56f407de30 2024-09-15T23:04:47.237 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.609+0000 7f56f8dbb640 1 -- 172.21.15.2:0/2145066701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56f0032740 con 0x7f56f407de30 2024-09-15T23:04:47.237 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.610+0000 7f56fc021640 1 -- 172.21.15.2:0/2145066701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 msgr2=0x7f56f407c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:47.238 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.610+0000 7f56fc021640 1 --2- 172.21.15.2:0/2145066701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 0x7f56f407c290 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009820 tx=0x7f56f002a270 comp rx=0 tx=0).stop 2024-09-15T23:04:47.238 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.610+0000 7f56fc021640 1 -- 172.21.15.2:0/2145066701 shutdown_connections 2024-09-15T23:04:47.238 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.610+0000 7f56fc021640 1 --2- 172.21.15.2:0/2145066701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 0x7f56f407c290 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.238 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.610+0000 7f56fc021640 1 -- 172.21.15.2:0/2145066701 >> 172.21.15.2:0/2145066701 conn(0x7f56f4102c70 msgr2=0x7f56f4105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:47.238 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.610+0000 7f56fc021640 1 -- 172.21.15.2:0/2145066701 shutdown_connections 2024-09-15T23:04:47.239 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.610+0000 7f56fc021640 1 -- 172.21.15.2:0/2145066701 wait complete. 2024-09-15T23:04:47.239 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.610+0000 7f56fc021640 1 Processor -- start 2024-09-15T23:04:47.239 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.610+0000 7f56fc021640 1 -- start start 2024-09-15T23:04:47.239 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.611+0000 7f56fc021640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 0x7f56f419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:47.240 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.611+0000 7f56fc021640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56f407cf10 con 0x7f56f407de30 2024-09-15T23:04:47.240 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.611+0000 7f56f9dbd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 0x7f56f419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:47.240 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.611+0000 7f56f9dbd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 0x7f56f419ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40936/0 (socket says 172.21.15.2:40936) 2024-09-15T23:04:47.240 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.611+0000 7f56f9dbd640 1 -- 172.21.15.2:0/1928148876 learned_addr learned my addr 172.21.15.2:0/1928148876 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:04:47.240 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.611+0000 7f56f9dbd640 1 -- 172.21.15.2:0/1928148876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f419d3f0 con 0x7f56f407de30 2024-09-15T23:04:47.241 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.611+0000 7f56f9dbd640 1 --2- 172.21.15.2:0/1928148876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 0x7f56f419ceb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f56f00090b0 tx=0x7f56f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:47.241 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.611+0000 7f56eaffd640 1 -- 172.21.15.2:0/1928148876 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56f0041070 con 0x7f56f407de30 2024-09-15T23:04:47.241 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.611+0000 7f56eaffd640 1 -- 172.21.15.2:0/1928148876 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f003c7a0 con 0x7f56f407de30 2024-09-15T23:04:47.241 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.611+0000 7f56eaffd640 1 -- 172.21.15.2:0/1928148876 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56f0037040 con 0x7f56f407de30 2024-09-15T23:04:47.241 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.611+0000 7f56fc021640 1 -- 172.21.15.2:0/1928148876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f419d680 con 0x7f56f407de30 2024-09-15T23:04:47.241 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.611+0000 7f56fc021640 1 -- 172.21.15.2:0/1928148876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f41a0370 con 0x7f56f407de30 2024-09-15T23:04:47.242 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.611+0000 7f56eaffd640 1 -- 172.21.15.2:0/1928148876 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f56f0044070 con 0x7f56f407de30 2024-09-15T23:04:47.242 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.612+0000 7f56eaffd640 1 -- 172.21.15.2:0/1928148876 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f56f003d3f0 con 0x7f56f407de30 2024-09-15T23:04:47.242 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.612+0000 7f56fc021640 1 -- 172.21.15.2:0/1928148876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f407c310 con 0x7f56f407de30 2024-09-15T23:04:47.242 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.614+0000 7f56eaffd640 1 -- 172.21.15.2:0/1928148876 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f56f0046450 con 0x7f56f407de30 2024-09-15T23:04:47.242 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.674+0000 7f56fc021640 1 -- 172.21.15.2:0/1928148876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f56f402d910 con 0x7f56f407de30 2024-09-15T23:04:47.242 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.677+0000 7f56eaffd640 1 -- 172.21.15.2:0/1928148876 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7f56f0046630 con 0x7f56f407de30 2024-09-15T23:04:47.242 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.678+0000 7f56fc021640 1 -- 172.21.15.2:0/1928148876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 msgr2=0x7f56f419ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:47.243 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.678+0000 7f56fc021640 1 --2- 172.21.15.2:0/1928148876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 0x7f56f419ceb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f56f00090b0 tx=0x7f56f00046c0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.243 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.678+0000 7f56fc021640 1 -- 172.21.15.2:0/1928148876 shutdown_connections 2024-09-15T23:04:47.243 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.678+0000 7f56fc021640 1 --2- 172.21.15.2:0/1928148876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56f407de30 0x7f56f419ceb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:47.243 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.678+0000 7f56fc021640 1 -- 172.21.15.2:0/1928148876 >> 172.21.15.2:0/1928148876 conn(0x7f56f4102c70 msgr2=0x7f56f4103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:47.243 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.678+0000 7f56fc021640 1 -- 172.21.15.2:0/1928148876 shutdown_connections 2024-09-15T23:04:47.243 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:46.678+0000 7f56fc021640 1 -- 172.21.15.2:0/1928148876 wait complete. 2024-09-15T23:04:47.244 INFO:teuthology.orchestra.run.smithi002.stdout:Generating new minimal ceph.conf... 2024-09-15T23:04:47.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:47 smithi002 ceph-mon[30657]: from='client.? 172.21.15.2:0/1928148876' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T23:04:47.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:47 smithi002 ceph-mon[30657]: from='client.? 172.21.15.2:0/1928148876' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-15T23:04:48.404 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:48 smithi002 ceph-mon[30657]: from='client.? 172.21.15.2:0/3758808787' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:04:48.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.633+0000 7f6e41f92640 1 Processor -- start 2024-09-15T23:04:48.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.633+0000 7f6e41f92640 1 -- start start 2024-09-15T23:04:48.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.633+0000 7f6e41f92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 0x7f6e3c1078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:48.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.633+0000 7f6e41f92640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c107e90 con 0x7f6e3c1074c0 2024-09-15T23:04:48.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.633+0000 7f6e3b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 0x7f6e3c1078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:48.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.634+0000 7f6e3b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 0x7f6e3c1078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40946/0 (socket says 172.21.15.2:40946) 2024-09-15T23:04:48.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.634+0000 7f6e3b7fe640 1 -- 172.21.15.2:0/213123039 learned_addr learned my addr 172.21.15.2:0/213123039 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:04:48.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.634+0000 7f6e3b7fe640 1 -- 172.21.15.2:0/213123039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c1086c0 con 0x7f6e3c1074c0 2024-09-15T23:04:48.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.635+0000 7f6e3b7fe640 1 --2- 172.21.15.2:0/213123039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 0x7f6e3c1078c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009820 tx=0x7f6e2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab896992e6c17aa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:48.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.635+0000 7f6e3a7fc640 1 -- 172.21.15.2:0/213123039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c037070 con 0x7f6e3c1074c0 2024-09-15T23:04:48.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.635+0000 7f6e3a7fc640 1 -- 172.21.15.2:0/213123039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6e2c0328d0 con 0x7f6e3c1074c0 2024-09-15T23:04:48.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.635+0000 7f6e3a7fc640 1 -- 172.21.15.2:0/213123039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c0307d0 con 0x7f6e3c1074c0 2024-09-15T23:04:48.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.636+0000 7f6e41f92640 1 -- 172.21.15.2:0/213123039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 msgr2=0x7f6e3c1078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:48.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.636+0000 7f6e41f92640 1 --2- 172.21.15.2:0/213123039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 0x7f6e3c1078c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009820 tx=0x7f6e2c02a270 comp rx=0 tx=0).stop 2024-09-15T23:04:48.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.636+0000 7f6e41f92640 1 -- 172.21.15.2:0/213123039 shutdown_connections 2024-09-15T23:04:48.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.636+0000 7f6e41f92640 1 --2- 172.21.15.2:0/213123039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 0x7f6e3c1078c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:48.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.636+0000 7f6e41f92640 1 -- 172.21.15.2:0/213123039 >> 172.21.15.2:0/213123039 conn(0x7f6e3c102c70 msgr2=0x7f6e3c105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:48.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.636+0000 7f6e41f92640 1 -- 172.21.15.2:0/213123039 shutdown_connections 2024-09-15T23:04:48.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.636+0000 7f6e41f92640 1 -- 172.21.15.2:0/213123039 wait complete. 2024-09-15T23:04:48.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.636+0000 7f6e41f92640 1 Processor -- start 2024-09-15T23:04:48.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.637+0000 7f6e41f92640 1 -- start start 2024-09-15T23:04:48.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.637+0000 7f6e41f92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 0x7f6e3c19b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:48.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.637+0000 7f6e41f92640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c10ba70 con 0x7f6e3c1074c0 2024-09-15T23:04:48.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.637+0000 7f6e3b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 0x7f6e3c19b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:48.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.637+0000 7f6e3b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 0x7f6e3c19b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40960/0 (socket says 172.21.15.2:40960) 2024-09-15T23:04:48.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.637+0000 7f6e3b7fe640 1 -- 172.21.15.2:0/3758808787 learned_addr learned my addr 172.21.15.2:0/3758808787 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:04:48.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.637+0000 7f6e3b7fe640 1 -- 172.21.15.2:0/3758808787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c19b9f0 con 0x7f6e3c1074c0 2024-09-15T23:04:48.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.637+0000 7f6e3b7fe640 1 --2- 172.21.15.2:0/3758808787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 0x7f6e3c19b4b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0097f0 tx=0x7f6e2c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:48.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.637+0000 7f6e38ff9640 1 -- 172.21.15.2:0/3758808787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c037040 con 0x7f6e3c1074c0 2024-09-15T23:04:48.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.637+0000 7f6e38ff9640 1 -- 172.21.15.2:0/3758808787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6e2c032bb0 con 0x7f6e3c1074c0 2024-09-15T23:04:48.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.637+0000 7f6e41f92640 1 -- 172.21.15.2:0/3758808787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c19bc80 con 0x7f6e3c1074c0 2024-09-15T23:04:48.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.638+0000 7f6e38ff9640 1 -- 172.21.15.2:0/3758808787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c03a390 con 0x7f6e3c1074c0 2024-09-15T23:04:48.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.638+0000 7f6e41f92640 1 -- 172.21.15.2:0/3758808787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c19e970 con 0x7f6e3c1074c0 2024-09-15T23:04:48.415 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.638+0000 7f6e38ff9640 1 -- 172.21.15.2:0/3758808787 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6e2c03a5d0 con 0x7f6e3c1074c0 2024-09-15T23:04:48.415 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.638+0000 7f6e38ff9640 1 -- 172.21.15.2:0/3758808787 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6e2c044ba0 con 0x7f6e3c1074c0 2024-09-15T23:04:48.415 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.639+0000 7f6e41f92640 1 -- 172.21.15.2:0/3758808787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3c10bbf0 con 0x7f6e3c1074c0 2024-09-15T23:04:48.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.641+0000 7f6e38ff9640 1 -- 172.21.15.2:0/3758808787 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6e2c044400 con 0x7f6e3c1074c0 2024-09-15T23:04:48.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.700+0000 7f6e41f92640 1 -- 172.21.15.2:0/3758808787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f6e3c19ef00 con 0x7f6e3c1074c0 2024-09-15T23:04:48.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.701+0000 7f6e38ff9640 1 -- 172.21.15.2:0/3758808787 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7f6e2c032d60 con 0x7f6e3c1074c0 2024-09-15T23:04:48.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.702+0000 7f6e41f92640 1 -- 172.21.15.2:0/3758808787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 msgr2=0x7f6e3c19b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:48.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.702+0000 7f6e41f92640 1 --2- 172.21.15.2:0/3758808787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 0x7f6e3c19b4b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0097f0 tx=0x7f6e2c030d00 comp rx=0 tx=0).stop 2024-09-15T23:04:48.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.702+0000 7f6e41f92640 1 -- 172.21.15.2:0/3758808787 shutdown_connections 2024-09-15T23:04:48.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.702+0000 7f6e41f92640 1 --2- 172.21.15.2:0/3758808787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e3c1074c0 0x7f6e3c19b4b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:48.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.702+0000 7f6e41f92640 1 -- 172.21.15.2:0/3758808787 >> 172.21.15.2:0/3758808787 conn(0x7f6e3c102c70 msgr2=0x7f6e3c1037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:48.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.702+0000 7f6e41f92640 1 -- 172.21.15.2:0/3758808787 shutdown_connections 2024-09-15T23:04:48.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:47.702+0000 7f6e41f92640 1 -- 172.21.15.2:0/3758808787 wait complete. 2024-09-15T23:04:48.417 INFO:teuthology.orchestra.run.smithi002.stdout:Restarting the monitor... 2024-09-15T23:04:48.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:48 smithi002 systemd[1]: Stopping Ceph mon.a for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:04:48.942 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:48 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a[30653]: 2024-09-15T23:04:48.682+0000 7f2e64226640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:04:48.942 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:48 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a[30653]: 2024-09-15T23:04:48.682+0000 7f2e64226640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-15T23:04:48.942 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:48 smithi002 podman[30898]: 2024-09-15 23:04:48.713443081 +0000 UTC m=+0.133650383 container died c37024754e64e4adacf76e9019bf8887d3153a0c92a81499c458af580cb5689c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:04:49.216 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 podman[30898]: 2024-09-15 23:04:49.031793871 +0000 UTC m=+0.452001181 container cleanup c37024754e64e4adacf76e9019bf8887d3153a0c92a81499c458af580cb5689c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-15T23:04:49.216 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 bash[30898]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a 2024-09-15T23:04:49.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 podman[30910]: 2024-09-15 23:04:49.215857675 +0000 UTC m=+0.501194962 container remove c37024754e64e4adacf76e9019bf8887d3153a0c92a81499c458af580cb5689c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-15T23:04:49.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 systemd[1]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-15T23:04:49.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 systemd[1]: Stopped Ceph mon.a for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:04:49.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 systemd[1]: Starting Ceph mon.a for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:04:49.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 podman[31001]: 2024-09-15 23:04:49.666609036 +0000 UTC m=+0.107075066 container create 0ce84f8b0ca9570d654bc99e38872ba993ecc29927864f3da17fcdc7bf11b068 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:04:49.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 podman[31001]: 2024-09-15 23:04:49.575811549 +0000 UTC m=+0.016277589 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:04:49.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 podman[31001]: 2024-09-15 23:04:49.876979375 +0000 UTC m=+0.317445418 container init 0ce84f8b0ca9570d654bc99e38872ba993ecc29927864f3da17fcdc7bf11b068 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:04:49.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 podman[31001]: 2024-09-15 23:04:49.880163495 +0000 UTC m=+0.320629526 container start 0ce84f8b0ca9570d654bc99e38872ba993ecc29927864f3da17fcdc7bf11b068 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-15T23:04:49.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T23:04:49.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T23:04:49.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: pidfile_write: ignore empty --pid-file 2024-09-15T23:04:49.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: load: jerasure load: lrc 2024-09-15T23:04:49.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: RocksDB version: 7.9.2 2024-09-15T23:04:49.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Git sha 0 2024-09-15T23:04:49.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T23:04:49.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: DB SUMMARY 2024-09-15T23:04:49.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: DB Session ID: 5LE1ELLPEZLBUIZ3EUO8 2024-09-15T23:04:49.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: CURRENT file: CURRENT 2024-09-15T23:04:49.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T23:04:49.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-15T23:04:49.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-15T23:04:49.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104696 ; 2024-09-15T23:04:49.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.error_if_exists: 0 2024-09-15T23:04:49.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.create_if_missing: 0 2024-09-15T23:04:49.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.paranoid_checks: 1 2024-09-15T23:04:49.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T23:04:49.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T23:04:49.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T23:04:49.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.env: 0x5607f4ad8940 2024-09-15T23:04:49.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T23:04:49.973 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.info_log: 0x5607f64356e0 2024-09-15T23:04:49.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T23:04:49.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.statistics: (nil) 2024-09-15T23:04:49.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.use_fsync: 0 2024-09-15T23:04:49.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_log_file_size: 0 2024-09-15T23:04:49.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T23:04:49.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T23:04:49.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T23:04:49.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T23:04:49.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.allow_fallocate: 1 2024-09-15T23:04:49.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T23:04:49.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T23:04:49.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.use_direct_reads: 0 2024-09-15T23:04:49.974 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T23:04:49.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T23:04:49.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.db_log_dir: 2024-09-15T23:04:49.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.wal_dir: 2024-09-15T23:04:49.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T23:04:49.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T23:04:49.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T23:04:49.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T23:04:49.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T23:04:49.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T23:04:49.975 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T23:04:49.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T23:04:49.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.write_buffer_manager: 0x5607f6444dc0 2024-09-15T23:04:49.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T23:04:49.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T23:04:49.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T23:04:49.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T23:04:49.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T23:04:49.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T23:04:49.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T23:04:49.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T23:04:49.976 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.unordered_write: 0 2024-09-15T23:04:49.977 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T23:04:49.977 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T23:04:49.977 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T23:04:49.977 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T23:04:49.977 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.row_cache: None 2024-09-15T23:04:49.977 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.wal_filter: None 2024-09-15T23:04:49.977 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T23:04:49.977 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T23:04:49.983 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.two_write_queues: 0 2024-09-15T23:04:49.983 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T23:04:49.983 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.wal_compression: 0 2024-09-15T23:04:49.983 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.atomic_flush: 0 2024-09-15T23:04:49.983 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T23:04:49.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T23:04:49.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T23:04:49.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.log_readahead_size: 0 2024-09-15T23:04:49.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T23:04:49.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T23:04:49.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T23:04:49.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T23:04:49.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T23:04:49.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T23:04:49.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T23:04:49.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_background_jobs: 2 2024-09-15T23:04:49.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_background_compactions: -1 2024-09-15T23:04:49.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_subcompactions: 1 2024-09-15T23:04:49.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T23:04:49.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T23:04:49.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T23:04:49.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T23:04:49.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T23:04:49.985 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_open_files: -1 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_background_flushes: -1 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Compression algorithms supported: 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: kZSTD supported: 0 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: kXpressCompression supported: 0 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: kBZip2Compression supported: 0 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T23:04:49.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: kLZ4Compression supported: 1 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: kZlibCompression supported: 1 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: kSnappyCompression supported: 1 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.merge_operator: 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compaction_filter: None 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T23:04:49.987 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T23:04:49.988 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5607f6435320) 2024-09-15T23:04:49.988 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-09-15T23:04:49.988 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T23:04:49.988 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T23:04:49.988 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-09-15T23:04:49.988 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_type: 0 2024-09-15T23:04:49.988 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_index_type: 0 2024-09-15T23:04:49.988 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_shortening: 1 2024-09-15T23:04:49.988 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T23:04:49.988 INFO:journalctl@ceph.mon.a.smithi002.stdout: checksum: 4 2024-09-15T23:04:49.988 INFO:journalctl@ceph.mon.a.smithi002.stdout: no_block_cache: 0 2024-09-15T23:04:49.988 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache: 0x5607f64291f0 2024-09-15T23:04:49.988 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_options: 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: capacity : 536870912 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_shard_bits : 4 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: strict_capacity_limit : 0 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_compressed: (nil) 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: persistent_cache: (nil) 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size: 4096 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size_deviation: 10 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_restart_interval: 16 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_block_restart_interval: 1 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: metadata_block_size: 4096 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: partition_filters: 0 2024-09-15T23:04:49.989 INFO:journalctl@ceph.mon.a.smithi002.stdout: use_delta_encoding: 1 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout: filter_policy: bloomfilter 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout: whole_key_filtering: 1 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout: verify_compression: 0 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout: format_version: 5 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_index_compression: 1 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_align: 0 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout: max_auto_readahead_size: 262144 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout: prepopulate_block_cache: 0 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout: initial_auto_readahead_size: 8192 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compression: NoCompression 2024-09-15T23:04:49.990 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.num_levels: 7 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T23:04:49.991 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T23:04:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T23:04:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T23:04:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T23:04:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T23:04:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T23:04:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T23:04:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T23:04:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T23:04:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T23:04:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T23:04:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T23:04:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T23:04:49.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T23:04:49.993 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T23:04:49.994 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.inplace_update_support: 0 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.bloom_locality: 0 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.max_successive_merges: 0 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.ttl: 2592000 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T23:04:49.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T23:04:49.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T23:04:49.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.enable_blob_files: false 2024-09-15T23:04:49.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.min_blob_size: 0 2024-09-15T23:04:49.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T23:04:49.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T23:04:49.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T23:04:49.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T23:04:49.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T23:04:49.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T23:04:49.996 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T23:04:49.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T23:04:49.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-15T23:04:49.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-15T23:04:49.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 14d19137-8515-4d34-a6e2-ba8b89c54483 2024-09-15T23:04:49.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726441489907294, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-15T23:04:49.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-15T23:04:49.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726441489908438, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99808, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 97694, "index_size": 306, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14155, "raw_average_key_size": 49, "raw_value_size": 90046, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726441489, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "14d19137-8515-4d34-a6e2-ba8b89c54483", "db_session_id": "5LE1ELLPEZLBUIZ3EUO8", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-15T23:04:49.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726441489908538, "job": 1, "event": "recovery_finished"} 2024-09-15T23:04:49.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-15T23:04:49.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T23:04:49.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5607f6456e00 2024-09-15T23:04:49.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: DB pointer 0x5607f6552000 2024-09-15T23:04:49.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** DB Stats ** 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T23:04:49.998 INFO:journalctl@ceph.mon.a.smithi002.stdout: L0 2/0 99.33 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: Sum 2/0 99.33 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 129.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 129.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T23:04:49.999 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T23:04:50.000 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T23:04:50.000 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative compaction: 0.00 GB write, 28.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T23:04:50.000 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval compaction: 0.00 GB write, 28.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T23:04:50.000 INFO:journalctl@ceph.mon.a.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T23:04:50.000 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache BinnedLRUCache@0x5607f64291f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-15T23:04:50.000 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-15T23:04:50.000 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-15T23:04:50.000 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T23:04:50.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: starting mon.a rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:04:50.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: mon.a@-1(???) e1 preinit fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:04:50.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: mon.a@-1(???).mds e1 new map 2024-09-15T23:04:50.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: mon.a@-1(???).mds e1 print_map 2024-09-15T23:04:50.000 INFO:journalctl@ceph.mon.a.smithi002.stdout: e1 2024-09-15T23:04:50.001 INFO:journalctl@ceph.mon.a.smithi002.stdout: btime 2024-09-15T23:04:45:101276+0000 2024-09-15T23:04:50.001 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T23:04:50.001 INFO:journalctl@ceph.mon.a.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T23:04:50.001 INFO:journalctl@ceph.mon.a.smithi002.stdout: legacy client fscid: -1 2024-09-15T23:04:50.001 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-09-15T23:04:50.001 INFO:journalctl@ceph.mon.a.smithi002.stdout: No filesystems configured 2024-09-15T23:04:50.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T23:04:50.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:04:50.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:04:50.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:04:50.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 ceph-mon[31019]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-15T23:04:50.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 bash[31001]: 0ce84f8b0ca9570d654bc99e38872ba993ecc29927864f3da17fcdc7bf11b068 2024-09-15T23:04:50.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:49 smithi002 systemd[1]: Started Ceph mon.a for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:04:50.002 INFO:teuthology.orchestra.run.smithi002.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-15T23:04:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.373+0000 7f4879a6b640 1 Processor -- start 2024-09-15T23:04:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.373+0000 7f4879a6b640 1 -- start start 2024-09-15T23:04:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.373+0000 7f4879a6b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 0x7f48741078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.373+0000 7f4879a6b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4874107e90 con 0x7f48741074c0 2024-09-15T23:04:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.374+0000 7f48737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 0x7f48741078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.374+0000 7f48737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 0x7f48741078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40976/0 (socket says 172.21.15.2:40976) 2024-09-15T23:04:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.374+0000 7f48737fe640 1 -- 172.21.15.2:0/1896439536 learned_addr learned my addr 172.21.15.2:0/1896439536 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:04:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.374+0000 7f48737fe640 1 -- 172.21.15.2:0/1896439536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48741086c0 con 0x7f48741074c0 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.376+0000 7f48737fe640 1 --2- 172.21.15.2:0/1896439536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 0x7f48741078c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4864009820 tx=0x7f486402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c29fada1f80b134 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.376+0000 7f48727fc640 1 -- 172.21.15.2:0/1896439536 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4864037070 con 0x7f48741074c0 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.376+0000 7f48727fc640 1 -- 172.21.15.2:0/1896439536 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f48640328d0 con 0x7f48741074c0 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.376+0000 7f48727fc640 1 -- 172.21.15.2:0/1896439536 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48640307d0 con 0x7f48741074c0 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.376+0000 7f4879a6b640 1 -- 172.21.15.2:0/1896439536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 msgr2=0x7f48741078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.376+0000 7f4879a6b640 1 --2- 172.21.15.2:0/1896439536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 0x7f48741078c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4864009820 tx=0x7f486402a270 comp rx=0 tx=0).stop 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.377+0000 7f4879a6b640 1 -- 172.21.15.2:0/1896439536 shutdown_connections 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.377+0000 7f4879a6b640 1 --2- 172.21.15.2:0/1896439536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 0x7f48741078c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.377+0000 7f4879a6b640 1 -- 172.21.15.2:0/1896439536 >> 172.21.15.2:0/1896439536 conn(0x7f4874102c70 msgr2=0x7f4874105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.377+0000 7f4879a6b640 1 -- 172.21.15.2:0/1896439536 shutdown_connections 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.377+0000 7f4879a6b640 1 -- 172.21.15.2:0/1896439536 wait complete. 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.377+0000 7f4879a6b640 1 Processor -- start 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.377+0000 7f4879a6b640 1 -- start start 2024-09-15T23:04:51.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.378+0000 7f4879a6b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 0x7f487407db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.378+0000 7f4879a6b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f487410ba70 con 0x7f48741074c0 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.378+0000 7f48737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 0x7f487407db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.378+0000 7f48737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 0x7f487407db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40978/0 (socket says 172.21.15.2:40978) 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.378+0000 7f48737fe640 1 -- 172.21.15.2:0/962935028 learned_addr learned my addr 172.21.15.2:0/962935028 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.378+0000 7f48737fe640 1 -- 172.21.15.2:0/962935028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487407e060 con 0x7f48741074c0 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.378+0000 7f48737fe640 1 --2- 172.21.15.2:0/962935028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 0x7f487407db20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4864009940 tx=0x7f4864032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.378+0000 7f4870ff9640 1 -- 172.21.15.2:0/962935028 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4864042070 con 0x7f48741074c0 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.378+0000 7f4870ff9640 1 -- 172.21.15.2:0/962935028 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4864030c80 con 0x7f48741074c0 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.378+0000 7f4879a6b640 1 -- 172.21.15.2:0/962935028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487407c250 con 0x7f48741074c0 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.378+0000 7f4870ff9640 1 -- 172.21.15.2:0/962935028 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4864037040 con 0x7f48741074c0 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.378+0000 7f4879a6b640 1 -- 172.21.15.2:0/962935028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487407c790 con 0x7f48741074c0 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.378+0000 7f4870ff9640 1 -- 172.21.15.2:0/962935028 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4864045070 con 0x7f48741074c0 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.379+0000 7f4870ff9640 1 -- 172.21.15.2:0/962935028 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4864047a40 con 0x7f48741074c0 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.379+0000 7f4879a6b640 1 -- 172.21.15.2:0/962935028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4874107940 con 0x7f48741074c0 2024-09-15T23:04:51.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.382+0000 7f4870ff9640 1 -- 172.21.15.2:0/962935028 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f486403c700 con 0x7f48741074c0 2024-09-15T23:04:51.019 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.442+0000 7f4879a6b640 1 -- 172.21.15.2:0/962935028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f487407ccc0 con 0x7f48741074c0 2024-09-15T23:04:51.019 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.444+0000 7f4870ff9640 1 -- 172.21.15.2:0/962935028 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f486403c8e0 con 0x7f48741074c0 2024-09-15T23:04:51.019 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.444+0000 7f4879a6b640 1 -- 172.21.15.2:0/962935028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 msgr2=0x7f487407db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:51.019 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.444+0000 7f4879a6b640 1 --2- 172.21.15.2:0/962935028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 0x7f487407db20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4864009940 tx=0x7f4864032e10 comp rx=0 tx=0).stop 2024-09-15T23:04:51.019 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.444+0000 7f4879a6b640 1 -- 172.21.15.2:0/962935028 shutdown_connections 2024-09-15T23:04:51.019 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.444+0000 7f4879a6b640 1 --2- 172.21.15.2:0/962935028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48741074c0 0x7f487407db20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:51.019 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.444+0000 7f4879a6b640 1 -- 172.21.15.2:0/962935028 >> 172.21.15.2:0/962935028 conn(0x7f4874102c70 msgr2=0x7f48741037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:51.019 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.445+0000 7f4879a6b640 1 -- 172.21.15.2:0/962935028 shutdown_connections 2024-09-15T23:04:51.019 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:50.445+0000 7f4879a6b640 1 -- 172.21.15.2:0/962935028 wait complete. 2024-09-15T23:04:51.019 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-15T23:04:51.034 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:04:51.035 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mgr... 2024-09-15T23:04:51.035 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-15T23:04:51.035 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-15T23:04:51.301 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.x 2024-09-15T23:04:51.301 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-15T23:04:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:50 smithi002 ceph-mon[31019]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T23:04:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:50 smithi002 ceph-mon[31019]: monmap epoch 1 2024-09-15T23:04:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:50 smithi002 ceph-mon[31019]: fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:04:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:50 smithi002 ceph-mon[31019]: last_changed 2024-09-15T23:04:42.039015+0000 2024-09-15T23:04:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:50 smithi002 ceph-mon[31019]: created 2024-09-15T23:04:42.039015+0000 2024-09-15T23:04:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:50 smithi002 ceph-mon[31019]: min_mon_release 19 (squid) 2024-09-15T23:04:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:50 smithi002 ceph-mon[31019]: election_strategy: 1 2024-09-15T23:04:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:50 smithi002 ceph-mon[31019]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-15T23:04:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:50 smithi002 ceph-mon[31019]: fsmap 2024-09-15T23:04:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:50 smithi002 ceph-mon[31019]: osdmap e1: 0 total, 0 up, 0 in 2024-09-15T23:04:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:50 smithi002 ceph-mon[31019]: mgrmap e1: no daemons active 2024-09-15T23:04:51.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:50 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/962935028' entity='client.admin' 2024-09-15T23:04:51.460 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968.target.wants/ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@.service. 2024-09-15T23:04:51.687 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:51 smithi002 systemd[1]: Starting Ceph mgr.x for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:04:51.981 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:51 smithi002 podman[31231]: 2024-09-15 23:04:51.686570796 +0000 UTC m=+0.104631152 container create 318dcf0efa63269f097bab95021d58816409df7b2ea40fd13e5c89aa0d7ab118 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e) 2024-09-15T23:04:51.981 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:51 smithi002 podman[31231]: 2024-09-15 23:04:51.59750749 +0000 UTC m=+0.015567819 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:04:51.981 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:51 smithi002 podman[31231]: 2024-09-15 23:04:51.897280668 +0000 UTC m=+0.315340983 container init 318dcf0efa63269f097bab95021d58816409df7b2ea40fd13e5c89aa0d7ab118 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-15T23:04:51.981 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:51 smithi002 podman[31231]: 2024-09-15 23:04:51.900016736 +0000 UTC m=+0.318077060 container start 318dcf0efa63269f097bab95021d58816409df7b2ea40fd13e5c89aa0d7ab118 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:04:51.981 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:51 smithi002 bash[31231]: 318dcf0efa63269f097bab95021d58816409df7b2ea40fd13e5c89aa0d7ab118 2024-09-15T23:04:51.997 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T23:04:51.997 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-15T23:04:52.005 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T23:04:52.005 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-15T23:04:52.005 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-15T23:04:52.005 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T23:04:52.016 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T23:04:52.016 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-15T23:04:52.027 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T23:04:52.027 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-15T23:04:52.027 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-15T23:04:52.027 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-15T23:04:52.027 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr to start... 2024-09-15T23:04:52.027 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr... 2024-09-15T23:04:52.261 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:51 smithi002 systemd[1]: Started Ceph mgr.x for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:04:52.261 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:52 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:52.036+0000 7f5523fd5040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:04:52.261 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:52 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:52.103+0000 7f5523fd5040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:04:52.261 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:52 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:52.259+0000 7f5523fd5040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:04:52.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:52 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:52.329+0000 7f5523fd5040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:04:52.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:52 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:52.491+0000 7f5523fd5040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:04:52.962 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:52 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1997745838' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T23:04:52.962 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:52 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:52.643+0000 7f5523fd5040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:04:53.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:52 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:52.985+0000 7f5523fd5040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:04:53.246 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:53 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:53.049+0000 7f5523fd5040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:04:53.247 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:53 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:53.245+0000 7f5523fd5040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:04:53.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-15T23:04:53.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:04:53.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "cb7ab3ae-73b6-11ef-bceb-c7b262605968", 2024-09-15T23:04:53.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T23:04:53.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T23:04:53.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T23:04:53.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T23:04:53.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:53.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T23:04:53.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T23:04:53.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-15T23:04:53.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:04:53.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T23:04:53.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T23:04:53.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:04:53.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-15T23:04:53.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T23:04:53.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:04:53.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T23:04:53.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T23:04:53.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:53.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T23:04:53.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:04:53.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T23:04:53.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T23:04:53.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T23:04:53.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T23:04:53.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T23:04:53.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T23:04:53.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:53.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T23:04:53.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T23:04:53.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T23:04:53.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T23:04:53.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T23:04:53.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T23:04:53.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T23:04:53.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T23:04:53.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T23:04:45:101276+0000", 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T23:04:53.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T23:04:45.101909+0000", 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.572+0000 7f3970122640 1 Processor -- start 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.572+0000 7f3970122640 1 -- start start 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.573+0000 7f3970122640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 0x7f396810a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.573+0000 7f3970122640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f396807be10 con 0x7f3968107f70 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.573+0000 7f396debe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 0x7f396810a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.573+0000 7f396debe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 0x7f396810a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41014/0 (socket says 172.21.15.2:41014) 2024-09-15T23:04:53.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.573+0000 7f396debe640 1 -- 172.21.15.2:0/595203690 learned_addr learned my addr 172.21.15.2:0/595203690 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:04:53.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.573+0000 7f396debe640 1 -- 172.21.15.2:0/595203690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396810a8a0 con 0x7f3968107f70 2024-09-15T23:04:53.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.574+0000 7f396debe640 1 --2- 172.21.15.2:0/595203690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 0x7f396810a360 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3964009820 tx=0x7f396402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c419c6c2e02c555c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:53.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.574+0000 7f396cebc640 1 -- 172.21.15.2:0/595203690 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3964037070 con 0x7f3968107f70 2024-09-15T23:04:53.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.574+0000 7f396cebc640 1 -- 172.21.15.2:0/595203690 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f39640328d0 con 0x7f3968107f70 2024-09-15T23:04:53.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.574+0000 7f396cebc640 1 -- 172.21.15.2:0/595203690 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39640307d0 con 0x7f3968107f70 2024-09-15T23:04:53.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.575+0000 7f3970122640 1 -- 172.21.15.2:0/595203690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 msgr2=0x7f396810a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:53.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.575+0000 7f3970122640 1 --2- 172.21.15.2:0/595203690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 0x7f396810a360 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3964009820 tx=0x7f396402a270 comp rx=0 tx=0).stop 2024-09-15T23:04:53.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.575+0000 7f3970122640 1 -- 172.21.15.2:0/595203690 shutdown_connections 2024-09-15T23:04:53.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.575+0000 7f3970122640 1 --2- 172.21.15.2:0/595203690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 0x7f396810a360 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.575+0000 7f3970122640 1 -- 172.21.15.2:0/595203690 >> 172.21.15.2:0/595203690 conn(0x7f3968101bb0 msgr2=0x7f3968103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:53.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.575+0000 7f3970122640 1 -- 172.21.15.2:0/595203690 shutdown_connections 2024-09-15T23:04:53.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.575+0000 7f3970122640 1 -- 172.21.15.2:0/595203690 wait complete. 2024-09-15T23:04:53.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.576+0000 7f3970122640 1 Processor -- start 2024-09-15T23:04:53.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.576+0000 7f3970122640 1 -- start start 2024-09-15T23:04:53.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.576+0000 7f3970122640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 0x7f396819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:53.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.576+0000 7f3970122640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f396810b880 con 0x7f3968107f70 2024-09-15T23:04:53.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.576+0000 7f396debe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 0x7f396819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:53.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.576+0000 7f396debe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 0x7f396819b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41016/0 (socket says 172.21.15.2:41016) 2024-09-15T23:04:53.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.576+0000 7f396debe640 1 -- 172.21.15.2:0/1997745838 learned_addr learned my addr 172.21.15.2:0/1997745838 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:04:53.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.576+0000 7f396debe640 1 -- 172.21.15.2:0/1997745838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396819b980 con 0x7f3968107f70 2024-09-15T23:04:53.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.577+0000 7f396debe640 1 --2- 172.21.15.2:0/1997745838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 0x7f396819b440 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3964032e10 tx=0x7f3964032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:53.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.577+0000 7f395affd640 1 -- 172.21.15.2:0/1997745838 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3964042070 con 0x7f3968107f70 2024-09-15T23:04:53.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.577+0000 7f395affd640 1 -- 172.21.15.2:0/1997745838 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3964030c80 con 0x7f3968107f70 2024-09-15T23:04:53.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.577+0000 7f3970122640 1 -- 172.21.15.2:0/1997745838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396819bc10 con 0x7f3968107f70 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.577+0000 7f395affd640 1 -- 172.21.15.2:0/1997745838 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3964037040 con 0x7f3968107f70 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.577+0000 7f3970122640 1 -- 172.21.15.2:0/1997745838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396819e900 con 0x7f3968107f70 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.577+0000 7f395affd640 1 -- 172.21.15.2:0/1997745838 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3964045070 con 0x7f3968107f70 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.577+0000 7f395affd640 1 -- 172.21.15.2:0/1997745838 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f39640479e0 con 0x7f3968107f70 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.578+0000 7f3970122640 1 -- 172.21.15.2:0/1997745838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39681083d0 con 0x7f3968107f70 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.582+0000 7f395affd640 1 -- 172.21.15.2:0/1997745838 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f396403c5f0 con 0x7f3968107f70 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.644+0000 7f3970122640 1 -- 172.21.15.2:0/1997745838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f396819ee80 con 0x7f3968107f70 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.644+0000 7f395affd640 1 -- 172.21.15.2:0/1997745838 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f396403c7d0 con 0x7f3968107f70 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.646+0000 7f3970122640 1 -- 172.21.15.2:0/1997745838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 msgr2=0x7f396819b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.646+0000 7f3970122640 1 --2- 172.21.15.2:0/1997745838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 0x7f396819b440 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3964032e10 tx=0x7f3964032e40 comp rx=0 tx=0).stop 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.646+0000 7f3970122640 1 -- 172.21.15.2:0/1997745838 shutdown_connections 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.646+0000 7f3970122640 1 --2- 172.21.15.2:0/1997745838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3968107f70 0x7f396819b440 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.646+0000 7f3970122640 1 -- 172.21.15.2:0/1997745838 >> 172.21.15.2:0/1997745838 conn(0x7f3968101bb0 msgr2=0x7f3968102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:53.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.646+0000 7f3970122640 1 -- 172.21.15.2:0/1997745838 shutdown_connections 2024-09-15T23:04:53.275 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:52.646+0000 7f3970122640 1 -- 172.21.15.2:0/1997745838 wait complete. 2024-09-15T23:04:53.275 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (1/15)... 2024-09-15T23:04:54.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:54 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:54.175+0000 7f5523fd5040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:04:54.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:54 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:54.246+0000 7f5523fd5040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:04:55.303 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:55 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:55.029+0000 7f5523fd5040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:04:55.303 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:55 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:55.150+0000 7f5523fd5040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:04:55.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:55 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:55.302+0000 7f5523fd5040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:04:55.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:55 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:55.366+0000 7f5523fd5040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:04:55.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:55 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:55.531+0000 7f5523fd5040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:04:55.920 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:55 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/897330654' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T23:04:55.921 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:55 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:55.604+0000 7f5523fd5040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:04:55.921 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:55 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:55.669+0000 7f5523fd5040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:04:55.921 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:55 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:55.850+0000 7f5523fd5040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:04:55.921 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:55 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:55.919+0000 7f5523fd5040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:04:56.204 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:55 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:55.990+0000 7f5523fd5040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:04:56.204 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:56 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:56.077+0000 7f5523fd5040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:04:56.204 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:56 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:56.140+0000 7f5523fd5040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:04:56.204 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:56 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:56.202+0000 7f5523fd5040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:04:56.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-15T23:04:56.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "cb7ab3ae-73b6-11ef-bceb-c7b262605968", 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:04:56.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-15T23:04:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T23:04:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:04:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T23:04:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T23:04:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T23:04:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:04:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T23:04:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T23:04:56.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T23:04:56.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T23:04:56.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T23:04:56.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T23:04:56.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:56.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T23:04:56.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T23:04:56.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T23:04:56.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T23:04:56.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T23:04:56.374 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T23:04:45:101276+0000", 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T23:04:56.375 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T23:04:45.101909+0000", 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:04:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.693+0000 7f3fe665e640 1 Processor -- start 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.693+0000 7f3fe665e640 1 -- start start 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.694+0000 7f3fe665e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe007bca0 0x7f3fe010a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.694+0000 7f3fe665e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe010a630 con 0x7f3fe007bca0 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.694+0000 7f3fdffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe007bca0 0x7f3fe010a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.694+0000 7f3fdffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe007bca0 0x7f3fe010a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41020/0 (socket says 172.21.15.2:41020) 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.694+0000 7f3fdffff640 1 -- 172.21.15.2:0/741364471 learned_addr learned my addr 172.21.15.2:0/741364471 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.694+0000 7f3fdffff640 1 -- 172.21.15.2:0/741364471 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe010a7b0 con 0x7f3fe007bca0 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.695+0000 7f3fdffff640 1 --2- 172.21.15.2:0/741364471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe007bca0 0x7f3fe010a060 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009820 tx=0x7f3fd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5dabb2cdf30719 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.695+0000 7f3fdeffd640 1 -- 172.21.15.2:0/741364471 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd0037070 con 0x7f3fe007bca0 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.695+0000 7f3fdeffd640 1 -- 172.21.15.2:0/741364471 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3fd00328d0 con 0x7f3fe007bca0 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.695+0000 7f3fdeffd640 1 -- 172.21.15.2:0/741364471 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd00307d0 con 0x7f3fe007bca0 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.696+0000 7f3fe665e640 1 -- 172.21.15.2:0/741364471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe007bca0 msgr2=0x7f3fe010a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.696+0000 7f3fe665e640 1 --2- 172.21.15.2:0/741364471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe007bca0 0x7f3fe010a060 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009820 tx=0x7f3fd002a270 comp rx=0 tx=0).stop 2024-09-15T23:04:56.377 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.696+0000 7f3fe665e640 1 -- 172.21.15.2:0/741364471 shutdown_connections 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.696+0000 7f3fe665e640 1 --2- 172.21.15.2:0/741364471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe007bca0 0x7f3fe010a060 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.696+0000 7f3fe665e640 1 -- 172.21.15.2:0/741364471 >> 172.21.15.2:0/741364471 conn(0x7f3fe0101bb0 msgr2=0x7f3fe0103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.696+0000 7f3fe665e640 1 -- 172.21.15.2:0/741364471 shutdown_connections 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.696+0000 7f3fe665e640 1 -- 172.21.15.2:0/741364471 wait complete. 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.697+0000 7f3fe665e640 1 Processor -- start 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.697+0000 7f3fe665e640 1 -- start start 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.697+0000 7f3fe665e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe019b3e0 0x7f3fe019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.697+0000 7f3fe665e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe010b850 con 0x7f3fe019b3e0 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.697+0000 7f3fdffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe019b3e0 0x7f3fe019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.697+0000 7f3fdffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe019b3e0 0x7f3fe019b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41034/0 (socket says 172.21.15.2:41034) 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.697+0000 7f3fdffff640 1 -- 172.21.15.2:0/897330654 learned_addr learned my addr 172.21.15.2:0/897330654 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.697+0000 7f3fdffff640 1 -- 172.21.15.2:0/897330654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe019bd40 con 0x7f3fe019b3e0 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.698+0000 7f3fdffff640 1 --2- 172.21.15.2:0/897330654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe019b3e0 0x7f3fe019b800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0032e10 tx=0x7f3fd0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.698+0000 7f3fdd7fa640 1 -- 172.21.15.2:0/897330654 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd0042070 con 0x7f3fe019b3e0 2024-09-15T23:04:56.378 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.698+0000 7f3fdd7fa640 1 -- 172.21.15.2:0/897330654 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3fd0030c80 con 0x7f3fe019b3e0 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.698+0000 7f3fe665e640 1 -- 172.21.15.2:0/897330654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe019bfd0 con 0x7f3fe019b3e0 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.698+0000 7f3fdd7fa640 1 -- 172.21.15.2:0/897330654 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd0037040 con 0x7f3fe019b3e0 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.698+0000 7f3fe665e640 1 -- 172.21.15.2:0/897330654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe019eab0 con 0x7f3fe019b3e0 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.698+0000 7f3fdd7fa640 1 -- 172.21.15.2:0/897330654 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3fd0045070 con 0x7f3fe019b3e0 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.698+0000 7f3fdd7fa640 1 -- 172.21.15.2:0/897330654 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3fd0047a40 con 0x7f3fe019b3e0 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.699+0000 7f3fe665e640 1 -- 172.21.15.2:0/897330654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe01080d0 con 0x7f3fe019b3e0 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.701+0000 7f3fdd7fa640 1 -- 172.21.15.2:0/897330654 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3fd003c700 con 0x7f3fe019b3e0 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.763+0000 7f3fe665e640 1 -- 172.21.15.2:0/897330654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f3fe007bd90 con 0x7f3fe019b3e0 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.764+0000 7f3fdd7fa640 1 -- 172.21.15.2:0/897330654 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f3fd003c8e0 con 0x7f3fe019b3e0 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.765+0000 7f3fe665e640 1 -- 172.21.15.2:0/897330654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe019b3e0 msgr2=0x7f3fe019b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.765+0000 7f3fe665e640 1 --2- 172.21.15.2:0/897330654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe019b3e0 0x7f3fe019b800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0032e10 tx=0x7f3fd0032e40 comp rx=0 tx=0).stop 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.765+0000 7f3fe665e640 1 -- 172.21.15.2:0/897330654 shutdown_connections 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.765+0000 7f3fe665e640 1 --2- 172.21.15.2:0/897330654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe019b3e0 0x7f3fe019b800 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:04:56.379 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.765+0000 7f3fe665e640 1 -- 172.21.15.2:0/897330654 >> 172.21.15.2:0/897330654 conn(0x7f3fe0101bb0 msgr2=0x7f3fe0102790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:04:56.380 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.765+0000 7f3fe665e640 1 -- 172.21.15.2:0/897330654 shutdown_connections 2024-09-15T23:04:56.380 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:55.765+0000 7f3fe665e640 1 -- 172.21.15.2:0/897330654 wait complete. 2024-09-15T23:04:56.380 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (2/15)... 2024-09-15T23:04:57.308 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:04:57.035+0000 7f5523fd5040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:04:57.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-mon[31019]: Activating manager daemon x 2024-09-15T23:04:57.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-mon[31019]: mgrmap e2: x(active, starting, since 0.00308423s) 2024-09-15T23:04:57.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-mon[31019]: from='mgr.14100 172.21.15.2:0/567865201' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T23:04:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-mon[31019]: from='mgr.14100 172.21.15.2:0/567865201' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T23:04:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-mon[31019]: from='mgr.14100 172.21.15.2:0/567865201' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T23:04:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-mon[31019]: from='mgr.14100 172.21.15.2:0/567865201' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:04:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-mon[31019]: from='mgr.14100 172.21.15.2:0/567865201' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T23:04:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-mon[31019]: Manager daemon x is now available 2024-09-15T23:04:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-mon[31019]: from='mgr.14100 172.21.15.2:0/567865201' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T23:04:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-mon[31019]: from='mgr.14100 172.21.15.2:0/567865201' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T23:04:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-mon[31019]: from='mgr.14100 172.21.15.2:0/567865201' entity='mgr.x' 2024-09-15T23:04:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-mon[31019]: from='mgr.14100 172.21.15.2:0/567865201' entity='mgr.x' 2024-09-15T23:04:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:57 smithi002 ceph-mon[31019]: from='mgr.14100 172.21.15.2:0/567865201' entity='mgr.x' 2024-09-15T23:04:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:59 smithi002 ceph-mon[31019]: mgrmap e3: x(active, since 1.0079s) 2024-09-15T23:04:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:04:59 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3859786921' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T23:05:00.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:00 smithi002 ceph-mon[31019]: mgrmap e4: x(active, since 2s) 2024-09-15T23:05:02.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-15T23:05:02.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:05:02.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "cb7ab3ae-73b6-11ef-bceb-c7b262605968", 2024-09-15T23:05:02.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T23:05:02.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T23:05:02.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T23:05:02.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T23:05:02.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:05:02.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T23:05:02.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T23:05:02.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-15T23:05:02.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:05:02.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T23:05:02.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T23:05:02.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:05:02.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-15T23:05:02.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T23:05:02.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:05:02.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T23:05:02.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T23:05:02.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:05:02.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T23:05:02.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:05:02.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T23:05:02.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T23:05:02.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T23:05:02.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T23:05:02.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T23:05:02.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T23:05:02.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:05:02.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T23:05:02.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T23:05:02.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T23:05:02.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T23:05:02.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T23:05:02.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T23:05:02.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T23:05:02.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T23:05:02.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T23:05:02.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:05:02.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T23:05:02.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:05:02.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T23:04:45:101276+0000", 2024-09-15T23:05:02.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T23:05:02.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T23:05:02.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:05:02.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T23:05:02.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T23:05:02.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T23:05:02.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T23:05:02.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T23:05:02.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T23:05:02.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T23:05:02.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:05:02.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T23:05:02.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:05:02.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T23:05:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:05:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T23:04:45.101909+0000", 2024-09-15T23:05:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T23:05:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:05:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T23:05:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:05:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.782+0000 7f5c10a68640 1 Processor -- start 2024-09-15T23:05:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.782+0000 7f5c10a68640 1 -- start start 2024-09-15T23:05:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.783+0000 7f5c10a68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 0x7f5c0c106800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.783+0000 7f5c10a68640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c106dd0 con 0x7f5c0c106400 2024-09-15T23:05:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.783+0000 7f5c0a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 0x7f5c0c106800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:02.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.783+0000 7f5c0a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 0x7f5c0c106800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47296/0 (socket says 172.21.15.2:47296) 2024-09-15T23:05:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.783+0000 7f5c0a59c640 1 -- 172.21.15.2:0/2311444799 learned_addr learned my addr 172.21.15.2:0/2311444799 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.783+0000 7f5c0a59c640 1 -- 172.21.15.2:0/2311444799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0c1075b0 con 0x7f5c0c106400 2024-09-15T23:05:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.784+0000 7f5c0a59c640 1 --2- 172.21.15.2:0/2311444799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 0x7f5c0c106800 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009820 tx=0x7f5bfc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6aa2c0521bab520 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.784+0000 7f5c0959a640 1 -- 172.21.15.2:0/2311444799 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bfc037070 con 0x7f5c0c106400 2024-09-15T23:05:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.784+0000 7f5c0959a640 1 -- 172.21.15.2:0/2311444799 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5bfc0328d0 con 0x7f5c0c106400 2024-09-15T23:05:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.784+0000 7f5c0959a640 1 -- 172.21.15.2:0/2311444799 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bfc0307d0 con 0x7f5c0c106400 2024-09-15T23:05:02.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.785+0000 7f5c10a68640 1 -- 172.21.15.2:0/2311444799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 msgr2=0x7f5c0c106800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.785+0000 7f5c10a68640 1 --2- 172.21.15.2:0/2311444799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 0x7f5c0c106800 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009820 tx=0x7f5bfc02a270 comp rx=0 tx=0).stop 2024-09-15T23:05:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.785+0000 7f5c10a68640 1 -- 172.21.15.2:0/2311444799 shutdown_connections 2024-09-15T23:05:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.785+0000 7f5c10a68640 1 --2- 172.21.15.2:0/2311444799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 0x7f5c0c106800 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.785+0000 7f5c10a68640 1 -- 172.21.15.2:0/2311444799 >> 172.21.15.2:0/2311444799 conn(0x7f5c0c101bb0 msgr2=0x7f5c0c103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.785+0000 7f5c10a68640 1 -- 172.21.15.2:0/2311444799 shutdown_connections 2024-09-15T23:05:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.785+0000 7f5c10a68640 1 -- 172.21.15.2:0/2311444799 wait complete. 2024-09-15T23:05:02.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.786+0000 7f5c10a68640 1 Processor -- start 2024-09-15T23:05:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.786+0000 7f5c10a68640 1 -- start start 2024-09-15T23:05:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.786+0000 7f5c10a68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 0x7f5c0c1915e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.786+0000 7f5c10a68640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c10a960 con 0x7f5c0c106400 2024-09-15T23:05:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.786+0000 7f5c0a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 0x7f5c0c1915e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.787+0000 7f5c0a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 0x7f5c0c1915e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47306/0 (socket says 172.21.15.2:47306) 2024-09-15T23:05:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.787+0000 7f5c0a59c640 1 -- 172.21.15.2:0/3859786921 learned_addr learned my addr 172.21.15.2:0/3859786921 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:02.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.787+0000 7f5c0a59c640 1 -- 172.21.15.2:0/3859786921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0c191b20 con 0x7f5c0c106400 2024-09-15T23:05:02.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.787+0000 7f5c0a59c640 1 --2- 172.21.15.2:0/3859786921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 0x7f5c0c1915e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc0097f0 tx=0x7f5bfc030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:02.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.787+0000 7f5bfb7fe640 1 -- 172.21.15.2:0/3859786921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bfc037040 con 0x7f5c0c106400 2024-09-15T23:05:02.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.787+0000 7f5bfb7fe640 1 -- 172.21.15.2:0/3859786921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5bfc032bb0 con 0x7f5c0c106400 2024-09-15T23:05:02.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.787+0000 7f5c10a68640 1 -- 172.21.15.2:0/3859786921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0c18fd10 con 0x7f5c0c106400 2024-09-15T23:05:02.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.787+0000 7f5bfb7fe640 1 -- 172.21.15.2:0/3859786921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bfc03a390 con 0x7f5c0c106400 2024-09-15T23:05:02.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.787+0000 7f5c10a68640 1 -- 172.21.15.2:0/3859786921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c0c190250 con 0x7f5c0c106400 2024-09-15T23:05:02.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.788+0000 7f5bfb7fe640 1 -- 172.21.15.2:0/3859786921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f5bfc03a580 con 0x7f5c0c106400 2024-09-15T23:05:02.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.788+0000 7f5c10a68640 1 -- 172.21.15.2:0/3859786921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c0c10aae0 con 0x7f5c0c106400 2024-09-15T23:05:02.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.789+0000 7f5bfb7fe640 1 --2- 172.21.15.2:0/3859786921 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f5bf40390a0 0x7f5bf403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:02.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.789+0000 7f5bfb7fe640 1 -- 172.21.15.2:0/3859786921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5bfc06c390 con 0x7f5c0c106400 2024-09-15T23:05:02.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.789+0000 7f5c09d9b640 1 --2- 172.21.15.2:0/3859786921 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f5bf40390a0 0x7f5bf403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:02.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.789+0000 7f5c09d9b640 1 --2- 172.21.15.2:0/3859786921 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f5bf40390a0 0x7f5bf403b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5c000098c0 tx=0x7f5c00006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:02.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:58.794+0000 7f5bfb7fe640 1 -- 172.21.15.2:0/3859786921 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5bfc042de0 con 0x7f5c0c106400 2024-09-15T23:05:02.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:59.037+0000 7f5c10a68640 1 -- 172.21.15.2:0/3859786921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5c0c0008d0 con 0x7f5c0c106400 2024-09-15T23:05:02.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:59.038+0000 7f5bfb7fe640 1 -- 172.21.15.2:0/3859786921 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f5bfc03a920 con 0x7f5c0c106400 2024-09-15T23:05:02.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:59.040+0000 7f5c10a68640 1 -- 172.21.15.2:0/3859786921 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f5bf40390a0 msgr2=0x7f5bf403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:02.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:59.040+0000 7f5c10a68640 1 --2- 172.21.15.2:0/3859786921 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f5bf40390a0 0x7f5bf403b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5c000098c0 tx=0x7f5c00006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:02.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:59.040+0000 7f5c10a68640 1 -- 172.21.15.2:0/3859786921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 msgr2=0x7f5c0c1915e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:02.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:59.040+0000 7f5c10a68640 1 --2- 172.21.15.2:0/3859786921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 0x7f5c0c1915e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc0097f0 tx=0x7f5bfc030d00 comp rx=0 tx=0).stop 2024-09-15T23:05:02.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:59.040+0000 7f5c10a68640 1 -- 172.21.15.2:0/3859786921 shutdown_connections 2024-09-15T23:05:02.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:59.040+0000 7f5c10a68640 1 --2- 172.21.15.2:0/3859786921 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f5bf40390a0 0x7f5bf403b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:02.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:59.040+0000 7f5c10a68640 1 --2- 172.21.15.2:0/3859786921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c0c106400 0x7f5c0c1915e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:02.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:59.040+0000 7f5c10a68640 1 -- 172.21.15.2:0/3859786921 >> 172.21.15.2:0/3859786921 conn(0x7f5c0c101bb0 msgr2=0x7f5c0c102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:02.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:59.040+0000 7f5c10a68640 1 -- 172.21.15.2:0/3859786921 shutdown_connections 2024-09-15T23:05:02.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:04:59.040+0000 7f5c10a68640 1 -- 172.21.15.2:0/3859786921 wait complete. 2024-09-15T23:05:02.209 INFO:teuthology.orchestra.run.smithi002.stdout:mgr is available 2024-09-15T23:05:05.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:05 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/508906334' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T23:05:11.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-15T23:05:11.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T23:05:11.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:05:11.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T23:05:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.343+0000 7f962a013640 1 Processor -- start 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.343+0000 7f962a013640 1 -- start start 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.343+0000 7f962a013640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 0x7f962410a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.343+0000 7f962a013640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f962407bdd0 con 0x7f9624107fb0 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.344+0000 7f96237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 0x7f962410a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.344+0000 7f96237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 0x7f962410a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47318/0 (socket says 172.21.15.2:47318) 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.344+0000 7f96237fe640 1 -- 172.21.15.2:0/2043692575 learned_addr learned my addr 172.21.15.2:0/2043692575 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.344+0000 7f96237fe640 1 -- 172.21.15.2:0/2043692575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962410a8e0 con 0x7f9624107fb0 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.345+0000 7f96237fe640 1 --2- 172.21.15.2:0/2043692575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 0x7f962410a3a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9618009820 tx=0x7f961802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9c0cdc9db247f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.345+0000 7f96227fc640 1 -- 172.21.15.2:0/2043692575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9618037070 con 0x7f9624107fb0 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.345+0000 7f96227fc640 1 -- 172.21.15.2:0/2043692575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f96180328d0 con 0x7f9624107fb0 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.345+0000 7f96227fc640 1 -- 172.21.15.2:0/2043692575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96180307d0 con 0x7f9624107fb0 2024-09-15T23:05:11.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.346+0000 7f962a013640 1 -- 172.21.15.2:0/2043692575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 msgr2=0x7f962410a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.346+0000 7f962a013640 1 --2- 172.21.15.2:0/2043692575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 0x7f962410a3a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9618009820 tx=0x7f961802a270 comp rx=0 tx=0).stop 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.346+0000 7f962a013640 1 -- 172.21.15.2:0/2043692575 shutdown_connections 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.346+0000 7f962a013640 1 --2- 172.21.15.2:0/2043692575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 0x7f962410a3a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.346+0000 7f962a013640 1 -- 172.21.15.2:0/2043692575 >> 172.21.15.2:0/2043692575 conn(0x7f9624101bb0 msgr2=0x7f9624103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.346+0000 7f962a013640 1 -- 172.21.15.2:0/2043692575 shutdown_connections 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.346+0000 7f962a013640 1 -- 172.21.15.2:0/2043692575 wait complete. 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.347+0000 7f962a013640 1 Processor -- start 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.347+0000 7f962a013640 1 -- start start 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.347+0000 7f962a013640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 0x7f962419b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.347+0000 7f962a013640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f962410b860 con 0x7f9624107fb0 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.347+0000 7f96237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 0x7f962419b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:11.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.347+0000 7f96237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 0x7f962419b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47320/0 (socket says 172.21.15.2:47320) 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.347+0000 7f96237fe640 1 -- 172.21.15.2:0/508906334 learned_addr learned my addr 172.21.15.2:0/508906334 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.348+0000 7f96237fe640 1 -- 172.21.15.2:0/508906334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962419b950 con 0x7f9624107fb0 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.348+0000 7f96237fe640 1 --2- 172.21.15.2:0/508906334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 0x7f962419b410 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9618032e10 tx=0x7f9618032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.348+0000 7f9620ff9640 1 -- 172.21.15.2:0/508906334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9618042070 con 0x7f9624107fb0 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.348+0000 7f9620ff9640 1 -- 172.21.15.2:0/508906334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9618030c80 con 0x7f9624107fb0 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.348+0000 7f962a013640 1 -- 172.21.15.2:0/508906334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f962419bbe0 con 0x7f9624107fb0 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.348+0000 7f9620ff9640 1 -- 172.21.15.2:0/508906334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9618037040 con 0x7f9624107fb0 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.348+0000 7f962a013640 1 -- 172.21.15.2:0/508906334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f962419e8d0 con 0x7f9624107fb0 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.349+0000 7f9620ff9640 1 -- 172.21.15.2:0/508906334 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f9618045070 con 0x7f9624107fb0 2024-09-15T23:05:11.690 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.349+0000 7f9620ff9640 1 --2- 172.21.15.2:0/508906334 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f960c0391b0 0x7f960c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.349+0000 7f9620ff9640 1 -- 172.21.15.2:0/508906334 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f961806c0c0 con 0x7f9624107fb0 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.349+0000 7f9622ffd640 1 --2- 172.21.15.2:0/508906334 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f960c0391b0 0x7f960c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.349+0000 7f962a013640 1 -- 172.21.15.2:0/508906334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9624108410 con 0x7f9624107fb0 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.350+0000 7f9622ffd640 1 --2- 172.21.15.2:0/508906334 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f960c0391b0 0x7f960c03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f96140098c0 tx=0x7f9614006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.354+0000 7f9620ff9640 1 -- 172.21.15.2:0/508906334 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9618045360 con 0x7f9624107fb0 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.534+0000 7f962a013640 1 -- 172.21.15.2:0/508906334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f962419ff00 con 0x7f9624107fb0 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.535+0000 7f9620ff9640 1 -- 172.21.15.2:0/508906334 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+427 (secure 0 0 0) 0x7f961803ab70 con 0x7f9624107fb0 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.537+0000 7f962a013640 1 -- 172.21.15.2:0/508906334 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f960c0391b0 msgr2=0x7f960c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.537+0000 7f962a013640 1 --2- 172.21.15.2:0/508906334 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f960c0391b0 0x7f960c03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f96140098c0 tx=0x7f9614006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.537+0000 7f962a013640 1 -- 172.21.15.2:0/508906334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 msgr2=0x7f962419b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.537+0000 7f962a013640 1 --2- 172.21.15.2:0/508906334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 0x7f962419b410 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9618032e10 tx=0x7f9618032e40 comp rx=0 tx=0).stop 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.537+0000 7f962a013640 1 -- 172.21.15.2:0/508906334 shutdown_connections 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.537+0000 7f962a013640 1 --2- 172.21.15.2:0/508906334 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f960c0391b0 0x7f960c03b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.537+0000 7f962a013640 1 --2- 172.21.15.2:0/508906334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9624107fb0 0x7f962419b410 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:11.692 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.537+0000 7f962a013640 1 -- 172.21.15.2:0/508906334 >> 172.21.15.2:0/508906334 conn(0x7f9624101bb0 msgr2=0x7f9624102790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:11.692 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.538+0000 7f962a013640 1 -- 172.21.15.2:0/508906334 shutdown_connections 2024-09-15T23:05:11.692 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:05.538+0000 7f962a013640 1 -- 172.21.15.2:0/508906334 wait complete. 2024-09-15T23:05:11.692 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling cephadm module... 2024-09-15T23:05:13.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:12 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3142078431' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-15T23:05:13.058 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:12 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: ignoring --setuser ceph since I am not root 2024-09-15T23:05:13.058 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:12 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: ignoring --setgroup ceph since I am not root 2024-09-15T23:05:13.058 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:12 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:12.857+0000 7fa31fc6d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:05:13.058 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:12 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:12.916+0000 7fa31fc6d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:05:13.339 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:13.073+0000 7fa31fc6d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:05:13.339 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:13.143+0000 7fa31fc6d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:05:13.339 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:13.296+0000 7fa31fc6d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:05:13.349 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.424+0000 7f17f3e5b640 1 Processor -- start 2024-09-15T23:05:13.349 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.424+0000 7f17f3e5b640 1 -- start start 2024-09-15T23:05:13.349 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.425+0000 7f17f3e5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 0x7f17ec1078d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:13.349 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.425+0000 7f17f3e5b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec107ea0 con 0x7f17ec1074d0 2024-09-15T23:05:13.350 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.425+0000 7f17f1bf7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 0x7f17ec1078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:13.350 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.425+0000 7f17f1bf7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 0x7f17ec1078d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35810/0 (socket says 172.21.15.2:35810) 2024-09-15T23:05:13.350 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.425+0000 7f17f1bf7640 1 -- 172.21.15.2:0/1915570079 learned_addr learned my addr 172.21.15.2:0/1915570079 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:13.350 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.425+0000 7f17f1bf7640 1 -- 172.21.15.2:0/1915570079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec1086d0 con 0x7f17ec1074d0 2024-09-15T23:05:13.350 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.426+0000 7f17f1bf7640 1 --2- 172.21.15.2:0/1915570079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 0x7f17ec1078d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009820 tx=0x7f17e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb4eaf25689d5ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:13.350 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.426+0000 7f17f0bf5640 1 -- 172.21.15.2:0/1915570079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e8037070 con 0x7f17ec1074d0 2024-09-15T23:05:13.350 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.426+0000 7f17f0bf5640 1 -- 172.21.15.2:0/1915570079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f17e80328d0 con 0x7f17ec1074d0 2024-09-15T23:05:13.350 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.426+0000 7f17f0bf5640 1 -- 172.21.15.2:0/1915570079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e80307d0 con 0x7f17ec1074d0 2024-09-15T23:05:13.350 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.427+0000 7f17f3e5b640 1 -- 172.21.15.2:0/1915570079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 msgr2=0x7f17ec1078d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:13.350 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.427+0000 7f17f3e5b640 1 --2- 172.21.15.2:0/1915570079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 0x7f17ec1078d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009820 tx=0x7f17e802a270 comp rx=0 tx=0).stop 2024-09-15T23:05:13.350 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.427+0000 7f17f3e5b640 1 -- 172.21.15.2:0/1915570079 shutdown_connections 2024-09-15T23:05:13.350 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.427+0000 7f17f3e5b640 1 --2- 172.21.15.2:0/1915570079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 0x7f17ec1078d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:13.350 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.427+0000 7f17f3e5b640 1 -- 172.21.15.2:0/1915570079 >> 172.21.15.2:0/1915570079 conn(0x7f17ec102c20 msgr2=0x7f17ec1050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.427+0000 7f17f3e5b640 1 -- 172.21.15.2:0/1915570079 shutdown_connections 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.427+0000 7f17f3e5b640 1 -- 172.21.15.2:0/1915570079 wait complete. 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.427+0000 7f17f3e5b640 1 Processor -- start 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.427+0000 7f17f3e5b640 1 -- start start 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.428+0000 7f17f3e5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 0x7f17ec19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.428+0000 7f17f3e5b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec10ba80 con 0x7f17ec1074d0 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.428+0000 7f17f1bf7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 0x7f17ec19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.428+0000 7f17f1bf7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 0x7f17ec19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35812/0 (socket says 172.21.15.2:35812) 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.428+0000 7f17f1bf7640 1 -- 172.21.15.2:0/3142078431 learned_addr learned my addr 172.21.15.2:0/3142078431 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.428+0000 7f17f1bf7640 1 -- 172.21.15.2:0/3142078431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec19db80 con 0x7f17ec1074d0 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.428+0000 7f17f1bf7640 1 --2- 172.21.15.2:0/3142078431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 0x7f17ec19d640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f17e80097f0 tx=0x7f17e8030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.428+0000 7f17e2ffd640 1 -- 172.21.15.2:0/3142078431 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e8037040 con 0x7f17ec1074d0 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.428+0000 7f17f3e5b640 1 -- 172.21.15.2:0/3142078431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ec19de10 con 0x7f17ec1074d0 2024-09-15T23:05:13.351 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.428+0000 7f17e2ffd640 1 -- 172.21.15.2:0/3142078431 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f17e8032bb0 con 0x7f17ec1074d0 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.428+0000 7f17e2ffd640 1 -- 172.21.15.2:0/3142078431 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e803a390 con 0x7f17ec1074d0 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.428+0000 7f17f3e5b640 1 -- 172.21.15.2:0/3142078431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ec1a0b00 con 0x7f17ec1074d0 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.429+0000 7f17e2ffd640 1 -- 172.21.15.2:0/3142078431 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f17e803b3f0 con 0x7f17ec1074d0 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.430+0000 7f17e2ffd640 1 --2- 172.21.15.2:0/3142078431 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f17d8039160 0x7f17d803b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.430+0000 7f17f3e5b640 1 -- 172.21.15.2:0/3142078431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17ec10bc00 con 0x7f17ec1074d0 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.430+0000 7f17e2ffd640 1 -- 172.21.15.2:0/3142078431 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f17e806c460 con 0x7f17ec1074d0 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.430+0000 7f17f13f6640 1 --2- 172.21.15.2:0/3142078431 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f17d8039160 0x7f17d803b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.430+0000 7f17f13f6640 1 --2- 172.21.15.2:0/3142078431 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f17d8039160 0x7f17d803b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0098c0 tx=0x7f17dc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.435+0000 7f17e2ffd640 1 -- 172.21.15.2:0/3142078431 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17e8032d60 con 0x7f17ec1074d0 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.663+0000 7f17f3e5b640 1 -- 172.21.15.2:0/3142078431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f17ec1a1160 con 0x7f17ec1074d0 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.714+0000 7f17e2ffd640 1 -- 172.21.15.2:0/3142078431 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f17e806be80 con 0x7f17ec1074d0 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.716+0000 7f17e2ffd640 1 -- 172.21.15.2:0/3142078431 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f17e803b6e0 con 0x7f17ec1074d0 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.717+0000 7f17f3e5b640 1 -- 172.21.15.2:0/3142078431 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f17d8039160 msgr2=0x7f17d803b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:13.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.717+0000 7f17f3e5b640 1 --2- 172.21.15.2:0/3142078431 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f17d8039160 0x7f17d803b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0098c0 tx=0x7f17dc006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:13.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.717+0000 7f17f3e5b640 1 -- 172.21.15.2:0/3142078431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 msgr2=0x7f17ec19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:13.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.717+0000 7f17f3e5b640 1 --2- 172.21.15.2:0/3142078431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 0x7f17ec19d640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f17e80097f0 tx=0x7f17e8030d00 comp rx=0 tx=0).stop 2024-09-15T23:05:13.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.717+0000 7f17f3e5b640 1 -- 172.21.15.2:0/3142078431 shutdown_connections 2024-09-15T23:05:13.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.717+0000 7f17f3e5b640 1 --2- 172.21.15.2:0/3142078431 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f17d8039160 0x7f17d803b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:13.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.717+0000 7f17f3e5b640 1 --2- 172.21.15.2:0/3142078431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ec1074d0 0x7f17ec19d640 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:13.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.717+0000 7f17f3e5b640 1 -- 172.21.15.2:0/3142078431 >> 172.21.15.2:0/3142078431 conn(0x7f17ec102c20 msgr2=0x7f17ec1036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:13.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.717+0000 7f17f3e5b640 1 -- 172.21.15.2:0/3142078431 shutdown_connections 2024-09-15T23:05:13.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:12.718+0000 7f17f3e5b640 1 -- 172.21.15.2:0/3142078431 wait complete. 2024-09-15T23:05:13.658 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:13.447+0000 7fa31fc6d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:05:13.944 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:13 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3142078431' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-15T23:05:13.944 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:13 smithi002 ceph-mon[31019]: mgrmap e5: x(active, since 15s) 2024-09-15T23:05:13.944 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:13.780+0000 7fa31fc6d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:05:13.944 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:13.844+0000 7fa31fc6d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:05:14.308 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:14 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:14.042+0000 7fa31fc6d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:05:14.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:05:14.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-15T23:05:14.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T23:05:14.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T23:05:14.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T23:05:14.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:05:14.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.737+0000 7f949924a640 1 Processor -- start 2024-09-15T23:05:14.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.737+0000 7f949924a640 1 -- start start 2024-09-15T23:05:14.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.737+0000 7f949924a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 0x7f949410a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:14.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.737+0000 7f949924a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f949407bd90 con 0x7f9494107ff0 2024-09-15T23:05:14.671 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.737+0000 7f9492d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 0x7f949410a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:14.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.737+0000 7f9492d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 0x7f949410a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35838/0 (socket says 172.21.15.2:35838) 2024-09-15T23:05:14.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.737+0000 7f9492d9d640 1 -- 172.21.15.2:0/686429310 learned_addr learned my addr 172.21.15.2:0/686429310 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:14.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.737+0000 7f9492d9d640 1 -- 172.21.15.2:0/686429310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949410a920 con 0x7f9494107ff0 2024-09-15T23:05:14.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.738+0000 7f9492d9d640 1 --2- 172.21.15.2:0/686429310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 0x7f949410a3e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9484009e80 tx=0x7f948402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507f2858566b1e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:14.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.738+0000 7f9491d9b640 1 -- 172.21.15.2:0/686429310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9484036070 con 0x7f9494107ff0 2024-09-15T23:05:14.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.738+0000 7f9491d9b640 1 -- 172.21.15.2:0/686429310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9484031890 con 0x7f9494107ff0 2024-09-15T23:05:14.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.738+0000 7f9491d9b640 1 -- 172.21.15.2:0/686429310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9484007980 con 0x7f9494107ff0 2024-09-15T23:05:14.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.739+0000 7f949924a640 1 -- 172.21.15.2:0/686429310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 msgr2=0x7f949410a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:14.672 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.739+0000 7f949924a640 1 --2- 172.21.15.2:0/686429310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 0x7f949410a3e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9484009e80 tx=0x7f948402a7a0 comp rx=0 tx=0).stop 2024-09-15T23:05:14.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.739+0000 7f949924a640 1 -- 172.21.15.2:0/686429310 shutdown_connections 2024-09-15T23:05:14.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.739+0000 7f949924a640 1 --2- 172.21.15.2:0/686429310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 0x7f949410a3e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:14.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.739+0000 7f949924a640 1 -- 172.21.15.2:0/686429310 >> 172.21.15.2:0/686429310 conn(0x7f9494101bb0 msgr2=0x7f9494103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:14.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.739+0000 7f949924a640 1 -- 172.21.15.2:0/686429310 shutdown_connections 2024-09-15T23:05:14.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.739+0000 7f949924a640 1 -- 172.21.15.2:0/686429310 wait complete. 2024-09-15T23:05:14.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.740+0000 7f949924a640 1 Processor -- start 2024-09-15T23:05:14.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.740+0000 7f949924a640 1 -- start start 2024-09-15T23:05:14.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.740+0000 7f949924a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 0x7f949419b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:14.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.740+0000 7f949924a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f949410b840 con 0x7f9494107ff0 2024-09-15T23:05:14.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.740+0000 7f9492d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 0x7f949419b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:14.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.740+0000 7f9492d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 0x7f949419b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35854/0 (socket says 172.21.15.2:35854) 2024-09-15T23:05:14.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.740+0000 7f9492d9d640 1 -- 172.21.15.2:0/2938165295 learned_addr learned my addr 172.21.15.2:0/2938165295 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:14.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.741+0000 7f9492d9d640 1 -- 172.21.15.2:0/2938165295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949419b990 con 0x7f9494107ff0 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.741+0000 7f9492d9d640 1 --2- 172.21.15.2:0/2938165295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 0x7f949419b450 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9484009680 tx=0x7f9484031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.741+0000 7f948bfff640 1 -- 172.21.15.2:0/2938165295 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9484041020 con 0x7f9494107ff0 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.741+0000 7f949924a640 1 -- 172.21.15.2:0/2938165295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f949419bc20 con 0x7f9494107ff0 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.741+0000 7f948bfff640 1 -- 172.21.15.2:0/2938165295 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f948403c900 con 0x7f9494107ff0 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.741+0000 7f948bfff640 1 -- 172.21.15.2:0/2938165295 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9484036040 con 0x7f9494107ff0 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.741+0000 7f949924a640 1 -- 172.21.15.2:0/2938165295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f949419e910 con 0x7f9494107ff0 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.742+0000 7f948bfff640 1 -- 172.21.15.2:0/2938165295 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f9484044020 con 0x7f9494107ff0 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.742+0000 7f948bfff640 1 --2- 172.21.15.2:0/2938165295 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f94780391b0 0x7f947803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.742+0000 7f949924a640 1 -- 172.21.15.2:0/2938165295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9494108450 con 0x7f9494107ff0 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.742+0000 7f948bfff640 1 -- 172.21.15.2:0/2938165295 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f948406e410 con 0x7f9494107ff0 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.742+0000 7f949259c640 1 -- 172.21.15.2:0/2938165295 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f94780391b0 msgr2=0x7f947803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2652608868 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.742+0000 7f949259c640 1 --2- 172.21.15.2:0/2938165295 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f94780391b0 0x7f947803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.747+0000 7f948bfff640 1 -- 172.21.15.2:0/2938165295 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f948404b020 con 0x7f9494107ff0 2024-09-15T23:05:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.943+0000 7f949259c640 1 -- 172.21.15.2:0/2938165295 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f94780391b0 msgr2=0x7f947803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2652608868 2024-09-15T23:05:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.943+0000 7f949259c640 1 --2- 172.21.15.2:0/2938165295 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f94780391b0 0x7f947803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:05:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.969+0000 7f949924a640 1 -- 172.21.15.2:0/2938165295 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f949419f020 con 0x7f9494107ff0 2024-09-15T23:05:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.970+0000 7f948bfff640 1 -- 172.21.15.2:0/2938165295 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f9484045c40 con 0x7f9494107ff0 2024-09-15T23:05:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.972+0000 7f949924a640 1 -- 172.21.15.2:0/2938165295 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f94780391b0 msgr2=0x7f947803b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:05:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.972+0000 7f949924a640 1 --2- 172.21.15.2:0/2938165295 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f94780391b0 0x7f947803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.972+0000 7f949924a640 1 -- 172.21.15.2:0/2938165295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 msgr2=0x7f949419b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.972+0000 7f949924a640 1 --2- 172.21.15.2:0/2938165295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 0x7f949419b450 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9484009680 tx=0x7f9484031c70 comp rx=0 tx=0).stop 2024-09-15T23:05:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.972+0000 7f949924a640 1 -- 172.21.15.2:0/2938165295 shutdown_connections 2024-09-15T23:05:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.972+0000 7f949924a640 1 --2- 172.21.15.2:0/2938165295 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7f94780391b0 0x7f947803b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.972+0000 7f949924a640 1 --2- 172.21.15.2:0/2938165295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9494107ff0 0x7f949419b450 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.972+0000 7f949924a640 1 -- 172.21.15.2:0/2938165295 >> 172.21.15.2:0/2938165295 conn(0x7f9494101bb0 msgr2=0x7f94941026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:14.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.972+0000 7f949924a640 1 -- 172.21.15.2:0/2938165295 shutdown_connections 2024-09-15T23:05:14.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:13.972+0000 7f949924a640 1 -- 172.21.15.2:0/2938165295 wait complete. 2024-09-15T23:05:14.676 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-15T23:05:14.676 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 5... 2024-09-15T23:05:14.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:14 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2938165295' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T23:05:15.231 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:14 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:14.971+0000 7fa31fc6d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:05:15.231 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:15 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:15.043+0000 7fa31fc6d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:05:16.058 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:15 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:15.793+0000 7fa31fc6d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:05:16.058 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:15 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:15.916+0000 7fa31fc6d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:05:16.356 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:16.064+0000 7fa31fc6d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:05:16.356 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:16.128+0000 7fa31fc6d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:05:16.356 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:16.284+0000 7fa31fc6d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:05:16.357 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:16.355+0000 7fa31fc6d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:05:16.651 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:16.417+0000 7fa31fc6d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:05:16.651 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:16.582+0000 7fa31fc6d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:05:16.651 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:16.650+0000 7fa31fc6d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:05:16.929 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:16.719+0000 7fa31fc6d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:05:16.929 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:16.805+0000 7fa31fc6d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:05:16.930 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:16.867+0000 7fa31fc6d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:05:16.930 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:16.928+0000 7fa31fc6d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:05:18.061 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:17.753+0000 7fa31fc6d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:05:18.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: Active manager daemon x restarted 2024-09-15T23:05:18.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: Activating manager daemon x 2024-09-15T23:05:18.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: osdmap e2: 0 total, 0 up, 0 in 2024-09-15T23:05:18.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: mgrmap e6: x(active, starting, since 0.00326652s) 2024-09-15T23:05:18.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:05:18.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T23:05:18.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T23:05:18.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T23:05:18.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T23:05:18.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: Manager daemon x is now available 2024-09-15T23:05:18.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' 2024-09-15T23:05:18.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' 2024-09-15T23:05:18.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:05:18.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:05:18.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T23:05:18.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:17 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T23:05:19.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:05:19.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-15T23:05:19.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T23:05:19.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:05:19.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.077+0000 7fabd1d3d640 1 Processor -- start 2024-09-15T23:05:19.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.077+0000 7fabd1d3d640 1 -- start start 2024-09-15T23:05:19.303 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.077+0000 7fabd1d3d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 0x7fabcc10a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:19.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.077+0000 7fabd1d3d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc07be10 con 0x7fabcc107f70 2024-09-15T23:05:19.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.078+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 0x7fabcc10a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:19.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.078+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 0x7fabcc10a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35864/0 (socket says 172.21.15.2:35864) 2024-09-15T23:05:19.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.078+0000 7fabcb7fe640 1 -- 172.21.15.2:0/2234631678 learned_addr learned my addr 172.21.15.2:0/2234631678 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:19.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.078+0000 7fabcb7fe640 1 -- 172.21.15.2:0/2234631678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabcc10a8a0 con 0x7fabcc107f70 2024-09-15T23:05:19.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.079+0000 7fabcb7fe640 1 --2- 172.21.15.2:0/2234631678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 0x7fabcc10a360 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009820 tx=0x7fabb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4415ecc7e681d49a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:19.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.079+0000 7fabca7fc640 1 -- 172.21.15.2:0/2234631678 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabb4037070 con 0x7fabcc107f70 2024-09-15T23:05:19.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.079+0000 7fabca7fc640 1 -- 172.21.15.2:0/2234631678 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fabb40328d0 con 0x7fabcc107f70 2024-09-15T23:05:19.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.079+0000 7fabca7fc640 1 -- 172.21.15.2:0/2234631678 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabb40307d0 con 0x7fabcc107f70 2024-09-15T23:05:19.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.079+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2234631678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 msgr2=0x7fabcc10a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:19.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.079+0000 7fabd1d3d640 1 --2- 172.21.15.2:0/2234631678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 0x7fabcc10a360 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009820 tx=0x7fabb402a270 comp rx=0 tx=0).stop 2024-09-15T23:05:19.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.080+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2234631678 shutdown_connections 2024-09-15T23:05:19.304 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.080+0000 7fabd1d3d640 1 --2- 172.21.15.2:0/2234631678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 0x7fabcc10a360 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.080+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2234631678 >> 172.21.15.2:0/2234631678 conn(0x7fabcc101bb0 msgr2=0x7fabcc103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.080+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2234631678 shutdown_connections 2024-09-15T23:05:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.080+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2234631678 wait complete. 2024-09-15T23:05:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.080+0000 7fabd1d3d640 1 Processor -- start 2024-09-15T23:05:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.080+0000 7fabd1d3d640 1 -- start start 2024-09-15T23:05:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.081+0000 7fabd1d3d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 0x7fabcc1077f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.081+0000 7fabd1d3d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc10b880 con 0x7fabcc107f70 2024-09-15T23:05:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.081+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 0x7fabcc1077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.081+0000 7fabcb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 0x7fabcc1077f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35866/0 (socket says 172.21.15.2:35866) 2024-09-15T23:05:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.081+0000 7fabcb7fe640 1 -- 172.21.15.2:0/2045977656 learned_addr learned my addr 172.21.15.2:0/2045977656 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.081+0000 7fabcb7fe640 1 -- 172.21.15.2:0/2045977656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabcc107d30 con 0x7fabcc107f70 2024-09-15T23:05:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.081+0000 7fabcb7fe640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 0x7fabcc1077f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fabb4032e10 tx=0x7fabb4032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:19.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.081+0000 7fabc8ff9640 1 -- 172.21.15.2:0/2045977656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabb4042070 con 0x7fabcc107f70 2024-09-15T23:05:19.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.081+0000 7fabc8ff9640 1 -- 172.21.15.2:0/2045977656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fabb4030c80 con 0x7fabcc107f70 2024-09-15T23:05:19.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.081+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2045977656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabcc105f20 con 0x7fabcc107f70 2024-09-15T23:05:19.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.081+0000 7fabc8ff9640 1 -- 172.21.15.2:0/2045977656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabb4037040 con 0x7fabcc107f70 2024-09-15T23:05:19.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.081+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2045977656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabcc106460 con 0x7fabcc107f70 2024-09-15T23:05:19.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.083+0000 7fabc8ff9640 1 -- 172.21.15.2:0/2045977656 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fabb4045070 con 0x7fabcc107f70 2024-09-15T23:05:19.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.083+0000 7fabc8ff9640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7fabb8039200 0x7fabb803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:19.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.083+0000 7fabc8ff9640 1 -- 172.21.15.2:0/2045977656 --> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fabb803bdd0 con 0x7fabb8039200 2024-09-15T23:05:19.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.083+0000 7fabc8ff9640 1 -- 172.21.15.2:0/2045977656 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fabb406c230 con 0x7fabcc107f70 2024-09-15T23:05:19.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.083+0000 7fabcaffd640 1 -- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7fabb8039200 msgr2=0x7fabb803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2652608868 2024-09-15T23:05:19.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.083+0000 7fabcaffd640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7fabb8039200 0x7fabb803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:05:19.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.284+0000 7fabcaffd640 1 -- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7fabb8039200 msgr2=0x7fabb803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2652608868 2024-09-15T23:05:19.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.284+0000 7fabcaffd640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7fabb8039200 0x7fabb803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:05:19.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.685+0000 7fabcaffd640 1 -- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7fabb8039200 msgr2=0x7fabb803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2652608868 2024-09-15T23:05:19.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:15.685+0000 7fabcaffd640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7fabb8039200 0x7fabb803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T23:05:19.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:16.486+0000 7fabcaffd640 1 -- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7fabb8039200 msgr2=0x7fabb803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2652608868 2024-09-15T23:05:19.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:16.486+0000 7fabcaffd640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7fabb8039200 0x7fabb803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T23:05:19.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:17.757+0000 7fabc8ff9640 1 -- 172.21.15.2:0/2045977656 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fabb406adb0 con 0x7fabcc107f70 2024-09-15T23:05:19.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:17.757+0000 7fabc8ff9640 1 -- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7fabb8039200 msgr2=0x7fabb803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:05:19.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:17.757+0000 7fabc8ff9640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7fabb8039200 0x7fabb803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:19.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.758+0000 7fabc8ff9640 1 -- 172.21.15.2:0/2045977656 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fabb403b330 con 0x7fabcc107f70 2024-09-15T23:05:19.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.758+0000 7fabc8ff9640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fabb803cb30 0x7fabb803ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:19.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.758+0000 7fabc8ff9640 1 -- 172.21.15.2:0/2045977656 --> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fabb4049ca0 con 0x7fabb803cb30 2024-09-15T23:05:19.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.758+0000 7fabcaffd640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fabb803cb30 0x7fabb803ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:19.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.759+0000 7fabcaffd640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fabb803cb30 0x7fabb803ef20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fabbc003980 tx=0x7fabbc0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:19.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.760+0000 7fabc8ff9640 1 -- 172.21.15.2:0/2045977656 <== mgr.14118 v2:172.21.15.2:6800/938645794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fabb4049ca0 con 0x7fabb803cb30 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.767+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2045977656 --> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fabcc1083d0 con 0x7fabb803cb30 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.767+0000 7fabc8ff9640 1 -- 172.21.15.2:0/2045977656 <== mgr.14118 v2:172.21.15.2:6800/938645794 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fabcc1083d0 con 0x7fabb803cb30 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.767+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fabb803cb30 msgr2=0x7fabb803ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.767+0000 7fabd1d3d640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fabb803cb30 0x7fabb803ef20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fabbc003980 tx=0x7fabbc0092b0 comp rx=0 tx=0).stop 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.767+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 msgr2=0x7fabcc1077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.767+0000 7fabd1d3d640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 0x7fabcc1077f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fabb4032e10 tx=0x7fabb4032e40 comp rx=0 tx=0).stop 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.768+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2045977656 shutdown_connections 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.768+0000 7fabd1d3d640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fabb803cb30 0x7fabb803ef20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.768+0000 7fabd1d3d640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:6800/2652608868,v1:172.21.15.2:6801/2652608868] conn(0x7fabb8039200 0x7fabb803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.768+0000 7fabd1d3d640 1 --2- 172.21.15.2:0/2045977656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabcc107f70 0x7fabcc1077f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.768+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2045977656 >> 172.21.15.2:0/2045977656 conn(0x7fabcc101bb0 msgr2=0x7fabcc102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.768+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2045977656 shutdown_connections 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:18.768+0000 7fabd1d3d640 1 -- 172.21.15.2:0/2045977656 wait complete. 2024-09-15T23:05:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 5 is available 2024-09-15T23:05:19.309 INFO:teuthology.orchestra.run.smithi002.stdout:Setting orchestrator backend to cephadm... 2024-09-15T23:05:20.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:19 smithi002 ceph-mon[31019]: Found migration_current of "None". Setting to last migration. 2024-09-15T23:05:20.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:19 smithi002 ceph-mon[31019]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T23:05:20.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:19 smithi002 ceph-mon[31019]: mgrmap e7: x(active, since 1.00566s) 2024-09-15T23:05:20.522 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.698+0000 7f459f785640 1 Processor -- start 2024-09-15T23:05:20.522 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.698+0000 7f459f785640 1 -- start start 2024-09-15T23:05:20.522 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.698+0000 7f459f785640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 0x7f459810a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:20.522 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.698+0000 7f459f785640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f459807be10 con 0x7f4598107f70 2024-09-15T23:05:20.522 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.698+0000 7f459d521640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 0x7f459810a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:20.522 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.698+0000 7f459d521640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 0x7f459810a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49952/0 (socket says 172.21.15.2:49952) 2024-09-15T23:05:20.523 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.698+0000 7f459d521640 1 -- 172.21.15.2:0/3402888420 learned_addr learned my addr 172.21.15.2:0/3402888420 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:20.523 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.698+0000 7f459d521640 1 -- 172.21.15.2:0/3402888420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459810a8a0 con 0x7f4598107f70 2024-09-15T23:05:20.523 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.699+0000 7f459d521640 1 --2- 172.21.15.2:0/3402888420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 0x7f459810a360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4594009820 tx=0x7f459402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdb95a7550fb0d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:20.523 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.700+0000 7f458ffff640 1 -- 172.21.15.2:0/3402888420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4594037070 con 0x7f4598107f70 2024-09-15T23:05:20.523 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.700+0000 7f458ffff640 1 -- 172.21.15.2:0/3402888420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f45940328d0 con 0x7f4598107f70 2024-09-15T23:05:20.523 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.700+0000 7f458ffff640 1 -- 172.21.15.2:0/3402888420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45940307d0 con 0x7f4598107f70 2024-09-15T23:05:20.523 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.700+0000 7f459f785640 1 -- 172.21.15.2:0/3402888420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 msgr2=0x7f459810a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:20.523 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.700+0000 7f459f785640 1 --2- 172.21.15.2:0/3402888420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 0x7f459810a360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4594009820 tx=0x7f459402a270 comp rx=0 tx=0).stop 2024-09-15T23:05:20.523 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.700+0000 7f459f785640 1 -- 172.21.15.2:0/3402888420 shutdown_connections 2024-09-15T23:05:20.523 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.700+0000 7f459f785640 1 --2- 172.21.15.2:0/3402888420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 0x7f459810a360 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:20.523 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.700+0000 7f459f785640 1 -- 172.21.15.2:0/3402888420 >> 172.21.15.2:0/3402888420 conn(0x7f4598101bb0 msgr2=0x7f4598103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:20.523 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.700+0000 7f459f785640 1 -- 172.21.15.2:0/3402888420 shutdown_connections 2024-09-15T23:05:20.523 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.700+0000 7f459f785640 1 -- 172.21.15.2:0/3402888420 wait complete. 2024-09-15T23:05:20.524 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.701+0000 7f459f785640 1 Processor -- start 2024-09-15T23:05:20.524 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.701+0000 7f459f785640 1 -- start start 2024-09-15T23:05:20.524 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.701+0000 7f459f785640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 0x7f459819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:20.524 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.701+0000 7f459f785640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f459810b880 con 0x7f4598107f70 2024-09-15T23:05:20.524 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.701+0000 7f459d521640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 0x7f459819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:20.524 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.701+0000 7f459d521640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 0x7f459819b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49962/0 (socket says 172.21.15.2:49962) 2024-09-15T23:05:20.524 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.701+0000 7f459d521640 1 -- 172.21.15.2:0/1500254186 learned_addr learned my addr 172.21.15.2:0/1500254186 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:20.524 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.701+0000 7f459d521640 1 -- 172.21.15.2:0/1500254186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459819b980 con 0x7f4598107f70 2024-09-15T23:05:20.524 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.702+0000 7f459d521640 1 --2- 172.21.15.2:0/1500254186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 0x7f459819b440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f45940097f0 tx=0x7f4594030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:20.524 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.702+0000 7f458e7fc640 1 -- 172.21.15.2:0/1500254186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4594037040 con 0x7f4598107f70 2024-09-15T23:05:20.524 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.702+0000 7f458e7fc640 1 -- 172.21.15.2:0/1500254186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4594032bb0 con 0x7f4598107f70 2024-09-15T23:05:20.524 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.702+0000 7f459f785640 1 -- 172.21.15.2:0/1500254186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459819bc10 con 0x7f4598107f70 2024-09-15T23:05:20.525 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.702+0000 7f459f785640 1 -- 172.21.15.2:0/1500254186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f459819e900 con 0x7f4598107f70 2024-09-15T23:05:20.525 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.702+0000 7f458e7fc640 1 -- 172.21.15.2:0/1500254186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459403a390 con 0x7f4598107f70 2024-09-15T23:05:20.525 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.703+0000 7f458e7fc640 1 -- 172.21.15.2:0/1500254186 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f459403a620 con 0x7f4598107f70 2024-09-15T23:05:20.525 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.703+0000 7f459f785640 1 -- 172.21.15.2:0/1500254186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f457c0052c0 con 0x7f4598107f70 2024-09-15T23:05:20.525 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.703+0000 7f458e7fc640 1 --2- 172.21.15.2:0/1500254186 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f45840390f0 0x7f458403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:20.525 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.703+0000 7f458e7fc640 1 -- 172.21.15.2:0/1500254186 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f459406c370 con 0x7f4598107f70 2024-09-15T23:05:20.525 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.703+0000 7f459cd20640 1 --2- 172.21.15.2:0/1500254186 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f45840390f0 0x7f458403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:20.525 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.704+0000 7f459cd20640 1 --2- 172.21.15.2:0/1500254186 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f45840390f0 0x7f458403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f45880098c0 tx=0x7f4588006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:20.525 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.708+0000 7f458e7fc640 1 -- 172.21.15.2:0/1500254186 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4594032d60 con 0x7f4598107f70 2024-09-15T23:05:20.525 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.762+0000 7f458e7fc640 1 -- 172.21.15.2:0/1500254186 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4594044780 con 0x7f4598107f70 2024-09-15T23:05:20.525 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.901+0000 7f459f785640 1 -- 172.21.15.2:0/1500254186 --> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f457c000bf0 con 0x7f45840390f0 2024-09-15T23:05:20.525 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.905+0000 7f458e7fc640 1 -- 172.21.15.2:0/1500254186 <== mgr.14118 v2:172.21.15.2:6800/938645794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f457c000bf0 con 0x7f45840390f0 2024-09-15T23:05:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.907+0000 7f459f785640 1 -- 172.21.15.2:0/1500254186 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f45840390f0 msgr2=0x7f458403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.907+0000 7f459f785640 1 --2- 172.21.15.2:0/1500254186 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f45840390f0 0x7f458403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f45880098c0 tx=0x7f4588006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.908+0000 7f459f785640 1 -- 172.21.15.2:0/1500254186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 msgr2=0x7f459819b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.908+0000 7f459f785640 1 --2- 172.21.15.2:0/1500254186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 0x7f459819b440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f45940097f0 tx=0x7f4594030d00 comp rx=0 tx=0).stop 2024-09-15T23:05:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.908+0000 7f459f785640 1 -- 172.21.15.2:0/1500254186 shutdown_connections 2024-09-15T23:05:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.908+0000 7f459f785640 1 --2- 172.21.15.2:0/1500254186 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f45840390f0 0x7f458403b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.908+0000 7f459f785640 1 --2- 172.21.15.2:0/1500254186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4598107f70 0x7f459819b440 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.908+0000 7f459f785640 1 -- 172.21.15.2:0/1500254186 >> 172.21.15.2:0/1500254186 conn(0x7f4598101bb0 msgr2=0x7f4598102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.908+0000 7f459f785640 1 -- 172.21.15.2:0/1500254186 shutdown_connections 2024-09-15T23:05:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:19.908+0000 7f459f785640 1 -- 172.21.15.2:0/1500254186 wait complete. 2024-09-15T23:05:20.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:20 smithi002 ceph-mon[31019]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T23:05:20.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:20 smithi002 ceph-mon[31019]: mgrmap e8: x(active, since 2s) 2024-09-15T23:05:20.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:20 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' 2024-09-15T23:05:20.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:20 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' 2024-09-15T23:05:20.811 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:20 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' 2024-09-15T23:05:20.811 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:20 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:05:21.763 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:21.549+0000 7fa286f87640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:23:05:21] ENGINE Error in HTTPServer.serve 2024-09-15T23:05:21.763 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: Traceback (most recent call last): 2024-09-15T23:05:21.763 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T23:05:21.763 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: self._connections.run(self.expiration_interval) 2024-09-15T23:05:21.764 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T23:05:21.764 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: self._run(expiration_interval) 2024-09-15T23:05:21.764 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T23:05:21.764 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T23:05:21.764 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T23:05:21.764 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T23:05:21.764 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T23:05:21.765 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: s = self.context.wrap_socket( 2024-09-15T23:05:21.765 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T23:05:21.765 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: return self.sslsocket_class._create( 2024-09-15T23:05:21.765 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T23:05:21.765 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: self.do_handshake() 2024-09-15T23:05:21.765 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T23:05:21.765 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: self._sslobj.do_handshake() 2024-09-15T23:05:21.765 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T23:05:21.765 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:21.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-15T23:05:21.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.928+0000 7f73d53a1640 1 Processor -- start 2024-09-15T23:05:21.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.928+0000 7f73d53a1640 1 -- start start 2024-09-15T23:05:21.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.928+0000 7f73d53a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 0x7f73d010a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:21.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.928+0000 7f73d53a1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73d007be60 con 0x7f73d0107f30 2024-09-15T23:05:21.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.928+0000 7f73ceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 0x7f73d010a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:21.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.928+0000 7f73ceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 0x7f73d010a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49970/0 (socket says 172.21.15.2:49970) 2024-09-15T23:05:21.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.928+0000 7f73ceffd640 1 -- 172.21.15.2:0/3374599213 learned_addr learned my addr 172.21.15.2:0/3374599213 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:21.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.929+0000 7f73ceffd640 1 -- 172.21.15.2:0/3374599213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d010a860 con 0x7f73d0107f30 2024-09-15T23:05:21.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.929+0000 7f73ceffd640 1 --2- 172.21.15.2:0/3374599213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 0x7f73d010a320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009820 tx=0x7f73c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d5ff701394da98 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.930+0000 7f73cdffb640 1 -- 172.21.15.2:0/3374599213 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c0037070 con 0x7f73d0107f30 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.930+0000 7f73cdffb640 1 -- 172.21.15.2:0/3374599213 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f73c00328d0 con 0x7f73d0107f30 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.930+0000 7f73cdffb640 1 -- 172.21.15.2:0/3374599213 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c00307d0 con 0x7f73d0107f30 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.930+0000 7f73d53a1640 1 -- 172.21.15.2:0/3374599213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 msgr2=0x7f73d010a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.930+0000 7f73d53a1640 1 --2- 172.21.15.2:0/3374599213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 0x7f73d010a320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009820 tx=0x7f73c002a270 comp rx=0 tx=0).stop 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.930+0000 7f73d53a1640 1 -- 172.21.15.2:0/3374599213 shutdown_connections 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.930+0000 7f73d53a1640 1 --2- 172.21.15.2:0/3374599213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 0x7f73d010a320 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.930+0000 7f73d53a1640 1 -- 172.21.15.2:0/3374599213 >> 172.21.15.2:0/3374599213 conn(0x7f73d0101bd0 msgr2=0x7f73d0103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.930+0000 7f73d53a1640 1 -- 172.21.15.2:0/3374599213 shutdown_connections 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.930+0000 7f73d53a1640 1 -- 172.21.15.2:0/3374599213 wait complete. 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.931+0000 7f73d53a1640 1 Processor -- start 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.931+0000 7f73d53a1640 1 -- start start 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.931+0000 7f73d53a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 0x7f73d019b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:21.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.931+0000 7f73d53a1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73d010b8a0 con 0x7f73d0107f30 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.931+0000 7f73ceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 0x7f73d019b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.931+0000 7f73ceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 0x7f73d019b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49984/0 (socket says 172.21.15.2:49984) 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.931+0000 7f73ceffd640 1 -- 172.21.15.2:0/1529347822 learned_addr learned my addr 172.21.15.2:0/1529347822 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.932+0000 7f73ceffd640 1 -- 172.21.15.2:0/1529347822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d019b960 con 0x7f73d0107f30 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.932+0000 7f73ceffd640 1 --2- 172.21.15.2:0/1529347822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 0x7f73d019b420 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f73c00097f0 tx=0x7f73c0030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.932+0000 7f73b7fff640 1 -- 172.21.15.2:0/1529347822 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c0037040 con 0x7f73d0107f30 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.932+0000 7f73d53a1640 1 -- 172.21.15.2:0/1529347822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d019bbf0 con 0x7f73d0107f30 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.932+0000 7f73b7fff640 1 -- 172.21.15.2:0/1529347822 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f73c0032bb0 con 0x7f73d0107f30 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.932+0000 7f73b7fff640 1 -- 172.21.15.2:0/1529347822 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c003a390 con 0x7f73d0107f30 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.932+0000 7f73d53a1640 1 -- 172.21.15.2:0/1529347822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d019e8e0 con 0x7f73d0107f30 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.933+0000 7f73b7fff640 1 -- 172.21.15.2:0/1529347822 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f73c003a5d0 con 0x7f73d0107f30 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.933+0000 7f73d53a1640 1 -- 172.21.15.2:0/1529347822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d0108390 con 0x7f73d0107f30 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.933+0000 7f73b7fff640 1 --2- 172.21.15.2:0/1529347822 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f73b80391b0 0x7f73b803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:21.773 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.934+0000 7f73b7fff640 1 -- 172.21.15.2:0/1529347822 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f73c006c6e0 con 0x7f73d0107f30 2024-09-15T23:05:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.934+0000 7f73ce7fc640 1 --2- 172.21.15.2:0/1529347822 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f73b80391b0 0x7f73b803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.934+0000 7f73ce7fc640 1 --2- 172.21.15.2:0/1529347822 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f73b80391b0 0x7f73b803b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f73c40098c0 tx=0x7f73c4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:20.942+0000 7f73b7fff640 1 -- 172.21.15.2:0/1529347822 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73c0032dd0 con 0x7f73d0107f30 2024-09-15T23:05:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:21.121+0000 7f73d53a1640 1 -- 172.21.15.2:0/1529347822 --> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f73d0102ec0 con 0x7f73b80391b0 2024-09-15T23:05:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:21.121+0000 7f73b7fff640 1 -- 172.21.15.2:0/1529347822 <== mgr.14118 v2:172.21.15.2:6800/938645794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f73d0102ec0 con 0x7f73b80391b0 2024-09-15T23:05:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:21.124+0000 7f73d53a1640 1 -- 172.21.15.2:0/1529347822 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f73b80391b0 msgr2=0x7f73b803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:21.124+0000 7f73d53a1640 1 --2- 172.21.15.2:0/1529347822 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f73b80391b0 0x7f73b803b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f73c40098c0 tx=0x7f73c4006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:21.124+0000 7f73d53a1640 1 -- 172.21.15.2:0/1529347822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 msgr2=0x7f73d019b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:21.124+0000 7f73d53a1640 1 --2- 172.21.15.2:0/1529347822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 0x7f73d019b420 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f73c00097f0 tx=0x7f73c0030d00 comp rx=0 tx=0).stop 2024-09-15T23:05:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:21.124+0000 7f73d53a1640 1 -- 172.21.15.2:0/1529347822 shutdown_connections 2024-09-15T23:05:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:21.124+0000 7f73d53a1640 1 --2- 172.21.15.2:0/1529347822 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f73b80391b0 0x7f73b803b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:21.124+0000 7f73d53a1640 1 --2- 172.21.15.2:0/1529347822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73d0107f30 0x7f73d019b420 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:21.124+0000 7f73d53a1640 1 -- 172.21.15.2:0/1529347822 >> 172.21.15.2:0/1529347822 conn(0x7f73d0101bd0 msgr2=0x7f73d01027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:21.775 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:21.124+0000 7f73d53a1640 1 -- 172.21.15.2:0/1529347822 shutdown_connections 2024-09-15T23:05:21.775 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:21.124+0000 7f73d53a1640 1 -- 172.21.15.2:0/1529347822 wait complete. 2024-09-15T23:05:21.775 INFO:teuthology.orchestra.run.smithi002.stdout:Generating ssh key... 2024-09-15T23:05:22.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-mon[31019]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:05:22.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:21 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:05:23.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-mon[31019]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:05:23.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-mon[31019]: [15/Sep/2024:23:05:21] ENGINE Bus STARTING 2024-09-15T23:05:23.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-mon[31019]: [15/Sep/2024:23:05:21] ENGINE Serving on http://172.21.15.2:8765 2024-09-15T23:05:23.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-mon[31019]: [15/Sep/2024:23:05:21] ENGINE Serving on https://172.21.15.2:7150 2024-09-15T23:05:23.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-mon[31019]: [15/Sep/2024:23:05:21] ENGINE Bus STARTED 2024-09-15T23:05:23.001 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-mon[31019]: [15/Sep/2024:23:05:21] ENGINE Error in HTTPServer.serve 2024-09-15T23:05:23.001 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-15T23:05:23.001 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T23:05:23.001 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T23:05:23.002 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-15T23:05:23.003 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T23:05:23.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' 2024-09-15T23:05:23.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' 2024-09-15T23:05:23.003 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: Generating public/private rsa key pair. 2024-09-15T23:05:23.003 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: Your identification has been saved in /tmp/tmptval_f74/key 2024-09-15T23:05:23.003 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: Your public key has been saved in /tmp/tmptval_f74/key.pub 2024-09-15T23:05:23.003 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: The key fingerprint is: 2024-09-15T23:05:23.003 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: SHA256:7Q8XmYlIi4T8WbAQ5OiHNbuL1qnbs22Y2rHq6BrEumg ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:05:23.003 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: The key's randomart image is: 2024-09-15T23:05:23.003 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: +---[RSA 3072]----+ 2024-09-15T23:05:23.003 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: | .+.. | 2024-09-15T23:05:23.003 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: | + o o | 2024-09-15T23:05:23.004 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: | . * o o | 2024-09-15T23:05:23.004 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: |.. o = = + . + | 2024-09-15T23:05:23.004 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: | oo o + S o = | 2024-09-15T23:05:23.004 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: |o . . . . | 2024-09-15T23:05:23.004 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: |o .o+ o . | 2024-09-15T23:05:23.004 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: |.E.+*=. + | 2024-09-15T23:05:23.004 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: |O+B=*+. . | 2024-09-15T23:05:23.004 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: +----[SHA256]-----+ 2024-09-15T23:05:23.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.158+0000 7f9291a4b640 1 Processor -- start 2024-09-15T23:05:23.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.158+0000 7f9291a4b640 1 -- start start 2024-09-15T23:05:23.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.158+0000 7f9291a4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 0x7f928c105b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:23.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.158+0000 7f9291a4b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f928c106150 con 0x7f928c105780 2024-09-15T23:05:23.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.158+0000 7f928affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 0x7f928c105b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:23.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.158+0000 7f928affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 0x7f928c105b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49992/0 (socket says 172.21.15.2:49992) 2024-09-15T23:05:23.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.158+0000 7f928affd640 1 -- 172.21.15.2:0/2119117516 learned_addr learned my addr 172.21.15.2:0/2119117516 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:23.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.159+0000 7f928affd640 1 -- 172.21.15.2:0/2119117516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928c108760 con 0x7f928c105780 2024-09-15T23:05:23.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.159+0000 7f928affd640 1 --2- 172.21.15.2:0/2119117516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 0x7f928c105b80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f927c009820 tx=0x7f927c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9b040783e3b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:23.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.159+0000 7f928a7fc640 1 -- 172.21.15.2:0/2119117516 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c037070 con 0x7f928c105780 2024-09-15T23:05:23.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.160+0000 7f928a7fc640 1 -- 172.21.15.2:0/2119117516 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f927c0328d0 con 0x7f928c105780 2024-09-15T23:05:23.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.160+0000 7f928a7fc640 1 -- 172.21.15.2:0/2119117516 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c0307d0 con 0x7f928c105780 2024-09-15T23:05:23.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.160+0000 7f9291a4b640 1 -- 172.21.15.2:0/2119117516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 msgr2=0x7f928c105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.160+0000 7f9291a4b640 1 --2- 172.21.15.2:0/2119117516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 0x7f928c105b80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f927c009820 tx=0x7f927c02a270 comp rx=0 tx=0).stop 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.160+0000 7f9291a4b640 1 -- 172.21.15.2:0/2119117516 shutdown_connections 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.160+0000 7f9291a4b640 1 --2- 172.21.15.2:0/2119117516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 0x7f928c105b80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.160+0000 7f9291a4b640 1 -- 172.21.15.2:0/2119117516 >> 172.21.15.2:0/2119117516 conn(0x7f928c101330 msgr2=0x7f928c103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.160+0000 7f9291a4b640 1 -- 172.21.15.2:0/2119117516 shutdown_connections 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.160+0000 7f9291a4b640 1 -- 172.21.15.2:0/2119117516 wait complete. 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.161+0000 7f9291a4b640 1 Processor -- start 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.161+0000 7f9291a4b640 1 -- start start 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.161+0000 7f9291a4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 0x7f928c19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.161+0000 7f9291a4b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f928c10b990 con 0x7f928c105780 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.161+0000 7f928affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 0x7f928c19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.161+0000 7f928affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 0x7f928c19b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50006/0 (socket says 172.21.15.2:50006) 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.161+0000 7f928affd640 1 -- 172.21.15.2:0/337329362 learned_addr learned my addr 172.21.15.2:0/337329362 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.162+0000 7f928affd640 1 -- 172.21.15.2:0/337329362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928c19b980 con 0x7f928c105780 2024-09-15T23:05:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.162+0000 7f928affd640 1 --2- 172.21.15.2:0/337329362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 0x7f928c19b440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f927c0097f0 tx=0x7f927c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.162+0000 7f9290a49640 1 -- 172.21.15.2:0/337329362 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c037040 con 0x7f928c105780 2024-09-15T23:05:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.162+0000 7f9290a49640 1 -- 172.21.15.2:0/337329362 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f927c032bb0 con 0x7f928c105780 2024-09-15T23:05:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.162+0000 7f9291a4b640 1 -- 172.21.15.2:0/337329362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928c19bc10 con 0x7f928c105780 2024-09-15T23:05:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.162+0000 7f9291a4b640 1 -- 172.21.15.2:0/337329362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f928c19e900 con 0x7f928c105780 2024-09-15T23:05:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.162+0000 7f9290a49640 1 -- 172.21.15.2:0/337329362 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f927c03a390 con 0x7f928c105780 2024-09-15T23:05:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.163+0000 7f9290a49640 1 -- 172.21.15.2:0/337329362 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f927c03a580 con 0x7f928c105780 2024-09-15T23:05:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.163+0000 7f9290a49640 1 --2- 172.21.15.2:0/337329362 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9278039200 0x7f927803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.163+0000 7f9291a4b640 1 -- 172.21.15.2:0/337329362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f928c105c00 con 0x7f928c105780 2024-09-15T23:05:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.163+0000 7f9290a49640 1 -- 172.21.15.2:0/337329362 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f927c06c4b0 con 0x7f928c105780 2024-09-15T23:05:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.163+0000 7f9283fff640 1 --2- 172.21.15.2:0/337329362 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9278039200 0x7f927803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.164+0000 7f9283fff640 1 --2- 172.21.15.2:0/337329362 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9278039200 0x7f927803b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f92740098c0 tx=0x7f9274006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.168+0000 7f9290a49640 1 -- 172.21.15.2:0/337329362 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f927c040210 con 0x7f928c105780 2024-09-15T23:05:23.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.347+0000 7f9291a4b640 1 -- 172.21.15.2:0/337329362 --> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f928c102590 con 0x7f9278039200 2024-09-15T23:05:23.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.706+0000 7f9290a49640 1 -- 172.21.15.2:0/337329362 <== mgr.14118 v2:172.21.15.2:6800/938645794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f928c102590 con 0x7f9278039200 2024-09-15T23:05:23.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.708+0000 7f9291a4b640 1 -- 172.21.15.2:0/337329362 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9278039200 msgr2=0x7f927803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:23.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.708+0000 7f9291a4b640 1 --2- 172.21.15.2:0/337329362 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9278039200 0x7f927803b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f92740098c0 tx=0x7f9274006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:23.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.708+0000 7f9291a4b640 1 -- 172.21.15.2:0/337329362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 msgr2=0x7f928c19b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:23.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.708+0000 7f9291a4b640 1 --2- 172.21.15.2:0/337329362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 0x7f928c19b440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f927c0097f0 tx=0x7f927c030d00 comp rx=0 tx=0).stop 2024-09-15T23:05:23.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.708+0000 7f9291a4b640 1 -- 172.21.15.2:0/337329362 shutdown_connections 2024-09-15T23:05:23.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.708+0000 7f9291a4b640 1 --2- 172.21.15.2:0/337329362 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9278039200 0x7f927803b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:23.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.708+0000 7f9291a4b640 1 --2- 172.21.15.2:0/337329362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f928c105780 0x7f928c19b440 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:23.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.708+0000 7f9291a4b640 1 -- 172.21.15.2:0/337329362 >> 172.21.15.2:0/337329362 conn(0x7f928c101330 msgr2=0x7f928c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:23.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.708+0000 7f9291a4b640 1 -- 172.21.15.2:0/337329362 shutdown_connections 2024-09-15T23:05:23.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:22.708+0000 7f9291a4b640 1 -- 172.21.15.2:0/337329362 wait complete. 2024-09-15T23:05:24.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:23 smithi002 ceph-mon[31019]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:05:24.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:23 smithi002 ceph-mon[31019]: Generating ssh key... 2024-09-15T23:05:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmho5faxLiHagNeQO/YpMWOGFy73N87TcSCY9CVEz7KViM+6SbqNbZ4wt5Vyq6QYg0Bh8i0T6762PKNKwhJoWlBn9iWHXcvcUiN6Jmrg2YvPKB/IS9V82/Awa6EjxE25D7O9wzD92yDjFcqQytT9HrTJ5a0vQTaqozyQwHkcLKMFi7aEfoMbbT1qkYeUC4lfBEgJd+rIDZYNAMylILRUbYsypQx0ghurMawh/ZkPbgzXrJWZeXmk5dXjTfh50Zh6WQRcN6NRrMMWKRoyxu8mW8botWt1FtQZCczcK4V4aIpFhENmZ8DSFyyoT4kcoCS70A6LA/mi+dFS4nXmQ6wubud120iE+n6bliMpRu7hCwC25K+hizOaXcwHwcQ/AngeLrn7TbujXvinxWxzqJ+zDlQbwY9fkmenWceymucs1NskA/lDlVhcy7rgVhnaGlXqEmUKJjWqj2cA2OjDoJ75iZ+uvK0EKBQ6OocnsyTZHF3RqNrxbgn2Ni+RW9PuEyfVU= ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:05:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.591+0000 7fd4898c9640 1 Processor -- start 2024-09-15T23:05:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.591+0000 7fd4898c9640 1 -- start start 2024-09-15T23:05:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.591+0000 7fd4898c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 0x7fd48407c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.591+0000 7fd4898c9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd48407c7b0 con 0x7fd48407de10 2024-09-15T23:05:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.591+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 0x7fd48407c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.591+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 0x7fd48407c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50014/0 (socket says 172.21.15.2:50014) 2024-09-15T23:05:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.591+0000 7fd482ffd640 1 -- 172.21.15.2:0/3322322448 learned_addr learned my addr 172.21.15.2:0/3322322448 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.592+0000 7fd482ffd640 1 -- 172.21.15.2:0/3322322448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48407c930 con 0x7fd48407de10 2024-09-15T23:05:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.592+0000 7fd482ffd640 1 --2- 172.21.15.2:0/3322322448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 0x7fd48407c270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd474009820 tx=0x7fd47402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8387dc808b1dd11b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.593+0000 7fd481ffb640 1 -- 172.21.15.2:0/3322322448 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd474037070 con 0x7fd48407de10 2024-09-15T23:05:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.593+0000 7fd481ffb640 1 -- 172.21.15.2:0/3322322448 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd4740328d0 con 0x7fd48407de10 2024-09-15T23:05:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.593+0000 7fd481ffb640 1 -- 172.21.15.2:0/3322322448 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4740307d0 con 0x7fd48407de10 2024-09-15T23:05:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.593+0000 7fd4898c9640 1 -- 172.21.15.2:0/3322322448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 msgr2=0x7fd48407c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.593+0000 7fd4898c9640 1 --2- 172.21.15.2:0/3322322448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 0x7fd48407c270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd474009820 tx=0x7fd47402a270 comp rx=0 tx=0).stop 2024-09-15T23:05:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.593+0000 7fd4898c9640 1 -- 172.21.15.2:0/3322322448 shutdown_connections 2024-09-15T23:05:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.593+0000 7fd4898c9640 1 --2- 172.21.15.2:0/3322322448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 0x7fd48407c270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.593+0000 7fd4898c9640 1 -- 172.21.15.2:0/3322322448 >> 172.21.15.2:0/3322322448 conn(0x7fd484102c70 msgr2=0x7fd484105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.593+0000 7fd4898c9640 1 -- 172.21.15.2:0/3322322448 shutdown_connections 2024-09-15T23:05:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.593+0000 7fd4898c9640 1 -- 172.21.15.2:0/3322322448 wait complete. 2024-09-15T23:05:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.594+0000 7fd4898c9640 1 Processor -- start 2024-09-15T23:05:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.594+0000 7fd4898c9640 1 -- start start 2024-09-15T23:05:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.594+0000 7fd4898c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 0x7fd48419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.594+0000 7fd4898c9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd48410dab0 con 0x7fd48407de10 2024-09-15T23:05:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.594+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 0x7fd48419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.594+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 0x7fd48419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50030/0 (socket says 172.21.15.2:50030) 2024-09-15T23:05:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.594+0000 7fd482ffd640 1 -- 172.21.15.2:0/3103485345 learned_addr learned my addr 172.21.15.2:0/3103485345 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.594+0000 7fd482ffd640 1 -- 172.21.15.2:0/3103485345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48419dbe0 con 0x7fd48407de10 2024-09-15T23:05:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.595+0000 7fd482ffd640 1 --2- 172.21.15.2:0/3103485345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 0x7fd48419d6a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd474032e10 tx=0x7fd474032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.595+0000 7fd4888c7640 1 -- 172.21.15.2:0/3103485345 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd474042070 con 0x7fd48407de10 2024-09-15T23:05:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.595+0000 7fd4888c7640 1 -- 172.21.15.2:0/3103485345 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd474030c80 con 0x7fd48407de10 2024-09-15T23:05:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.595+0000 7fd4888c7640 1 -- 172.21.15.2:0/3103485345 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd474037040 con 0x7fd48407de10 2024-09-15T23:05:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.595+0000 7fd4898c9640 1 -- 172.21.15.2:0/3103485345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48419de70 con 0x7fd48407de10 2024-09-15T23:05:24.418 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.595+0000 7fd4898c9640 1 -- 172.21.15.2:0/3103485345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4841a0b10 con 0x7fd48407de10 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.596+0000 7fd4888c7640 1 -- 172.21.15.2:0/3103485345 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd474045070 con 0x7fd48407de10 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.596+0000 7fd4888c7640 1 --2- 172.21.15.2:0/3103485345 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fd46c039200 0x7fd46c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.596+0000 7fd4898c9640 1 -- 172.21.15.2:0/3103485345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd48407c2f0 con 0x7fd48407de10 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.596+0000 7fd4888c7640 1 -- 172.21.15.2:0/3103485345 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd47406c180 con 0x7fd48407de10 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.596+0000 7fd4827fc640 1 --2- 172.21.15.2:0/3103485345 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fd46c039200 0x7fd46c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.596+0000 7fd4827fc640 1 --2- 172.21.15.2:0/3103485345 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fd46c039200 0x7fd46c03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd4780098c0 tx=0x7fd478006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.601+0000 7fd4888c7640 1 -- 172.21.15.2:0/3103485345 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd474045360 con 0x7fd48407de10 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.777+0000 7fd4898c9640 1 -- 172.21.15.2:0/3103485345 --> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fd484103f60 con 0x7fd46c039200 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.778+0000 7fd4888c7640 1 -- 172.21.15.2:0/3103485345 <== mgr.14118 v2:172.21.15.2:6800/938645794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fd484103f60 con 0x7fd46c039200 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.779+0000 7fd4898c9640 1 -- 172.21.15.2:0/3103485345 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fd46c039200 msgr2=0x7fd46c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.779+0000 7fd4898c9640 1 --2- 172.21.15.2:0/3103485345 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fd46c039200 0x7fd46c03b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd4780098c0 tx=0x7fd478006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.780+0000 7fd4898c9640 1 -- 172.21.15.2:0/3103485345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 msgr2=0x7fd48419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.780+0000 7fd4898c9640 1 --2- 172.21.15.2:0/3103485345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 0x7fd48419d6a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd474032e10 tx=0x7fd474032e40 comp rx=0 tx=0).stop 2024-09-15T23:05:24.419 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.780+0000 7fd4898c9640 1 -- 172.21.15.2:0/3103485345 shutdown_connections 2024-09-15T23:05:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.780+0000 7fd4898c9640 1 --2- 172.21.15.2:0/3103485345 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fd46c039200 0x7fd46c03b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.780+0000 7fd4898c9640 1 --2- 172.21.15.2:0/3103485345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd48407de10 0x7fd48419d6a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.780+0000 7fd4898c9640 1 -- 172.21.15.2:0/3103485345 >> 172.21.15.2:0/3103485345 conn(0x7fd484102c70 msgr2=0x7fd484103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.780+0000 7fd4898c9640 1 -- 172.21.15.2:0/3103485345 shutdown_connections 2024-09-15T23:05:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:23.780+0000 7fd4898c9640 1 -- 172.21.15.2:0/3103485345 wait complete. 2024-09-15T23:05:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-15T23:05:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:Adding key to root@localhost authorized_keys... 2024-09-15T23:05:24.425 INFO:teuthology.orchestra.run.smithi002.stdout:Adding host smithi002... 2024-09-15T23:05:24.997 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:24 smithi002 ceph-mon[31019]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:05:26.029 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:25 smithi002 ceph-mon[31019]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:05:26.925 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:26 smithi002 ceph-mon[31019]: Deploying cephadm binary to smithi002 2024-09-15T23:05:29.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Added host 'smithi002' with addr '172.21.15.2' 2024-09-15T23:05:29.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.806+0000 7f9ae39cf640 1 Processor -- start 2024-09-15T23:05:29.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.806+0000 7f9ae39cf640 1 -- start start 2024-09-15T23:05:29.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.806+0000 7f9ae39cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 0x7f9adc07c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:29.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.806+0000 7f9ae39cf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9adc07c880 con 0x7f9adc07de50 2024-09-15T23:05:29.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.806+0000 7f9ae176b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 0x7f9adc07c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:29.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.806+0000 7f9ae176b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 0x7f9adc07c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50044/0 (socket says 172.21.15.2:50044) 2024-09-15T23:05:29.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.806+0000 7f9ae176b640 1 -- 172.21.15.2:0/3143989495 learned_addr learned my addr 172.21.15.2:0/3143989495 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:29.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.807+0000 7f9ae176b640 1 -- 172.21.15.2:0/3143989495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9adc07ca00 con 0x7f9adc07de50 2024-09-15T23:05:29.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.807+0000 7f9ae176b640 1 --2- 172.21.15.2:0/3143989495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 0x7f9adc07c2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009820 tx=0x7f9ad802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b8920a9817febb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:29.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.808+0000 7f9ad3fff640 1 -- 172.21.15.2:0/3143989495 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ad8037070 con 0x7f9adc07de50 2024-09-15T23:05:29.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.808+0000 7f9ad3fff640 1 -- 172.21.15.2:0/3143989495 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9ad80328d0 con 0x7f9adc07de50 2024-09-15T23:05:29.482 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.808+0000 7f9ad3fff640 1 -- 172.21.15.2:0/3143989495 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ad80307d0 con 0x7f9adc07de50 2024-09-15T23:05:29.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.808+0000 7f9ae39cf640 1 -- 172.21.15.2:0/3143989495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 msgr2=0x7f9adc07c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:29.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.808+0000 7f9ae39cf640 1 --2- 172.21.15.2:0/3143989495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 0x7f9adc07c2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009820 tx=0x7f9ad802a270 comp rx=0 tx=0).stop 2024-09-15T23:05:29.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.808+0000 7f9ae39cf640 1 -- 172.21.15.2:0/3143989495 shutdown_connections 2024-09-15T23:05:29.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.808+0000 7f9ae39cf640 1 --2- 172.21.15.2:0/3143989495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 0x7f9adc07c2b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:29.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.808+0000 7f9ae39cf640 1 -- 172.21.15.2:0/3143989495 >> 172.21.15.2:0/3143989495 conn(0x7f9adc102c70 msgr2=0x7f9adc105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:29.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.808+0000 7f9ae39cf640 1 -- 172.21.15.2:0/3143989495 shutdown_connections 2024-09-15T23:05:29.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.808+0000 7f9ae39cf640 1 -- 172.21.15.2:0/3143989495 wait complete. 2024-09-15T23:05:29.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.809+0000 7f9ae39cf640 1 Processor -- start 2024-09-15T23:05:29.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.809+0000 7f9ae39cf640 1 -- start start 2024-09-15T23:05:29.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.809+0000 7f9ae39cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 0x7f9adc19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:29.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.809+0000 7f9ae39cf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9adc10dad0 con 0x7f9adc07de50 2024-09-15T23:05:29.483 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.809+0000 7f9ae176b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 0x7f9adc19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:29.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.809+0000 7f9ae176b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 0x7f9adc19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50050/0 (socket says 172.21.15.2:50050) 2024-09-15T23:05:29.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.809+0000 7f9ae176b640 1 -- 172.21.15.2:0/1795434132 learned_addr learned my addr 172.21.15.2:0/1795434132 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:29.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.809+0000 7f9ae176b640 1 -- 172.21.15.2:0/1795434132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9adc19dba0 con 0x7f9adc07de50 2024-09-15T23:05:29.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.810+0000 7f9ae176b640 1 --2- 172.21.15.2:0/1795434132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 0x7f9adc19d660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80097f0 tx=0x7f9ad8030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:29.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.810+0000 7f9ad27fc640 1 -- 172.21.15.2:0/1795434132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ad8037040 con 0x7f9adc07de50 2024-09-15T23:05:29.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.810+0000 7f9ae39cf640 1 -- 172.21.15.2:0/1795434132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9adc19de30 con 0x7f9adc07de50 2024-09-15T23:05:29.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.810+0000 7f9ad27fc640 1 -- 172.21.15.2:0/1795434132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9ad8032bb0 con 0x7f9adc07de50 2024-09-15T23:05:29.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.810+0000 7f9ad27fc640 1 -- 172.21.15.2:0/1795434132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ad803a390 con 0x7f9adc07de50 2024-09-15T23:05:29.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.810+0000 7f9ae39cf640 1 -- 172.21.15.2:0/1795434132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9adc1a0b20 con 0x7f9adc07de50 2024-09-15T23:05:29.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.811+0000 7f9ad27fc640 1 -- 172.21.15.2:0/1795434132 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f9ad803b3f0 con 0x7f9adc07de50 2024-09-15T23:05:29.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.811+0000 7f9ad27fc640 1 --2- 172.21.15.2:0/1795434132 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ac80391b0 0x7f9ac803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:29.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.811+0000 7f9ae39cf640 1 -- 172.21.15.2:0/1795434132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9adc07c330 con 0x7f9adc07de50 2024-09-15T23:05:29.484 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.811+0000 7f9ad27fc640 1 -- 172.21.15.2:0/1795434132 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9ad806c530 con 0x7f9adc07de50 2024-09-15T23:05:29.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.811+0000 7f9ae0f6a640 1 --2- 172.21.15.2:0/1795434132 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ac80391b0 0x7f9ac803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:29.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.812+0000 7f9ae0f6a640 1 --2- 172.21.15.2:0/1795434132 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ac80391b0 0x7f9ac803b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0098c0 tx=0x7f9acc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:29.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.816+0000 7f9ad27fc640 1 -- 172.21.15.2:0/1795434132 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ad8032d60 con 0x7f9adc07de50 2024-09-15T23:05:29.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:24.996+0000 7f9ae39cf640 1 -- 172.21.15.2:0/1795434132 --> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}) -- 0x7f9adc103f40 con 0x7f9ac80391b0 2024-09-15T23:05:29.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:28.858+0000 7f9ad27fc640 1 -- 172.21.15.2:0/1795434132 <== mgr.14118 v2:172.21.15.2:6800/938645794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f9adc103f40 con 0x7f9ac80391b0 2024-09-15T23:05:29.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:28.861+0000 7f9ae39cf640 1 -- 172.21.15.2:0/1795434132 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ac80391b0 msgr2=0x7f9ac803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:29.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:28.861+0000 7f9ae39cf640 1 --2- 172.21.15.2:0/1795434132 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ac80391b0 0x7f9ac803b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0098c0 tx=0x7f9acc006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:29.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:28.861+0000 7f9ae39cf640 1 -- 172.21.15.2:0/1795434132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 msgr2=0x7f9adc19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:29.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:28.861+0000 7f9ae39cf640 1 --2- 172.21.15.2:0/1795434132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 0x7f9adc19d660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80097f0 tx=0x7f9ad8030d00 comp rx=0 tx=0).stop 2024-09-15T23:05:29.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:28.861+0000 7f9ae39cf640 1 -- 172.21.15.2:0/1795434132 shutdown_connections 2024-09-15T23:05:29.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:28.861+0000 7f9ae39cf640 1 --2- 172.21.15.2:0/1795434132 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ac80391b0 0x7f9ac803b670 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:29.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:28.861+0000 7f9ae39cf640 1 --2- 172.21.15.2:0/1795434132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9adc07de50 0x7f9adc19d660 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:29.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:28.861+0000 7f9ae39cf640 1 -- 172.21.15.2:0/1795434132 >> 172.21.15.2:0/1795434132 conn(0x7f9adc102c70 msgr2=0x7f9adc103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:29.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:28.861+0000 7f9ae39cf640 1 -- 172.21.15.2:0/1795434132 shutdown_connections 2024-09-15T23:05:29.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:28.861+0000 7f9ae39cf640 1 -- 172.21.15.2:0/1795434132 wait complete. 2024-09-15T23:05:29.486 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mon service... 2024-09-15T23:05:30.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:29 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' 2024-09-15T23:05:30.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:29 smithi002 ceph-mon[31019]: Added host smithi002 2024-09-15T23:05:30.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:29 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:05:30.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-15T23:05:30.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.859+0000 7f48e9c2e640 1 Processor -- start 2024-09-15T23:05:30.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.859+0000 7f48e9c2e640 1 -- start start 2024-09-15T23:05:30.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.860+0000 7f48e9c2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 0x7f48e4107900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:30.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.860+0000 7f48e9c2e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f48e4107ed0 con 0x7f48e4107500 2024-09-15T23:05:30.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.860+0000 7f48e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 0x7f48e4107900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:30.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.860+0000 7f48e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 0x7f48e4107900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43546/0 (socket says 172.21.15.2:43546) 2024-09-15T23:05:30.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.860+0000 7f48e37fe640 1 -- 172.21.15.2:0/1328797591 learned_addr learned my addr 172.21.15.2:0/1328797591 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:30.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.860+0000 7f48e37fe640 1 -- 172.21.15.2:0/1328797591 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e41086b0 con 0x7f48e4107500 2024-09-15T23:05:30.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.861+0000 7f48e37fe640 1 --2- 172.21.15.2:0/1328797591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 0x7f48e4107900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009820 tx=0x7f48d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34af5efd784de71e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:30.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.861+0000 7f48e27fc640 1 -- 172.21.15.2:0/1328797591 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48d4037070 con 0x7f48e4107500 2024-09-15T23:05:30.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.861+0000 7f48e27fc640 1 -- 172.21.15.2:0/1328797591 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f48d40328d0 con 0x7f48e4107500 2024-09-15T23:05:30.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.861+0000 7f48e27fc640 1 -- 172.21.15.2:0/1328797591 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48d40307d0 con 0x7f48e4107500 2024-09-15T23:05:30.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.861+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1328797591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 msgr2=0x7f48e4107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:30.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.861+0000 7f48e9c2e640 1 --2- 172.21.15.2:0/1328797591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 0x7f48e4107900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009820 tx=0x7f48d402a270 comp rx=0 tx=0).stop 2024-09-15T23:05:30.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.862+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1328797591 shutdown_connections 2024-09-15T23:05:30.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.862+0000 7f48e9c2e640 1 --2- 172.21.15.2:0/1328797591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 0x7f48e4107900 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:30.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.862+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1328797591 >> 172.21.15.2:0/1328797591 conn(0x7f48e4102cb0 msgr2=0x7f48e41050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:30.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.862+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1328797591 shutdown_connections 2024-09-15T23:05:30.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.862+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1328797591 wait complete. 2024-09-15T23:05:30.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.862+0000 7f48e9c2e640 1 Processor -- start 2024-09-15T23:05:30.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.863+0000 7f48e9c2e640 1 -- start start 2024-09-15T23:05:30.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.863+0000 7f48e9c2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 0x7f48e419b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:30.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.863+0000 7f48e9c2e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f48e410ba60 con 0x7f48e4107500 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.863+0000 7f48e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 0x7f48e419b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.863+0000 7f48e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 0x7f48e419b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43552/0 (socket says 172.21.15.2:43552) 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.863+0000 7f48e37fe640 1 -- 172.21.15.2:0/1171364614 learned_addr learned my addr 172.21.15.2:0/1171364614 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.863+0000 7f48e37fe640 1 -- 172.21.15.2:0/1171364614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e419b9b0 con 0x7f48e4107500 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.863+0000 7f48e37fe640 1 --2- 172.21.15.2:0/1171364614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 0x7f48e419b470 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f48d40097f0 tx=0x7f48d4030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.863+0000 7f48e0ff9640 1 -- 172.21.15.2:0/1171364614 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48d4037040 con 0x7f48e4107500 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.863+0000 7f48e0ff9640 1 -- 172.21.15.2:0/1171364614 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f48d4032bb0 con 0x7f48e4107500 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.863+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1171364614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e419bc40 con 0x7f48e4107500 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.863+0000 7f48e0ff9640 1 -- 172.21.15.2:0/1171364614 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48d403a390 con 0x7f48e4107500 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.863+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1171364614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e419e930 con 0x7f48e4107500 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.864+0000 7f48e0ff9640 1 -- 172.21.15.2:0/1171364614 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f48d403a580 con 0x7f48e4107500 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.864+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1171364614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48e410bbe0 con 0x7f48e4107500 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.865+0000 7f48e0ff9640 1 --2- 172.21.15.2:0/1171364614 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f48cc039200 0x7f48cc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:30.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.865+0000 7f48e0ff9640 1 -- 172.21.15.2:0/1171364614 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f48d406c4b0 con 0x7f48e4107500 2024-09-15T23:05:30.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.865+0000 7f48e2ffd640 1 --2- 172.21.15.2:0/1171364614 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f48cc039200 0x7f48cc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:30.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.865+0000 7f48e2ffd640 1 --2- 172.21.15.2:0/1171364614 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f48cc039200 0x7f48cc03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f48d80098c0 tx=0x7f48d8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:30.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:29.869+0000 7f48e0ff9640 1 -- 172.21.15.2:0/1171364614 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f48d4040210 con 0x7f48e4107500 2024-09-15T23:05:30.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.081+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1171364614 --> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f48e4103f10 con 0x7f48cc039200 2024-09-15T23:05:30.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.085+0000 7f48e0ff9640 1 -- 172.21.15.2:0/1171364614 <== mgr.14118 v2:172.21.15.2:6800/938645794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f48e4103f10 con 0x7f48cc039200 2024-09-15T23:05:30.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.088+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1171364614 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f48cc039200 msgr2=0x7f48cc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:30.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.088+0000 7f48e9c2e640 1 --2- 172.21.15.2:0/1171364614 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f48cc039200 0x7f48cc03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f48d80098c0 tx=0x7f48d8006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:30.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.088+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1171364614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 msgr2=0x7f48e419b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:30.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.088+0000 7f48e9c2e640 1 --2- 172.21.15.2:0/1171364614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 0x7f48e419b470 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f48d40097f0 tx=0x7f48d4030d00 comp rx=0 tx=0).stop 2024-09-15T23:05:30.625 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.088+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1171364614 shutdown_connections 2024-09-15T23:05:30.625 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.088+0000 7f48e9c2e640 1 --2- 172.21.15.2:0/1171364614 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f48cc039200 0x7f48cc03b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:30.625 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.088+0000 7f48e9c2e640 1 --2- 172.21.15.2:0/1171364614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e4107500 0x7f48e419b470 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:30.625 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.088+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1171364614 >> 172.21.15.2:0/1171364614 conn(0x7f48e4102cb0 msgr2=0x7f48e4103800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:30.625 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.088+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1171364614 shutdown_connections 2024-09-15T23:05:30.625 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.088+0000 7f48e9c2e640 1 -- 172.21.15.2:0/1171364614 wait complete. 2024-09-15T23:05:30.625 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mgr service... 2024-09-15T23:05:31.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:31 smithi002 ceph-mon[31019]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:05:31.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:31 smithi002 ceph-mon[31019]: Saving service mon spec with placement count:5 2024-09-15T23:05:31.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:31 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' 2024-09-15T23:05:31.912 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-15T23:05:31.913 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.989+0000 7f1117e8f640 1 Processor -- start 2024-09-15T23:05:31.913 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.989+0000 7f1117e8f640 1 -- start start 2024-09-15T23:05:31.913 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.989+0000 7f1117e8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 0x7f111007c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:31.913 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.989+0000 7f1117e8f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f111007c860 con 0x7f111007de30 2024-09-15T23:05:31.913 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.989+0000 7f1115c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 0x7f111007c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:31.913 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.989+0000 7f1115c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 0x7f111007c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43558/0 (socket says 172.21.15.2:43558) 2024-09-15T23:05:31.913 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.989+0000 7f1115c2b640 1 -- 172.21.15.2:0/672863890 learned_addr learned my addr 172.21.15.2:0/672863890 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:31.913 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.990+0000 7f1115c2b640 1 -- 172.21.15.2:0/672863890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111007c9e0 con 0x7f111007de30 2024-09-15T23:05:31.913 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.991+0000 7f1115c2b640 1 --2- 172.21.15.2:0/672863890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 0x7f111007c290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f110c009820 tx=0x7f110c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b239cad897843016 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:31.913 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.991+0000 7f1114c29640 1 -- 172.21.15.2:0/672863890 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f110c037070 con 0x7f111007de30 2024-09-15T23:05:31.913 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.991+0000 7f1114c29640 1 -- 172.21.15.2:0/672863890 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f110c0328d0 con 0x7f111007de30 2024-09-15T23:05:31.913 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.991+0000 7f1114c29640 1 -- 172.21.15.2:0/672863890 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f110c0307d0 con 0x7f111007de30 2024-09-15T23:05:31.913 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.992+0000 7f1117e8f640 1 -- 172.21.15.2:0/672863890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 msgr2=0x7f111007c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:31.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.992+0000 7f1117e8f640 1 --2- 172.21.15.2:0/672863890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 0x7f111007c290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f110c009820 tx=0x7f110c02a270 comp rx=0 tx=0).stop 2024-09-15T23:05:31.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.992+0000 7f1117e8f640 1 -- 172.21.15.2:0/672863890 shutdown_connections 2024-09-15T23:05:31.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.992+0000 7f1117e8f640 1 --2- 172.21.15.2:0/672863890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 0x7f111007c290 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:31.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.992+0000 7f1117e8f640 1 -- 172.21.15.2:0/672863890 >> 172.21.15.2:0/672863890 conn(0x7f1110102c70 msgr2=0x7f1110105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:31.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.992+0000 7f1117e8f640 1 -- 172.21.15.2:0/672863890 shutdown_connections 2024-09-15T23:05:31.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.992+0000 7f1117e8f640 1 -- 172.21.15.2:0/672863890 wait complete. 2024-09-15T23:05:31.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.992+0000 7f1117e8f640 1 Processor -- start 2024-09-15T23:05:31.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.993+0000 7f1117e8f640 1 -- start start 2024-09-15T23:05:31.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.993+0000 7f1117e8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 0x7f111019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:31.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.993+0000 7f1117e8f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f111010da90 con 0x7f111007de30 2024-09-15T23:05:31.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.993+0000 7f1115c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 0x7f111019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:31.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.993+0000 7f1115c2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 0x7f111019d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43562/0 (socket says 172.21.15.2:43562) 2024-09-15T23:05:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.993+0000 7f1115c2b640 1 -- 172.21.15.2:0/1280771053 learned_addr learned my addr 172.21.15.2:0/1280771053 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.993+0000 7f1115c2b640 1 -- 172.21.15.2:0/1280771053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111019db60 con 0x7f111007de30 2024-09-15T23:05:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.993+0000 7f1115c2b640 1 --2- 172.21.15.2:0/1280771053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 0x7f111019d620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f110c032e10 tx=0x7f110c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.993+0000 7f1106ffd640 1 -- 172.21.15.2:0/1280771053 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f110c042070 con 0x7f111007de30 2024-09-15T23:05:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.993+0000 7f1106ffd640 1 -- 172.21.15.2:0/1280771053 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f110c030c80 con 0x7f111007de30 2024-09-15T23:05:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.993+0000 7f1117e8f640 1 -- 172.21.15.2:0/1280771053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111019ddf0 con 0x7f111007de30 2024-09-15T23:05:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.993+0000 7f1106ffd640 1 -- 172.21.15.2:0/1280771053 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f110c037040 con 0x7f111007de30 2024-09-15T23:05:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.994+0000 7f1117e8f640 1 -- 172.21.15.2:0/1280771053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11101a0ae0 con 0x7f111007de30 2024-09-15T23:05:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.994+0000 7f1106ffd640 1 -- 172.21.15.2:0/1280771053 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f110c045070 con 0x7f111007de30 2024-09-15T23:05:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.994+0000 7f1117e8f640 1 -- 172.21.15.2:0/1280771053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f111007c310 con 0x7f111007de30 2024-09-15T23:05:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.995+0000 7f1106ffd640 1 --2- 172.21.15.2:0/1280771053 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f10fc0391b0 0x7f10fc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.995+0000 7f1106ffd640 1 -- 172.21.15.2:0/1280771053 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f110c06c1f0 con 0x7f111007de30 2024-09-15T23:05:31.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.995+0000 7f111542a640 1 --2- 172.21.15.2:0/1280771053 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f10fc0391b0 0x7f10fc03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:31.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:30.995+0000 7f111542a640 1 --2- 172.21.15.2:0/1280771053 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f10fc0391b0 0x7f10fc03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f11000098c0 tx=0x7f1100006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:31.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:31.000+0000 7f1106ffd640 1 -- 172.21.15.2:0/1280771053 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f110c045360 con 0x7f111007de30 2024-09-15T23:05:31.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:31.193+0000 7f1117e8f640 1 -- 172.21.15.2:0/1280771053 --> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f1110103f60 con 0x7f10fc0391b0 2024-09-15T23:05:31.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:31.197+0000 7f1106ffd640 1 -- 172.21.15.2:0/1280771053 <== mgr.14118 v2:172.21.15.2:6800/938645794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1110103f60 con 0x7f10fc0391b0 2024-09-15T23:05:31.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:31.199+0000 7f1117e8f640 1 -- 172.21.15.2:0/1280771053 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f10fc0391b0 msgr2=0x7f10fc03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:31.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:31.199+0000 7f1117e8f640 1 --2- 172.21.15.2:0/1280771053 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f10fc0391b0 0x7f10fc03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f11000098c0 tx=0x7f1100006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:31.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:31.199+0000 7f1117e8f640 1 -- 172.21.15.2:0/1280771053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 msgr2=0x7f111019d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:31.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:31.199+0000 7f1117e8f640 1 --2- 172.21.15.2:0/1280771053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 0x7f111019d620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f110c032e10 tx=0x7f110c032e40 comp rx=0 tx=0).stop 2024-09-15T23:05:31.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:31.199+0000 7f1117e8f640 1 -- 172.21.15.2:0/1280771053 shutdown_connections 2024-09-15T23:05:31.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:31.199+0000 7f1117e8f640 1 --2- 172.21.15.2:0/1280771053 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f10fc0391b0 0x7f10fc03b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:31.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:31.199+0000 7f1117e8f640 1 --2- 172.21.15.2:0/1280771053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f111007de30 0x7f111019d620 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:31.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:31.199+0000 7f1117e8f640 1 -- 172.21.15.2:0/1280771053 >> 172.21.15.2:0/1280771053 conn(0x7f1110102c70 msgr2=0x7f1110103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:31.917 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:31.200+0000 7f1117e8f640 1 -- 172.21.15.2:0/1280771053 shutdown_connections 2024-09-15T23:05:31.917 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:31.200+0000 7f1117e8f640 1 -- 172.21.15.2:0/1280771053 wait complete. 2024-09-15T23:05:32.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:32 smithi002 ceph-mon[31019]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:05:32.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:32 smithi002 ceph-mon[31019]: Saving service mgr spec with placement count:2 2024-09-15T23:05:32.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:32 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' 2024-09-15T23:05:33.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.350+0000 7fd7d8d71640 1 Processor -- start 2024-09-15T23:05:33.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.350+0000 7fd7d8d71640 1 -- start start 2024-09-15T23:05:33.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.350+0000 7fd7d8d71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 0x7fd7d407c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:33.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.350+0000 7fd7d8d71640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d407c860 con 0x7fd7d407de30 2024-09-15T23:05:33.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.350+0000 7fd7d259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 0x7fd7d407c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:33.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.350+0000 7fd7d259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 0x7fd7d407c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43566/0 (socket says 172.21.15.2:43566) 2024-09-15T23:05:33.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.350+0000 7fd7d259c640 1 -- 172.21.15.2:0/1998445990 learned_addr learned my addr 172.21.15.2:0/1998445990 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:33.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.350+0000 7fd7d259c640 1 -- 172.21.15.2:0/1998445990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d407c9e0 con 0x7fd7d407de30 2024-09-15T23:05:33.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.351+0000 7fd7d259c640 1 --2- 172.21.15.2:0/1998445990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 0x7fd7d407c290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009820 tx=0x7fd7c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39c732ada2abecc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:33.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.351+0000 7fd7d1d9b640 1 -- 172.21.15.2:0/1998445990 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c4037070 con 0x7fd7d407de30 2024-09-15T23:05:33.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.351+0000 7fd7d1d9b640 1 -- 172.21.15.2:0/1998445990 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd7c40328d0 con 0x7fd7d407de30 2024-09-15T23:05:33.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.351+0000 7fd7d1d9b640 1 -- 172.21.15.2:0/1998445990 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c40307d0 con 0x7fd7d407de30 2024-09-15T23:05:33.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.352+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1998445990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 msgr2=0x7fd7d407c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:33.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.352+0000 7fd7d8d71640 1 --2- 172.21.15.2:0/1998445990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 0x7fd7d407c290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009820 tx=0x7fd7c402a270 comp rx=0 tx=0).stop 2024-09-15T23:05:33.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.352+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1998445990 shutdown_connections 2024-09-15T23:05:33.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.352+0000 7fd7d8d71640 1 --2- 172.21.15.2:0/1998445990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 0x7fd7d407c290 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:33.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.352+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1998445990 >> 172.21.15.2:0/1998445990 conn(0x7fd7d4102c70 msgr2=0x7fd7d4105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:33.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.352+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1998445990 shutdown_connections 2024-09-15T23:05:33.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.352+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1998445990 wait complete. 2024-09-15T23:05:33.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.353+0000 7fd7d8d71640 1 Processor -- start 2024-09-15T23:05:33.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.353+0000 7fd7d8d71640 1 -- start start 2024-09-15T23:05:33.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.353+0000 7fd7d8d71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 0x7fd7d419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:33.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.353+0000 7fd7d8d71640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d410da90 con 0x7fd7d407de30 2024-09-15T23:05:33.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.353+0000 7fd7d259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 0x7fd7d419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:33.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.353+0000 7fd7d259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 0x7fd7d419d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43570/0 (socket says 172.21.15.2:43570) 2024-09-15T23:05:33.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.353+0000 7fd7d259c640 1 -- 172.21.15.2:0/1894199094 learned_addr learned my addr 172.21.15.2:0/1894199094 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:33.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.353+0000 7fd7d259c640 1 -- 172.21.15.2:0/1894199094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d419db60 con 0x7fd7d407de30 2024-09-15T23:05:33.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.353+0000 7fd7d259c640 1 --2- 172.21.15.2:0/1894199094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 0x7fd7d419d620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4032e10 tx=0x7fd7c4032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:33.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.353+0000 7fd7cb7fe640 1 -- 172.21.15.2:0/1894199094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c4042070 con 0x7fd7d407de30 2024-09-15T23:05:33.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.353+0000 7fd7cb7fe640 1 -- 172.21.15.2:0/1894199094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd7c4030c80 con 0x7fd7d407de30 2024-09-15T23:05:33.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.354+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1894199094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d419ddf0 con 0x7fd7d407de30 2024-09-15T23:05:33.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.354+0000 7fd7cb7fe640 1 -- 172.21.15.2:0/1894199094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c4037040 con 0x7fd7d407de30 2024-09-15T23:05:33.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.354+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1894199094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d41a0ae0 con 0x7fd7d407de30 2024-09-15T23:05:33.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.354+0000 7fd7cb7fe640 1 -- 172.21.15.2:0/1894199094 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd7c4045070 con 0x7fd7d407de30 2024-09-15T23:05:33.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.354+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1894199094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d407c310 con 0x7fd7d407de30 2024-09-15T23:05:33.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.355+0000 7fd7cb7fe640 1 --2- 172.21.15.2:0/1894199094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fd7c0039200 0x7fd7c003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:33.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.355+0000 7fd7cb7fe640 1 -- 172.21.15.2:0/1894199094 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd7c406c180 con 0x7fd7d407de30 2024-09-15T23:05:33.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.355+0000 7fd7cbfff640 1 --2- 172.21.15.2:0/1894199094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fd7c0039200 0x7fd7c003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:33.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.355+0000 7fd7cbfff640 1 --2- 172.21.15.2:0/1894199094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fd7c0039200 0x7fd7c003b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0098c0 tx=0x7fd7bc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:33.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.359+0000 7fd7cb7fe640 1 -- 172.21.15.2:0/1894199094 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7c4045360 con 0x7fd7d407de30 2024-09-15T23:05:33.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.541+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1894199094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fd7d41a1160 con 0x7fd7d407de30 2024-09-15T23:05:33.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.543+0000 7fd7cb7fe640 1 -- 172.21.15.2:0/1894199094 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7fd7c4043260 con 0x7fd7d407de30 2024-09-15T23:05:33.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.545+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1894199094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fd7c0039200 msgr2=0x7fd7c003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:33.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.545+0000 7fd7d8d71640 1 --2- 172.21.15.2:0/1894199094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fd7c0039200 0x7fd7c003b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0098c0 tx=0x7fd7bc006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:33.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.545+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1894199094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 msgr2=0x7fd7d419d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:33.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.545+0000 7fd7d8d71640 1 --2- 172.21.15.2:0/1894199094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 0x7fd7d419d620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4032e10 tx=0x7fd7c4032e40 comp rx=0 tx=0).stop 2024-09-15T23:05:33.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.545+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1894199094 shutdown_connections 2024-09-15T23:05:33.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.545+0000 7fd7d8d71640 1 --2- 172.21.15.2:0/1894199094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fd7c0039200 0x7fd7c003b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:33.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.545+0000 7fd7d8d71640 1 --2- 172.21.15.2:0/1894199094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7d407de30 0x7fd7d419d620 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:33.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.545+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1894199094 >> 172.21.15.2:0/1894199094 conn(0x7fd7d4102c70 msgr2=0x7fd7d4103880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:33.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.546+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1894199094 shutdown_connections 2024-09-15T23:05:33.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:32.546+0000 7fd7d8d71640 1 -- 172.21.15.2:0/1894199094 wait complete. 2024-09-15T23:05:33.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:33 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1894199094' entity='client.admin' 2024-09-15T23:05:35.011 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:34 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2492791862' entity='client.admin' 2024-09-15T23:05:35.011 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:34 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' 2024-09-15T23:05:35.020 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.712+0000 7f17c8c13640 1 Processor -- start 2024-09-15T23:05:35.020 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.712+0000 7f17c8c13640 1 -- start start 2024-09-15T23:05:35.020 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.712+0000 7f17c8c13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 0x7f17c4107e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:35.021 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.712+0000 7f17c8c13640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17c41083f0 con 0x7f17c4107a20 2024-09-15T23:05:35.021 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.712+0000 7f17c259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 0x7f17c4107e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:35.021 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.712+0000 7f17c259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 0x7f17c4107e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43572/0 (socket says 172.21.15.2:43572) 2024-09-15T23:05:35.021 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.712+0000 7f17c259c640 1 -- 172.21.15.2:0/2278131424 learned_addr learned my addr 172.21.15.2:0/2278131424 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:35.021 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.713+0000 7f17c259c640 1 -- 172.21.15.2:0/2278131424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c4108570 con 0x7f17c4107a20 2024-09-15T23:05:35.021 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.713+0000 7f17c259c640 1 --2- 172.21.15.2:0/2278131424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 0x7f17c4107e20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009820 tx=0x7f17b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0ca1f1be8664cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:35.021 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.714+0000 7f17c159a640 1 -- 172.21.15.2:0/2278131424 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17b4037070 con 0x7f17c4107a20 2024-09-15T23:05:35.021 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.714+0000 7f17c159a640 1 -- 172.21.15.2:0/2278131424 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f17b40328d0 con 0x7f17c4107a20 2024-09-15T23:05:35.021 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.714+0000 7f17c159a640 1 -- 172.21.15.2:0/2278131424 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17b40307d0 con 0x7f17c4107a20 2024-09-15T23:05:35.021 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.714+0000 7f17c8c13640 1 -- 172.21.15.2:0/2278131424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 msgr2=0x7f17c4107e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:35.022 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.714+0000 7f17c8c13640 1 --2- 172.21.15.2:0/2278131424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 0x7f17c4107e20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009820 tx=0x7f17b402a270 comp rx=0 tx=0).stop 2024-09-15T23:05:35.022 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.714+0000 7f17c8c13640 1 -- 172.21.15.2:0/2278131424 shutdown_connections 2024-09-15T23:05:35.022 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.714+0000 7f17c8c13640 1 --2- 172.21.15.2:0/2278131424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 0x7f17c4107e20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:35.022 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.714+0000 7f17c8c13640 1 -- 172.21.15.2:0/2278131424 >> 172.21.15.2:0/2278131424 conn(0x7f17c4101290 msgr2=0x7f17c41036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:35.022 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.714+0000 7f17c8c13640 1 -- 172.21.15.2:0/2278131424 shutdown_connections 2024-09-15T23:05:35.022 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.714+0000 7f17c8c13640 1 -- 172.21.15.2:0/2278131424 wait complete. 2024-09-15T23:05:35.022 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.715+0000 7f17c8c13640 1 Processor -- start 2024-09-15T23:05:35.022 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.715+0000 7f17c8c13640 1 -- start start 2024-09-15T23:05:35.022 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.715+0000 7f17c8c13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 0x7f17c419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:35.022 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.715+0000 7f17c8c13640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f17c41063e0 con 0x7f17c4107a20 2024-09-15T23:05:35.022 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.715+0000 7f17c259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 0x7f17c419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:35.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.715+0000 7f17c259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 0x7f17c419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43588/0 (socket says 172.21.15.2:43588) 2024-09-15T23:05:35.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.715+0000 7f17c259c640 1 -- 172.21.15.2:0/2492791862 learned_addr learned my addr 172.21.15.2:0/2492791862 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:35.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.716+0000 7f17c259c640 1 -- 172.21.15.2:0/2492791862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c419dbe0 con 0x7f17c4107a20 2024-09-15T23:05:35.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.716+0000 7f17c259c640 1 --2- 172.21.15.2:0/2492791862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 0x7f17c419d6a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f17b40097f0 tx=0x7f17b4030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:35.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.716+0000 7f17bb7fe640 1 -- 172.21.15.2:0/2492791862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17b4037040 con 0x7f17c4107a20 2024-09-15T23:05:35.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.716+0000 7f17bb7fe640 1 -- 172.21.15.2:0/2492791862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f17b4032bb0 con 0x7f17c4107a20 2024-09-15T23:05:35.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.716+0000 7f17c8c13640 1 -- 172.21.15.2:0/2492791862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c419de70 con 0x7f17c4107a20 2024-09-15T23:05:35.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.716+0000 7f17bb7fe640 1 -- 172.21.15.2:0/2492791862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17b403a390 con 0x7f17c4107a20 2024-09-15T23:05:35.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.716+0000 7f17c8c13640 1 -- 172.21.15.2:0/2492791862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c41a0b60 con 0x7f17c4107a20 2024-09-15T23:05:35.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.717+0000 7f17bb7fe640 1 -- 172.21.15.2:0/2492791862 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f17b403a600 con 0x7f17c4107a20 2024-09-15T23:05:35.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.717+0000 7f17c8c13640 1 -- 172.21.15.2:0/2492791862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c4107ea0 con 0x7f17c4107a20 2024-09-15T23:05:35.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.717+0000 7f17bb7fe640 1 --2- 172.21.15.2:0/2492791862 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f17b0039200 0x7f17b003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:35.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.717+0000 7f17bb7fe640 1 -- 172.21.15.2:0/2492791862 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f17b406c570 con 0x7f17c4107a20 2024-09-15T23:05:35.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.717+0000 7f17c1d9b640 1 --2- 172.21.15.2:0/2492791862 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f17b0039200 0x7f17b003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:35.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.718+0000 7f17c1d9b640 1 --2- 172.21.15.2:0/2492791862 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f17b0039200 0x7f17b003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0098c0 tx=0x7f17ac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:35.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.722+0000 7f17bb7fe640 1 -- 172.21.15.2:0/2492791862 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17b40392f0 con 0x7f17c4107a20 2024-09-15T23:05:35.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.898+0000 7f17c8c13640 1 -- 172.21.15.2:0/2492791862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f17c402dab0 con 0x7f17c4107a20 2024-09-15T23:05:35.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.900+0000 7f17bb7fe640 1 -- 172.21.15.2:0/2492791862 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v7)=0 v7) ==== 130+0+0 (secure 0 0 0) 0x7f17b4040210 con 0x7f17c4107a20 2024-09-15T23:05:35.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.903+0000 7f17c8c13640 1 -- 172.21.15.2:0/2492791862 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f17b0039200 msgr2=0x7f17b003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:35.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.903+0000 7f17c8c13640 1 --2- 172.21.15.2:0/2492791862 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f17b0039200 0x7f17b003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0098c0 tx=0x7f17ac006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:35.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.903+0000 7f17c8c13640 1 -- 172.21.15.2:0/2492791862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 msgr2=0x7f17c419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:35.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.903+0000 7f17c8c13640 1 --2- 172.21.15.2:0/2492791862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 0x7f17c419d6a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f17b40097f0 tx=0x7f17b4030d00 comp rx=0 tx=0).stop 2024-09-15T23:05:35.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.903+0000 7f17c8c13640 1 -- 172.21.15.2:0/2492791862 shutdown_connections 2024-09-15T23:05:35.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.903+0000 7f17c8c13640 1 --2- 172.21.15.2:0/2492791862 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f17b0039200 0x7f17b003b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:35.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.903+0000 7f17c8c13640 1 --2- 172.21.15.2:0/2492791862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17c4107a20 0x7f17c419d6a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:35.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.903+0000 7f17c8c13640 1 -- 172.21.15.2:0/2492791862 >> 172.21.15.2:0/2492791862 conn(0x7f17c4101290 msgr2=0x7f17c4194150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:35.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.903+0000 7f17c8c13640 1 -- 172.21.15.2:0/2492791862 shutdown_connections 2024-09-15T23:05:35.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:33.903+0000 7f17c8c13640 1 -- 172.21.15.2:0/2492791862 wait complete. 2024-09-15T23:05:35.025 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling the dashboard module... 2024-09-15T23:05:36.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:36 smithi002 ceph-mon[31019]: from='mgr.14118 172.21.15.2:0/1464205388' entity='mgr.x' 2024-09-15T23:05:36.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:36 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1794086191' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-15T23:05:36.601 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:36 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: ignoring --setuser ceph since I am not root 2024-09-15T23:05:36.601 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:36 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: ignoring --setgroup ceph since I am not root 2024-09-15T23:05:36.601 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:36 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:36.490+0000 7f16087db040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:05:36.601 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:36 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:36.550+0000 7f16087db040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:05:36.936 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:36 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:36.711+0000 7f16087db040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:05:36.937 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:36 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:36.780+0000 7f16087db040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:05:36.937 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:36 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:36.935+0000 7f16087db040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:05:36.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.472+0000 7f0e441c7640 1 Processor -- start 2024-09-15T23:05:36.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.473+0000 7f0e441c7640 1 -- start start 2024-09-15T23:05:36.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.473+0000 7f0e441c7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 0x7f0e3c106800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:36.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.473+0000 7f0e441c7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c106dd0 con 0x7f0e3c106400 2024-09-15T23:05:36.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.473+0000 7f0e41f63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 0x7f0e3c106800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:36.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.473+0000 7f0e41f63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 0x7f0e3c106800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43596/0 (socket says 172.21.15.2:43596) 2024-09-15T23:05:36.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.473+0000 7f0e41f63640 1 -- 172.21.15.2:0/1358213560 learned_addr learned my addr 172.21.15.2:0/1358213560 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:36.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.473+0000 7f0e41f63640 1 -- 172.21.15.2:0/1358213560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3c1075b0 con 0x7f0e3c106400 2024-09-15T23:05:36.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.474+0000 7f0e41f63640 1 --2- 172.21.15.2:0/1358213560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 0x7f0e3c106800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800bac0 tx=0x7f0e3802c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcc284ba9a53b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:36.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.474+0000 7f0e40f61640 1 -- 172.21.15.2:0/1358213560 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e380326d0 con 0x7f0e3c106400 2024-09-15T23:05:36.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.474+0000 7f0e40f61640 1 -- 172.21.15.2:0/1358213560 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e38038070 con 0x7f0e3c106400 2024-09-15T23:05:36.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.474+0000 7f0e40f61640 1 -- 172.21.15.2:0/1358213560 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e38033c40 con 0x7f0e3c106400 2024-09-15T23:05:36.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.475+0000 7f0e441c7640 1 -- 172.21.15.2:0/1358213560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 msgr2=0x7f0e3c106800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:36.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.475+0000 7f0e441c7640 1 --2- 172.21.15.2:0/1358213560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 0x7f0e3c106800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800bac0 tx=0x7f0e3802c920 comp rx=0 tx=0).stop 2024-09-15T23:05:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.476+0000 7f0e441c7640 1 -- 172.21.15.2:0/1358213560 shutdown_connections 2024-09-15T23:05:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.476+0000 7f0e441c7640 1 --2- 172.21.15.2:0/1358213560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 0x7f0e3c106800 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.476+0000 7f0e441c7640 1 -- 172.21.15.2:0/1358213560 >> 172.21.15.2:0/1358213560 conn(0x7f0e3c101bb0 msgr2=0x7f0e3c103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.476+0000 7f0e441c7640 1 -- 172.21.15.2:0/1358213560 shutdown_connections 2024-09-15T23:05:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.476+0000 7f0e441c7640 1 -- 172.21.15.2:0/1358213560 wait complete. 2024-09-15T23:05:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.476+0000 7f0e441c7640 1 Processor -- start 2024-09-15T23:05:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.477+0000 7f0e441c7640 1 -- start start 2024-09-15T23:05:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.477+0000 7f0e441c7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 0x7f0e3c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.477+0000 7f0e441c7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c07b100 con 0x7f0e3c106400 2024-09-15T23:05:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.477+0000 7f0e41f63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 0x7f0e3c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.477+0000 7f0e41f63640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 0x7f0e3c1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43612/0 (socket says 172.21.15.2:43612) 2024-09-15T23:05:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.477+0000 7f0e41f63640 1 -- 172.21.15.2:0/1794086191 learned_addr learned my addr 172.21.15.2:0/1794086191 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.477+0000 7f0e41f63640 1 -- 172.21.15.2:0/1794086191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3c1997f0 con 0x7f0e3c106400 2024-09-15T23:05:36.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.477+0000 7f0e41f63640 1 --2- 172.21.15.2:0/1794086191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 0x7f0e3c1992b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e38033950 tx=0x7f0e380327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:36.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.478+0000 7f0e32ffd640 1 -- 172.21.15.2:0/1794086191 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e38042070 con 0x7f0e3c106400 2024-09-15T23:05:36.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.478+0000 7f0e441c7640 1 -- 172.21.15.2:0/1794086191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3c199a80 con 0x7f0e3c106400 2024-09-15T23:05:36.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.478+0000 7f0e32ffd640 1 -- 172.21.15.2:0/1794086191 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e38032d20 con 0x7f0e3c106400 2024-09-15T23:05:36.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.478+0000 7f0e32ffd640 1 -- 172.21.15.2:0/1794086191 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e38045540 con 0x7f0e3c106400 2024-09-15T23:05:36.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.478+0000 7f0e441c7640 1 -- 172.21.15.2:0/1794086191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3c19c770 con 0x7f0e3c106400 2024-09-15T23:05:36.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.479+0000 7f0e32ffd640 1 -- 172.21.15.2:0/1794086191 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f0e3804d060 con 0x7f0e3c106400 2024-09-15T23:05:36.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.479+0000 7f0e441c7640 1 -- 172.21.15.2:0/1794086191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e3c106800 con 0x7f0e3c106400 2024-09-15T23:05:36.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.479+0000 7f0e32ffd640 1 --2- 172.21.15.2:0/1794086191 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f0e280391b0 0x7f0e2803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:36.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.479+0000 7f0e32ffd640 1 -- 172.21.15.2:0/1794086191 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0e38030050 con 0x7f0e3c106400 2024-09-15T23:05:36.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.479+0000 7f0e41762640 1 --2- 172.21.15.2:0/1794086191 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f0e280391b0 0x7f0e2803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:36.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.479+0000 7f0e41762640 1 --2- 172.21.15.2:0/1794086191 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f0e280391b0 0x7f0e2803b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0098c0 tx=0x7f0e2c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:36.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.488+0000 7f0e32ffd640 1 -- 172.21.15.2:0/1794086191 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e38009d10 con 0x7f0e3c106400 2024-09-15T23:05:36.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:35.740+0000 7f0e441c7640 1 -- 172.21.15.2:0/1794086191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f0e3c192720 con 0x7f0e3c106400 2024-09-15T23:05:36.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:36.330+0000 7f0e32ffd640 1 -- 172.21.15.2:0/1794086191 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f0e38046400 con 0x7f0e3c106400 2024-09-15T23:05:36.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:36.332+0000 7f0e32ffd640 1 -- 172.21.15.2:0/1794086191 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f0e38045ce0 con 0x7f0e3c106400 2024-09-15T23:05:36.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:36.333+0000 7f0e441c7640 1 -- 172.21.15.2:0/1794086191 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f0e280391b0 msgr2=0x7f0e2803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:36.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:36.333+0000 7f0e441c7640 1 --2- 172.21.15.2:0/1794086191 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f0e280391b0 0x7f0e2803b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0098c0 tx=0x7f0e2c006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:36.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:36.333+0000 7f0e441c7640 1 -- 172.21.15.2:0/1794086191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 msgr2=0x7f0e3c1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:36.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:36.333+0000 7f0e441c7640 1 --2- 172.21.15.2:0/1794086191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 0x7f0e3c1992b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e38033950 tx=0x7f0e380327d0 comp rx=0 tx=0).stop 2024-09-15T23:05:36.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:36.333+0000 7f0e441c7640 1 -- 172.21.15.2:0/1794086191 shutdown_connections 2024-09-15T23:05:36.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:36.333+0000 7f0e441c7640 1 --2- 172.21.15.2:0/1794086191 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f0e280391b0 0x7f0e2803b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:36.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:36.333+0000 7f0e441c7640 1 --2- 172.21.15.2:0/1794086191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3c106400 0x7f0e3c1992b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:36.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:36.333+0000 7f0e441c7640 1 -- 172.21.15.2:0/1794086191 >> 172.21.15.2:0/1794086191 conn(0x7f0e3c101bb0 msgr2=0x7f0e3c18f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:36.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:36.333+0000 7f0e441c7640 1 -- 172.21.15.2:0/1794086191 shutdown_connections 2024-09-15T23:05:36.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:36.333+0000 7f0e441c7640 1 -- 172.21.15.2:0/1794086191 wait complete. 2024-09-15T23:05:37.222 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:37 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:37.086+0000 7f16087db040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:05:37.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:37 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1794086191' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-15T23:05:37.488 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:37 smithi002 ceph-mon[31019]: mgrmap e9: x(active, since 18s) 2024-09-15T23:05:37.488 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:37 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:37.420+0000 7f16087db040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:05:37.488 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:37 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:37.486+0000 7f16087db040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:05:37.808 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:37 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:37.685+0000 7f16087db040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:05:38.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:05:38.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-15T23:05:38.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T23:05:38.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T23:05:38.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T23:05:38.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:05:38.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.429+0000 7fbf5276e640 1 Processor -- start 2024-09-15T23:05:38.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.429+0000 7fbf5276e640 1 -- start start 2024-09-15T23:05:38.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.429+0000 7fbf5276e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 0x7fbf4c10a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:38.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.429+0000 7fbf5276e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c07be10 con 0x7fbf4c107f70 2024-09-15T23:05:38.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.429+0000 7fbf4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 0x7fbf4c10a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:38.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.429+0000 7fbf4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 0x7fbf4c10a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47604/0 (socket says 172.21.15.2:47604) 2024-09-15T23:05:38.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.429+0000 7fbf4bfff640 1 -- 172.21.15.2:0/2168192605 learned_addr learned my addr 172.21.15.2:0/2168192605 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:38.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.430+0000 7fbf4bfff640 1 -- 172.21.15.2:0/2168192605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4c10a8a0 con 0x7fbf4c107f70 2024-09-15T23:05:38.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.430+0000 7fbf4bfff640 1 --2- 172.21.15.2:0/2168192605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 0x7fbf4c10a360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009820 tx=0x7fbf3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50662d0006915b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:38.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.431+0000 7fbf4affd640 1 -- 172.21.15.2:0/2168192605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c037070 con 0x7fbf4c107f70 2024-09-15T23:05:38.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.431+0000 7fbf4affd640 1 -- 172.21.15.2:0/2168192605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf3c0328f0 con 0x7fbf4c107f70 2024-09-15T23:05:38.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.431+0000 7fbf4affd640 1 -- 172.21.15.2:0/2168192605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c030740 con 0x7fbf4c107f70 2024-09-15T23:05:38.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.431+0000 7fbf5276e640 1 -- 172.21.15.2:0/2168192605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 msgr2=0x7fbf4c10a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:38.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.431+0000 7fbf5276e640 1 --2- 172.21.15.2:0/2168192605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 0x7fbf4c10a360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009820 tx=0x7fbf3c02a270 comp rx=0 tx=0).stop 2024-09-15T23:05:38.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.431+0000 7fbf5276e640 1 -- 172.21.15.2:0/2168192605 shutdown_connections 2024-09-15T23:05:38.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.431+0000 7fbf5276e640 1 --2- 172.21.15.2:0/2168192605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 0x7fbf4c10a360 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:38.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.431+0000 7fbf5276e640 1 -- 172.21.15.2:0/2168192605 >> 172.21.15.2:0/2168192605 conn(0x7fbf4c101bb0 msgr2=0x7fbf4c103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:38.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.431+0000 7fbf5276e640 1 -- 172.21.15.2:0/2168192605 shutdown_connections 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.432+0000 7fbf5276e640 1 -- 172.21.15.2:0/2168192605 wait complete. 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.432+0000 7fbf5276e640 1 Processor -- start 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.432+0000 7fbf5276e640 1 -- start start 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.432+0000 7fbf5276e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 0x7fbf4c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.432+0000 7fbf5276e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c10b8c0 con 0x7fbf4c107f70 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.433+0000 7fbf4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 0x7fbf4c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.433+0000 7fbf4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 0x7fbf4c19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47606/0 (socket says 172.21.15.2:47606) 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.433+0000 7fbf4bfff640 1 -- 172.21.15.2:0/1318499094 learned_addr learned my addr 172.21.15.2:0/1318499094 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.433+0000 7fbf4bfff640 1 -- 172.21.15.2:0/1318499094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4c19dbb0 con 0x7fbf4c107f70 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.433+0000 7fbf4bfff640 1 --2- 172.21.15.2:0/1318499094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 0x7fbf4c19d670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c030cc0 tx=0x7fbf3c030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.433+0000 7fbf497fa640 1 -- 172.21.15.2:0/1318499094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c042070 con 0x7fbf4c107f70 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.433+0000 7fbf497fa640 1 -- 172.21.15.2:0/1318499094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf3c030e60 con 0x7fbf4c107f70 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.433+0000 7fbf5276e640 1 -- 172.21.15.2:0/1318499094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf4c19de40 con 0x7fbf4c107f70 2024-09-15T23:05:38.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.433+0000 7fbf5276e640 1 -- 172.21.15.2:0/1318499094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf4c1a0b30 con 0x7fbf4c107f70 2024-09-15T23:05:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.433+0000 7fbf497fa640 1 -- 172.21.15.2:0/1318499094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c037040 con 0x7fbf4c107f70 2024-09-15T23:05:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.434+0000 7fbf497fa640 1 -- 172.21.15.2:0/1318499094 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fbf3c045070 con 0x7fbf4c107f70 2024-09-15T23:05:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.434+0000 7fbf5276e640 1 -- 172.21.15.2:0/1318499094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf38005290 con 0x7fbf4c107f70 2024-09-15T23:05:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.435+0000 7fbf497fa640 1 --2- 172.21.15.2:0/1318499094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fbf34039260 0x7fbf3403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.435+0000 7fbf497fa640 1 -- 172.21.15.2:0/1318499094 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbf3c06c310 con 0x7fbf4c107f70 2024-09-15T23:05:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.435+0000 7fbf4b7fe640 1 -- 172.21.15.2:0/1318499094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fbf34039260 msgr2=0x7fbf3403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/938645794 2024-09-15T23:05:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.435+0000 7fbf4b7fe640 1 --2- 172.21.15.2:0/1318499094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fbf34039260 0x7fbf3403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:05:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.439+0000 7fbf497fa640 1 -- 172.21.15.2:0/1318499094 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf3c045360 con 0x7fbf4c107f70 2024-09-15T23:05:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.636+0000 7fbf4b7fe640 1 -- 172.21.15.2:0/1318499094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fbf34039260 msgr2=0x7fbf3403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/938645794 2024-09-15T23:05:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.636+0000 7fbf4b7fe640 1 --2- 172.21.15.2:0/1318499094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fbf34039260 0x7fbf3403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:05:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.663+0000 7fbf5276e640 1 -- 172.21.15.2:0/1318499094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fbf38005d90 con 0x7fbf4c107f70 2024-09-15T23:05:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.664+0000 7fbf497fa640 1 -- 172.21.15.2:0/1318499094 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fbf3c02ed90 con 0x7fbf4c107f70 2024-09-15T23:05:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.666+0000 7fbf5276e640 1 -- 172.21.15.2:0/1318499094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fbf34039260 msgr2=0x7fbf3403b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:05:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.666+0000 7fbf5276e640 1 --2- 172.21.15.2:0/1318499094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fbf34039260 0x7fbf3403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.666+0000 7fbf5276e640 1 -- 172.21.15.2:0/1318499094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 msgr2=0x7fbf4c19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.666+0000 7fbf5276e640 1 --2- 172.21.15.2:0/1318499094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 0x7fbf4c19d670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c030cc0 tx=0x7fbf3c030cf0 comp rx=0 tx=0).stop 2024-09-15T23:05:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.666+0000 7fbf5276e640 1 -- 172.21.15.2:0/1318499094 shutdown_connections 2024-09-15T23:05:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.666+0000 7fbf5276e640 1 --2- 172.21.15.2:0/1318499094 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7fbf34039260 0x7fbf3403b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.666+0000 7fbf5276e640 1 --2- 172.21.15.2:0/1318499094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c107f70 0x7fbf4c19d670 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.666+0000 7fbf5276e640 1 -- 172.21.15.2:0/1318499094 >> 172.21.15.2:0/1318499094 conn(0x7fbf4c101bb0 msgr2=0x7fbf4c1026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.666+0000 7fbf5276e640 1 -- 172.21.15.2:0/1318499094 shutdown_connections 2024-09-15T23:05:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:37.666+0000 7fbf5276e640 1 -- 172.21.15.2:0/1318499094 wait complete. 2024-09-15T23:05:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-15T23:05:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 9... 2024-09-15T23:05:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:38 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1318499094' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T23:05:38.917 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:38 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:38.629+0000 7f16087db040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:05:38.917 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:38 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:38.701+0000 7f16087db040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:05:39.574 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:39 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:39.453+0000 7f16087db040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:05:39.574 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:39 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:39.573+0000 7f16087db040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:05:39.943 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:39 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:39.722+0000 7f16087db040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:05:39.943 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:39 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:39.786+0000 7f16087db040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:05:39.943 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:39 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:39.942+0000 7f16087db040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:05:40.242 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:40 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:40.013+0000 7f16087db040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:05:40.242 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:40 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:40.075+0000 7f16087db040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:05:40.242 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:40 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:40.241+0000 7f16087db040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:05:40.527 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:40 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:40.308+0000 7f16087db040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:05:40.527 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:40 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:40.378+0000 7f16087db040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:05:40.527 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:40 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:40.464+0000 7f16087db040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:05:40.527 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:40 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:40.526+0000 7f16087db040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:05:40.808 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:40 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:40.587+0000 7f16087db040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:05:41.682 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:41.414+0000 7f16087db040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:05:41.682 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-mon[31019]: Active manager daemon x restarted 2024-09-15T23:05:41.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-mon[31019]: Activating manager daemon x 2024-09-15T23:05:41.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-mon[31019]: osdmap e3: 0 total, 0 up, 0 in 2024-09-15T23:05:41.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-mon[31019]: mgrmap e10: x(active, starting, since 0.00319925s) 2024-09-15T23:05:41.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:05:41.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T23:05:41.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T23:05:41.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T23:05:41.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T23:05:41.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-mon[31019]: Manager daemon x is now available 2024-09-15T23:05:41.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:05:41.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T23:05:41.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T23:05:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:05:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-15T23:05:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T23:05:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:05:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.710+0000 7f9f06e4d640 1 Processor -- start 2024-09-15T23:05:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.710+0000 7f9f06e4d640 1 -- start start 2024-09-15T23:05:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.710+0000 7f9f06e4d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 0x7f9f00106800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.710+0000 7f9f06e4d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00106dd0 con 0x7f9f00106400 2024-09-15T23:05:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.710+0000 7f9f04be9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 0x7f9f00106800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.710+0000 7f9f04be9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 0x7f9f00106800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47622/0 (socket says 172.21.15.2:47622) 2024-09-15T23:05:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.710+0000 7f9f04be9640 1 -- 172.21.15.2:0/29079464 learned_addr learned my addr 172.21.15.2:0/29079464 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.711+0000 7f9f04be9640 1 -- 172.21.15.2:0/29079464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f001075b0 con 0x7f9f00106400 2024-09-15T23:05:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.711+0000 7f9f04be9640 1 --2- 172.21.15.2:0/29079464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 0x7f9f00106800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009820 tx=0x7f9ef002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac59c6a1429a8b84 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.711+0000 7f9eff7fe640 1 -- 172.21.15.2:0/29079464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef0037070 con 0x7f9f00106400 2024-09-15T23:05:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.711+0000 7f9eff7fe640 1 -- 172.21.15.2:0/29079464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ef00328f0 con 0x7f9f00106400 2024-09-15T23:05:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.711+0000 7f9eff7fe640 1 -- 172.21.15.2:0/29079464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef0030740 con 0x7f9f00106400 2024-09-15T23:05:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.712+0000 7f9f06e4d640 1 -- 172.21.15.2:0/29079464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 msgr2=0x7f9f00106800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.712+0000 7f9f06e4d640 1 --2- 172.21.15.2:0/29079464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 0x7f9f00106800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009820 tx=0x7f9ef002a270 comp rx=0 tx=0).stop 2024-09-15T23:05:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.712+0000 7f9f06e4d640 1 -- 172.21.15.2:0/29079464 shutdown_connections 2024-09-15T23:05:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.712+0000 7f9f06e4d640 1 --2- 172.21.15.2:0/29079464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 0x7f9f00106800 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.712+0000 7f9f06e4d640 1 -- 172.21.15.2:0/29079464 >> 172.21.15.2:0/29079464 conn(0x7f9f00101bb0 msgr2=0x7f9f00103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.712+0000 7f9f06e4d640 1 -- 172.21.15.2:0/29079464 shutdown_connections 2024-09-15T23:05:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.712+0000 7f9f06e4d640 1 -- 172.21.15.2:0/29079464 wait complete. 2024-09-15T23:05:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.713+0000 7f9f06e4d640 1 Processor -- start 2024-09-15T23:05:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.713+0000 7f9f06e4d640 1 -- start start 2024-09-15T23:05:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.713+0000 7f9f06e4d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 0x7f9f0019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.713+0000 7f9f06e4d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0010a960 con 0x7f9f00106400 2024-09-15T23:05:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.713+0000 7f9f04be9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 0x7f9f0019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.713+0000 7f9f04be9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 0x7f9f0019b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47628/0 (socket says 172.21.15.2:47628) 2024-09-15T23:05:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.713+0000 7f9f04be9640 1 -- 172.21.15.2:0/925348645 learned_addr learned my addr 172.21.15.2:0/925348645 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.713+0000 7f9f04be9640 1 -- 172.21.15.2:0/925348645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0019b9f0 con 0x7f9f00106400 2024-09-15T23:05:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.714+0000 7f9f04be9640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 0x7f9f0019b4b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009940 tx=0x7f9ef0030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.714+0000 7f9efdffb640 1 -- 172.21.15.2:0/925348645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef0042070 con 0x7f9f00106400 2024-09-15T23:05:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.714+0000 7f9f06e4d640 1 -- 172.21.15.2:0/925348645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0019bc80 con 0x7f9f00106400 2024-09-15T23:05:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.714+0000 7f9efdffb640 1 -- 172.21.15.2:0/925348645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ef0030e30 con 0x7f9f00106400 2024-09-15T23:05:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.714+0000 7f9efdffb640 1 -- 172.21.15.2:0/925348645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef0037040 con 0x7f9f00106400 2024-09-15T23:05:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.714+0000 7f9f06e4d640 1 -- 172.21.15.2:0/925348645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0019e970 con 0x7f9f00106400 2024-09-15T23:05:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.715+0000 7f9efdffb640 1 -- 172.21.15.2:0/925348645 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f9ef0045070 con 0x7f9f00106400 2024-09-15T23:05:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.715+0000 7f9efdffb640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ee8039200 0x7f9ee803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.715+0000 7f9efdffb640 1 -- 172.21.15.2:0/925348645 --> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9ee803bdd0 con 0x7f9ee8039200 2024-09-15T23:05:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.715+0000 7f9efdffb640 1 -- 172.21.15.2:0/925348645 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9ef006c390 con 0x7f9f00106400 2024-09-15T23:05:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.715+0000 7f9efffff640 1 -- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ee8039200 msgr2=0x7f9ee803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/938645794 2024-09-15T23:05:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.715+0000 7f9efffff640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ee8039200 0x7f9ee803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:05:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.916+0000 7f9efffff640 1 -- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ee8039200 msgr2=0x7f9ee803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/938645794 2024-09-15T23:05:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:38.916+0000 7f9efffff640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ee8039200 0x7f9ee803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:05:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:39.317+0000 7f9efffff640 1 -- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ee8039200 msgr2=0x7f9ee803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/938645794 2024-09-15T23:05:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:39.317+0000 7f9efffff640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ee8039200 0x7f9ee803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T23:05:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:40.118+0000 7f9efffff640 1 -- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ee8039200 msgr2=0x7f9ee803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/938645794 2024-09-15T23:05:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:40.118+0000 7f9efffff640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ee8039200 0x7f9ee803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T23:05:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:41.417+0000 7f9efdffb640 1 -- 172.21.15.2:0/925348645 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f9ef006ae40 con 0x7f9f00106400 2024-09-15T23:05:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:41.417+0000 7f9efdffb640 1 -- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ee8039200 msgr2=0x7f9ee803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:05:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:41.417+0000 7f9efdffb640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ee8039200 0x7f9ee803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.419+0000 7f9efdffb640 1 -- 172.21.15.2:0/925348645 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f9ef003b330 con 0x7f9f00106400 2024-09-15T23:05:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.419+0000 7f9efdffb640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f9ee803ccc0 0x7f9ee803f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.419+0000 7f9efdffb640 1 -- 172.21.15.2:0/925348645 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9ee803bdd0 con 0x7f9ee803ccc0 2024-09-15T23:05:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.419+0000 7f9efffff640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f9ee803ccc0 0x7f9ee803f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.420+0000 7f9efffff640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f9ee803ccc0 0x7f9ee803f0b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4003980 tx=0x7f9ef4006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.421+0000 7f9efdffb640 1 -- 172.21.15.2:0/925348645 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f9ee803bdd0 con 0x7f9ee803ccc0 2024-09-15T23:05:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.428+0000 7f9f06e4d640 1 -- 172.21.15.2:0/925348645 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f9f0010aae0 con 0x7f9ee803ccc0 2024-09-15T23:05:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.428+0000 7f9efdffb640 1 -- 172.21.15.2:0/925348645 <== mgr.14150 v2:172.21.15.2:6800/2564114882 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f9f0010aae0 con 0x7f9ee803ccc0 2024-09-15T23:05:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.428+0000 7f9f06e4d640 1 -- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f9ee803ccc0 msgr2=0x7f9ee803f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.428+0000 7f9f06e4d640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f9ee803ccc0 0x7f9ee803f0b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4003980 tx=0x7f9ef4006e10 comp rx=0 tx=0).stop 2024-09-15T23:05:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.428+0000 7f9f06e4d640 1 -- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 msgr2=0x7f9f0019b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.428+0000 7f9f06e4d640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 0x7f9f0019b4b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009940 tx=0x7f9ef0030cc0 comp rx=0 tx=0).stop 2024-09-15T23:05:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.429+0000 7f9f06e4d640 1 -- 172.21.15.2:0/925348645 shutdown_connections 2024-09-15T23:05:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.429+0000 7f9f06e4d640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f9ee803ccc0 0x7f9ee803f0b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.429+0000 7f9f06e4d640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:6800/938645794,v1:172.21.15.2:6801/938645794] conn(0x7f9ee8039200 0x7f9ee803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.429+0000 7f9f06e4d640 1 --2- 172.21.15.2:0/925348645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f00106400 0x7f9f0019b4b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.429+0000 7f9f06e4d640 1 -- 172.21.15.2:0/925348645 >> 172.21.15.2:0/925348645 conn(0x7f9f00101bb0 msgr2=0x7f9f00102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.429+0000 7f9f06e4d640 1 -- 172.21.15.2:0/925348645 shutdown_connections 2024-09-15T23:05:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:42.429+0000 7f9f06e4d640 1 -- 172.21.15.2:0/925348645 wait complete. 2024-09-15T23:05:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 9 is available 2024-09-15T23:05:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:Generating a dashboard self-signed certificate... 2024-09-15T23:05:43.679 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:43 smithi002 ceph-mon[31019]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T23:05:43.679 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:43 smithi002 ceph-mon[31019]: mgrmap e11: x(active, since 1.006s) 2024-09-15T23:05:43.679 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:43 smithi002 ceph-mon[31019]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T23:05:43.679 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:43 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:44.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:44.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-mon[31019]: mgrmap e12: x(active, since 2s) 2024-09-15T23:05:44.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:44.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:44.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-mon[31019]: [15/Sep/2024:23:05:44] ENGINE Bus STARTING 2024-09-15T23:05:44.809 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:44.509+0000 7f157392f640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:23:05:44] ENGINE Error in HTTPServer.serve 2024-09-15T23:05:44.809 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: Traceback (most recent call last): 2024-09-15T23:05:44.809 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T23:05:44.809 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: self._connections.run(self.expiration_interval) 2024-09-15T23:05:44.809 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T23:05:44.809 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: self._run(expiration_interval) 2024-09-15T23:05:44.809 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T23:05:44.809 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T23:05:44.809 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T23:05:44.809 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T23:05:44.809 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T23:05:44.810 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: s = self.context.wrap_socket( 2024-09-15T23:05:44.810 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T23:05:44.810 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: return self.sslsocket_class._create( 2024-09-15T23:05:44.810 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T23:05:44.810 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: self.do_handshake() 2024-09-15T23:05:44.810 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T23:05:44.810 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: self._sslobj.do_handshake() 2024-09-15T23:05:44.810 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T23:05:44.810 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:05:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:05:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-15T23:05:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.976+0000 7f859c3ce640 1 Processor -- start 2024-09-15T23:05:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.976+0000 7f859c3ce640 1 -- start start 2024-09-15T23:05:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.977+0000 7f859c3ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 0x7f8594106200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.977+0000 7f859c3ce640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f859407bd70 con 0x7f8594105e00 2024-09-15T23:05:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.977+0000 7f859a16a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 0x7f8594106200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.977+0000 7f859a16a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 0x7f8594106200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47722/0 (socket says 172.21.15.2:47722) 2024-09-15T23:05:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.977+0000 7f859a16a640 1 -- 172.21.15.2:0/1083662618 learned_addr learned my addr 172.21.15.2:0/1083662618 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.977+0000 7f859a16a640 1 -- 172.21.15.2:0/1083662618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8594106740 con 0x7f8594105e00 2024-09-15T23:05:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.978+0000 7f859a16a640 1 --2- 172.21.15.2:0/1083662618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 0x7f8594106200 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8590009820 tx=0x7f859002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae3eb4be74a4534 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.978+0000 7f8599168640 1 -- 172.21.15.2:0/1083662618 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8590037070 con 0x7f8594105e00 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.978+0000 7f8599168640 1 -- 172.21.15.2:0/1083662618 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85900328f0 con 0x7f8594105e00 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.978+0000 7f8599168640 1 -- 172.21.15.2:0/1083662618 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8590030740 con 0x7f8594105e00 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.979+0000 7f859c3ce640 1 -- 172.21.15.2:0/1083662618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 msgr2=0x7f8594106200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.979+0000 7f859c3ce640 1 --2- 172.21.15.2:0/1083662618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 0x7f8594106200 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8590009820 tx=0x7f859002a270 comp rx=0 tx=0).stop 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.979+0000 7f859c3ce640 1 -- 172.21.15.2:0/1083662618 shutdown_connections 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.979+0000 7f859c3ce640 1 --2- 172.21.15.2:0/1083662618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 0x7f8594106200 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.979+0000 7f859c3ce640 1 -- 172.21.15.2:0/1083662618 >> 172.21.15.2:0/1083662618 conn(0x7f8594101bb0 msgr2=0x7f8594103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.979+0000 7f859c3ce640 1 -- 172.21.15.2:0/1083662618 shutdown_connections 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.979+0000 7f859c3ce640 1 -- 172.21.15.2:0/1083662618 wait complete. 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.980+0000 7f859c3ce640 1 Processor -- start 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.980+0000 7f859c3ce640 1 -- start start 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.980+0000 7f859c3ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 0x7f859419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.980+0000 7f859c3ce640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8594107820 con 0x7f8594105e00 2024-09-15T23:05:44.873 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.980+0000 7f859a16a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 0x7f859419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.980+0000 7f859a16a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 0x7f859419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47732/0 (socket says 172.21.15.2:47732) 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.980+0000 7f859a16a640 1 -- 172.21.15.2:0/4028048078 learned_addr learned my addr 172.21.15.2:0/4028048078 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.980+0000 7f859a16a640 1 -- 172.21.15.2:0/4028048078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859419db70 con 0x7f8594105e00 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.981+0000 7f859a16a640 1 --2- 172.21.15.2:0/4028048078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 0x7f859419d630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85900097f0 tx=0x7f8590030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.981+0000 7f858b7fe640 1 -- 172.21.15.2:0/4028048078 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8590042070 con 0x7f8594105e00 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.981+0000 7f858b7fe640 1 -- 172.21.15.2:0/4028048078 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8590030d80 con 0x7f8594105e00 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.981+0000 7f858b7fe640 1 -- 172.21.15.2:0/4028048078 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8590037040 con 0x7f8594105e00 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.981+0000 7f859c3ce640 1 -- 172.21.15.2:0/4028048078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859419de00 con 0x7f8594105e00 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.981+0000 7f859c3ce640 1 -- 172.21.15.2:0/4028048078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85941a0af0 con 0x7f8594105e00 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.982+0000 7f858b7fe640 1 -- 172.21.15.2:0/4028048078 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f8590045070 con 0x7f8594105e00 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.982+0000 7f859c3ce640 1 -- 172.21.15.2:0/4028048078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8594106200 con 0x7f8594105e00 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.982+0000 7f858b7fe640 1 --2- 172.21.15.2:0/4028048078 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8580039260 0x7f858003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.982+0000 7f858b7fe640 1 -- 172.21.15.2:0/4028048078 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f859006c440 con 0x7f8594105e00 2024-09-15T23:05:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.982+0000 7f8599969640 1 --2- 172.21.15.2:0/4028048078 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8580039260 0x7f858003b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.983+0000 7f8599969640 1 --2- 172.21.15.2:0/4028048078 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8580039260 0x7f858003b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f85840098c0 tx=0x7f8584006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:43.987+0000 7f858b7fe640 1 -- 172.21.15.2:0/4028048078 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8590045360 con 0x7f8594105e00 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:44.185+0000 7f859c3ce640 1 -- 172.21.15.2:0/4028048078 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f8594062630 con 0x7f8580039260 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:44.227+0000 7f858b7fe640 1 -- 172.21.15.2:0/4028048078 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f8594062630 con 0x7f8580039260 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:44.230+0000 7f859c3ce640 1 -- 172.21.15.2:0/4028048078 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8580039260 msgr2=0x7f858003b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:44.230+0000 7f859c3ce640 1 --2- 172.21.15.2:0/4028048078 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8580039260 0x7f858003b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f85840098c0 tx=0x7f8584006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:44.230+0000 7f859c3ce640 1 -- 172.21.15.2:0/4028048078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 msgr2=0x7f859419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:44.230+0000 7f859c3ce640 1 --2- 172.21.15.2:0/4028048078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 0x7f859419d630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85900097f0 tx=0x7f8590030c70 comp rx=0 tx=0).stop 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:44.230+0000 7f859c3ce640 1 -- 172.21.15.2:0/4028048078 shutdown_connections 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:44.230+0000 7f859c3ce640 1 --2- 172.21.15.2:0/4028048078 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8580039260 0x7f858003b720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:44.230+0000 7f859c3ce640 1 --2- 172.21.15.2:0/4028048078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8594105e00 0x7f859419d630 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:44.230+0000 7f859c3ce640 1 -- 172.21.15.2:0/4028048078 >> 172.21.15.2:0/4028048078 conn(0x7f8594101bb0 msgr2=0x7f8594191a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:44.230+0000 7f859c3ce640 1 -- 172.21.15.2:0/4028048078 shutdown_connections 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:44.230+0000 7f859c3ce640 1 -- 172.21.15.2:0/4028048078 wait complete. 2024-09-15T23:05:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial admin user... 2024-09-15T23:05:45.806 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:45 smithi002 ceph-mon[31019]: [15/Sep/2024:23:05:44] ENGINE Serving on https://172.21.15.2:7150 2024-09-15T23:05:45.806 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:45 smithi002 ceph-mon[31019]: [15/Sep/2024:23:05:44] ENGINE Error in HTTPServer.serve 2024-09-15T23:05:45.806 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-15T23:05:45.807 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T23:05:45.807 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-15T23:05:45.807 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T23:05:45.807 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-15T23:05:45.807 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T23:05:45.807 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T23:05:45.807 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T23:05:45.807 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T23:05:45.807 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T23:05:45.807 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-15T23:05:45.807 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T23:05:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-15T23:05:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T23:05:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-15T23:05:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T23:05:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-15T23:05:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T23:05:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:45 smithi002 ceph-mon[31019]: [15/Sep/2024:23:05:44] ENGINE Serving on http://172.21.15.2:8765 2024-09-15T23:05:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:45 smithi002 ceph-mon[31019]: [15/Sep/2024:23:05:44] ENGINE Bus STARTED 2024-09-15T23:05:46.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$w0g9ykM86BIgYxklDbZYFeIG99Cg56tt0WJMKk0ED.Ac5Brz2glLO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726441545, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-15T23:05:46.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.353+0000 7f10f0461640 1 Processor -- start 2024-09-15T23:05:46.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.354+0000 7f10f0461640 1 -- start start 2024-09-15T23:05:46.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.354+0000 7f10f0461640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 0x7f10e810a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:46.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.354+0000 7f10f0461640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f10e807be00 con 0x7f10e8107f90 2024-09-15T23:05:46.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.354+0000 7f10ee1fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 0x7f10e810a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.354+0000 7f10ee1fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 0x7f10e810a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47736/0 (socket says 172.21.15.2:47736) 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.354+0000 7f10ee1fd640 1 -- 172.21.15.2:0/2834067671 learned_addr learned my addr 172.21.15.2:0/2834067671 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.354+0000 7f10ee1fd640 1 -- 172.21.15.2:0/2834067671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e810a8c0 con 0x7f10e8107f90 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.355+0000 7f10ee1fd640 1 --2- 172.21.15.2:0/2834067671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 0x7f10e810a380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009820 tx=0x7f10e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e856f2e5a833c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.355+0000 7f10ed1fb640 1 -- 172.21.15.2:0/2834067671 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10e4037070 con 0x7f10e8107f90 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.355+0000 7f10ed1fb640 1 -- 172.21.15.2:0/2834067671 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10e40328f0 con 0x7f10e8107f90 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.355+0000 7f10ed1fb640 1 -- 172.21.15.2:0/2834067671 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10e4030740 con 0x7f10e8107f90 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.356+0000 7f10f0461640 1 -- 172.21.15.2:0/2834067671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 msgr2=0x7f10e810a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.356+0000 7f10f0461640 1 --2- 172.21.15.2:0/2834067671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 0x7f10e810a380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009820 tx=0x7f10e402a270 comp rx=0 tx=0).stop 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.356+0000 7f10f0461640 1 -- 172.21.15.2:0/2834067671 shutdown_connections 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.356+0000 7f10f0461640 1 --2- 172.21.15.2:0/2834067671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 0x7f10e810a380 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.356+0000 7f10f0461640 1 -- 172.21.15.2:0/2834067671 >> 172.21.15.2:0/2834067671 conn(0x7f10e8101bd0 msgr2=0x7f10e8103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.356+0000 7f10f0461640 1 -- 172.21.15.2:0/2834067671 shutdown_connections 2024-09-15T23:05:46.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.356+0000 7f10f0461640 1 -- 172.21.15.2:0/2834067671 wait complete. 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.357+0000 7f10f0461640 1 Processor -- start 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.357+0000 7f10f0461640 1 -- start start 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.357+0000 7f10f0461640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 0x7f10e819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.357+0000 7f10f0461640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f10e810b8e0 con 0x7f10e8107f90 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.357+0000 7f10ee1fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 0x7f10e819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.357+0000 7f10ee1fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 0x7f10e819b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47738/0 (socket says 172.21.15.2:47738) 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.357+0000 7f10ee1fd640 1 -- 172.21.15.2:0/241439879 learned_addr learned my addr 172.21.15.2:0/241439879 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.358+0000 7f10ee1fd640 1 -- 172.21.15.2:0/241439879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e819b980 con 0x7f10e8107f90 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.358+0000 7f10ee1fd640 1 --2- 172.21.15.2:0/241439879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 0x7f10e819b440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f10e40097f0 tx=0x7f10e4030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.358+0000 7f10db7fe640 1 -- 172.21.15.2:0/241439879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10e4042070 con 0x7f10e8107f90 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.358+0000 7f10db7fe640 1 -- 172.21.15.2:0/241439879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10e4030d80 con 0x7f10e8107f90 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.358+0000 7f10db7fe640 1 -- 172.21.15.2:0/241439879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10e4037040 con 0x7f10e8107f90 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.358+0000 7f10f0461640 1 -- 172.21.15.2:0/241439879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e819bc10 con 0x7f10e8107f90 2024-09-15T23:05:46.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.358+0000 7f10f0461640 1 -- 172.21.15.2:0/241439879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e819e900 con 0x7f10e8107f90 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.359+0000 7f10db7fe640 1 -- 172.21.15.2:0/241439879 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f10e4045070 con 0x7f10e8107f90 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.359+0000 7f10db7fe640 1 --2- 172.21.15.2:0/241439879 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f10d40392b0 0x7f10d403b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.359+0000 7f10f0461640 1 -- 172.21.15.2:0/241439879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e81083f0 con 0x7f10e8107f90 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.359+0000 7f10db7fe640 1 -- 172.21.15.2:0/241439879 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f10e406c650 con 0x7f10e8107f90 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.359+0000 7f10ed9fc640 1 --2- 172.21.15.2:0/241439879 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f10d40392b0 0x7f10d403b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.360+0000 7f10ed9fc640 1 --2- 172.21.15.2:0/241439879 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f10d40392b0 0x7f10d403b770 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0098c0 tx=0x7f10dc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.364+0000 7f10db7fe640 1 -- 172.21.15.2:0/241439879 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f10e403d770 con 0x7f10e8107f90 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.557+0000 7f10f0461640 1 -- 172.21.15.2:0/241439879 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f10e8102df0 con 0x7f10d40392b0 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.805+0000 7f10db7fe640 1 -- 172.21.15.2:0/241439879 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f10e8102df0 con 0x7f10d40392b0 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.807+0000 7f10f0461640 1 -- 172.21.15.2:0/241439879 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f10d40392b0 msgr2=0x7f10d403b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.807+0000 7f10f0461640 1 --2- 172.21.15.2:0/241439879 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f10d40392b0 0x7f10d403b770 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0098c0 tx=0x7f10dc006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.807+0000 7f10f0461640 1 -- 172.21.15.2:0/241439879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 msgr2=0x7f10e819b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.807+0000 7f10f0461640 1 --2- 172.21.15.2:0/241439879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 0x7f10e819b440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f10e40097f0 tx=0x7f10e4030c70 comp rx=0 tx=0).stop 2024-09-15T23:05:46.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.807+0000 7f10f0461640 1 -- 172.21.15.2:0/241439879 shutdown_connections 2024-09-15T23:05:46.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.807+0000 7f10f0461640 1 --2- 172.21.15.2:0/241439879 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f10d40392b0 0x7f10d403b770 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:46.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.807+0000 7f10f0461640 1 --2- 172.21.15.2:0/241439879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10e8107f90 0x7f10e819b440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:46.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.807+0000 7f10f0461640 1 -- 172.21.15.2:0/241439879 >> 172.21.15.2:0/241439879 conn(0x7f10e8101bd0 msgr2=0x7f10e81026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:46.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.808+0000 7f10f0461640 1 -- 172.21.15.2:0/241439879 shutdown_connections 2024-09-15T23:05:46.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:45.808+0000 7f10f0461640 1 -- 172.21.15.2:0/241439879 wait complete. 2024-09-15T23:05:46.516 INFO:teuthology.orchestra.run.smithi002.stdout:Fetching dashboard port number... 2024-09-15T23:05:47.052 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:46 smithi002 ceph-mon[31019]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:05:47.052 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:46 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:47.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 8443 2024-09-15T23:05:47.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.930+0000 7f28e78c1640 1 Processor -- start 2024-09-15T23:05:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.930+0000 7f28e78c1640 1 -- start start 2024-09-15T23:05:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.930+0000 7f28e78c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 0x7f28e01061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.930+0000 7f28e78c1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f28e007bde0 con 0x7f28e0105da0 2024-09-15T23:05:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.930+0000 7f28e565d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 0x7f28e01061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.930+0000 7f28e565d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 0x7f28e01061a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46898/0 (socket says 172.21.15.2:46898) 2024-09-15T23:05:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.930+0000 7f28e565d640 1 -- 172.21.15.2:0/3491273874 learned_addr learned my addr 172.21.15.2:0/3491273874 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.931+0000 7f28e565d640 1 -- 172.21.15.2:0/3491273874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e01066e0 con 0x7f28e0105da0 2024-09-15T23:05:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.931+0000 7f28e565d640 1 --2- 172.21.15.2:0/3491273874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 0x7f28e01061a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009820 tx=0x7f28dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb649f15c8815dd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.932+0000 7f28d7fff640 1 -- 172.21.15.2:0/3491273874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28dc037070 con 0x7f28e0105da0 2024-09-15T23:05:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.932+0000 7f28d7fff640 1 -- 172.21.15.2:0/3491273874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28dc0328f0 con 0x7f28e0105da0 2024-09-15T23:05:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.932+0000 7f28d7fff640 1 -- 172.21.15.2:0/3491273874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28dc030740 con 0x7f28e0105da0 2024-09-15T23:05:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.932+0000 7f28e78c1640 1 -- 172.21.15.2:0/3491273874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 msgr2=0x7f28e01061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.932+0000 7f28e78c1640 1 --2- 172.21.15.2:0/3491273874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 0x7f28e01061a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009820 tx=0x7f28dc02a270 comp rx=0 tx=0).stop 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.932+0000 7f28e78c1640 1 -- 172.21.15.2:0/3491273874 shutdown_connections 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.932+0000 7f28e78c1640 1 --2- 172.21.15.2:0/3491273874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 0x7f28e01061a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.932+0000 7f28e78c1640 1 -- 172.21.15.2:0/3491273874 >> 172.21.15.2:0/3491273874 conn(0x7f28e0101bd0 msgr2=0x7f28e0103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.932+0000 7f28e78c1640 1 -- 172.21.15.2:0/3491273874 shutdown_connections 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.932+0000 7f28e78c1640 1 -- 172.21.15.2:0/3491273874 wait complete. 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.933+0000 7f28e78c1640 1 Processor -- start 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.933+0000 7f28e78c1640 1 -- start start 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.933+0000 7f28e78c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 0x7f28e019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.933+0000 7f28e78c1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f28e01077c0 con 0x7f28e0105da0 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.933+0000 7f28e565d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 0x7f28e019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.933+0000 7f28e565d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 0x7f28e019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46900/0 (socket says 172.21.15.2:46900) 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.933+0000 7f28e565d640 1 -- 172.21.15.2:0/3940046877 learned_addr learned my addr 172.21.15.2:0/3940046877 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.934+0000 7f28e565d640 1 -- 172.21.15.2:0/3940046877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e019db80 con 0x7f28e0105da0 2024-09-15T23:05:47.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.934+0000 7f28e565d640 1 --2- 172.21.15.2:0/3940046877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 0x7f28e019d640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f28dc030cc0 tx=0x7f28dc030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:47.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.934+0000 7f28d67fc640 1 -- 172.21.15.2:0/3940046877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28dc042070 con 0x7f28e0105da0 2024-09-15T23:05:47.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.934+0000 7f28d67fc640 1 -- 172.21.15.2:0/3940046877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f28dc030e60 con 0x7f28e0105da0 2024-09-15T23:05:47.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.934+0000 7f28d67fc640 1 -- 172.21.15.2:0/3940046877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28dc037040 con 0x7f28e0105da0 2024-09-15T23:05:47.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.934+0000 7f28e78c1640 1 -- 172.21.15.2:0/3940046877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e019de10 con 0x7f28e0105da0 2024-09-15T23:05:47.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.934+0000 7f28e78c1640 1 -- 172.21.15.2:0/3940046877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e01a0b00 con 0x7f28e0105da0 2024-09-15T23:05:47.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.935+0000 7f28d67fc640 1 -- 172.21.15.2:0/3940046877 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f28dc045070 con 0x7f28e0105da0 2024-09-15T23:05:47.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.935+0000 7f28d67fc640 1 --2- 172.21.15.2:0/3940046877 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f28cc039260 0x7f28cc03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:47.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.935+0000 7f28d67fc640 1 -- 172.21.15.2:0/3940046877 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f28dc06c480 con 0x7f28e0105da0 2024-09-15T23:05:47.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.935+0000 7f28e78c1640 1 -- 172.21.15.2:0/3940046877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e01061a0 con 0x7f28e0105da0 2024-09-15T23:05:47.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.935+0000 7f28e4e5c640 1 --2- 172.21.15.2:0/3940046877 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f28cc039260 0x7f28cc03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:47.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.935+0000 7f28e4e5c640 1 --2- 172.21.15.2:0/3940046877 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f28cc039260 0x7f28cc03b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28d00098c0 tx=0x7f28d0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:47.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:46.940+0000 7f28d67fc640 1 -- 172.21.15.2:0/3940046877 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f28dc045360 con 0x7f28e0105da0 2024-09-15T23:05:47.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:47.118+0000 7f28e78c1640 1 -- 172.21.15.2:0/3940046877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f28e002d8e0 con 0x7f28e0105da0 2024-09-15T23:05:47.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:47.119+0000 7f28d67fc640 1 -- 172.21.15.2:0/3940046877 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f28dc02ed90 con 0x7f28e0105da0 2024-09-15T23:05:47.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:47.121+0000 7f28e78c1640 1 -- 172.21.15.2:0/3940046877 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f28cc039260 msgr2=0x7f28cc03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:47.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:47.121+0000 7f28e78c1640 1 --2- 172.21.15.2:0/3940046877 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f28cc039260 0x7f28cc03b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28d00098c0 tx=0x7f28d0006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:47.121+0000 7f28e78c1640 1 -- 172.21.15.2:0/3940046877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 msgr2=0x7f28e019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:47.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:47.121+0000 7f28e78c1640 1 --2- 172.21.15.2:0/3940046877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 0x7f28e019d640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f28dc030cc0 tx=0x7f28dc030cf0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:47.121+0000 7f28e78c1640 1 -- 172.21.15.2:0/3940046877 shutdown_connections 2024-09-15T23:05:47.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:47.121+0000 7f28e78c1640 1 --2- 172.21.15.2:0/3940046877 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f28cc039260 0x7f28cc03b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:47.121+0000 7f28e78c1640 1 --2- 172.21.15.2:0/3940046877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28e0105da0 0x7f28e019d640 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:47.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:47.121+0000 7f28e78c1640 1 -- 172.21.15.2:0/3940046877 >> 172.21.15.2:0/3940046877 conn(0x7f28e0101bd0 msgr2=0x7f28e0194300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:47.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:47.121+0000 7f28e78c1640 1 -- 172.21.15.2:0/3940046877 shutdown_connections 2024-09-15T23:05:47.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:47.121+0000 7f28e78c1640 1 -- 172.21.15.2:0/3940046877 wait complete. 2024-09-15T23:05:47.789 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T23:05:47.789 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-15T23:05:47.797 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T23:05:47.797 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-15T23:05:47.797 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-15T23:05:47.798 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-15T23:05:47.800 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph Dashboard is now available at: 2024-09-15T23:05:47.800 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:05:47.800 INFO:teuthology.orchestra.run.smithi002.stdout: URL: https://smithi002.front.sepia.ceph.com:8443/ 2024-09-15T23:05:47.800 INFO:teuthology.orchestra.run.smithi002.stdout: User: admin 2024-09-15T23:05:47.800 INFO:teuthology.orchestra.run.smithi002.stdout: Password: crlely26oe 2024-09-15T23:05:47.800 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:05:47.800 INFO:teuthology.orchestra.run.smithi002.stdout:Saving cluster configuration to /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config directory 2024-09-15T23:05:48.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:47 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3940046877' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-15T23:05:49.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:48 smithi002 ceph-mon[31019]: mgrmap e13: x(active, since 6s) 2024-09-15T23:05:49.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:48 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2319896355' entity='client.admin' 2024-09-15T23:05:49.279 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.224+0000 7fa837fa9640 1 Processor -- start 2024-09-15T23:05:49.279 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.224+0000 7fa837fa9640 1 -- start start 2024-09-15T23:05:49.279 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.225+0000 7fa837fa9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 0x7fa8301078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:49.279 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.225+0000 7fa837fa9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa830107e90 con 0x7fa8301074c0 2024-09-15T23:05:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.225+0000 7fa835d45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 0x7fa8301078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.225+0000 7fa835d45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 0x7fa8301078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46906/0 (socket says 172.21.15.2:46906) 2024-09-15T23:05:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.225+0000 7fa835d45640 1 -- 172.21.15.2:0/533484835 learned_addr learned my addr 172.21.15.2:0/533484835 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.225+0000 7fa835d45640 1 -- 172.21.15.2:0/533484835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8301086c0 con 0x7fa8301074c0 2024-09-15T23:05:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.226+0000 7fa835d45640 1 --2- 172.21.15.2:0/533484835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 0x7fa8301078c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009820 tx=0x7fa82c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1067968e3ffcc32c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.226+0000 7fa834d43640 1 -- 172.21.15.2:0/533484835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa82c037070 con 0x7fa8301074c0 2024-09-15T23:05:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.226+0000 7fa834d43640 1 -- 172.21.15.2:0/533484835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa82c0328f0 con 0x7fa8301074c0 2024-09-15T23:05:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.226+0000 7fa834d43640 1 -- 172.21.15.2:0/533484835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa82c030740 con 0x7fa8301074c0 2024-09-15T23:05:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.227+0000 7fa837fa9640 1 -- 172.21.15.2:0/533484835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 msgr2=0x7fa8301078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.227+0000 7fa837fa9640 1 --2- 172.21.15.2:0/533484835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 0x7fa8301078c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009820 tx=0x7fa82c02a270 comp rx=0 tx=0).stop 2024-09-15T23:05:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.227+0000 7fa837fa9640 1 -- 172.21.15.2:0/533484835 shutdown_connections 2024-09-15T23:05:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.227+0000 7fa837fa9640 1 --2- 172.21.15.2:0/533484835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 0x7fa8301078c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:49.280 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.227+0000 7fa837fa9640 1 -- 172.21.15.2:0/533484835 >> 172.21.15.2:0/533484835 conn(0x7fa830102c70 msgr2=0x7fa830105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:49.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.227+0000 7fa837fa9640 1 -- 172.21.15.2:0/533484835 shutdown_connections 2024-09-15T23:05:49.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.227+0000 7fa837fa9640 1 -- 172.21.15.2:0/533484835 wait complete. 2024-09-15T23:05:49.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.227+0000 7fa837fa9640 1 Processor -- start 2024-09-15T23:05:49.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.228+0000 7fa837fa9640 1 -- start start 2024-09-15T23:05:49.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.228+0000 7fa837fa9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 0x7fa83019b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:49.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.228+0000 7fa837fa9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa83010ba70 con 0x7fa8301074c0 2024-09-15T23:05:49.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.228+0000 7fa835d45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 0x7fa83019b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:49.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.228+0000 7fa835d45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 0x7fa83019b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46922/0 (socket says 172.21.15.2:46922) 2024-09-15T23:05:49.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.228+0000 7fa835d45640 1 -- 172.21.15.2:0/2319896355 learned_addr learned my addr 172.21.15.2:0/2319896355 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:49.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.228+0000 7fa835d45640 1 -- 172.21.15.2:0/2319896355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83019ba70 con 0x7fa8301074c0 2024-09-15T23:05:49.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.228+0000 7fa835d45640 1 --2- 172.21.15.2:0/2319896355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 0x7fa83019b530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0097f0 tx=0x7fa82c030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:49.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.229+0000 7fa826ffd640 1 -- 172.21.15.2:0/2319896355 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa82c042070 con 0x7fa8301074c0 2024-09-15T23:05:49.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.229+0000 7fa826ffd640 1 -- 172.21.15.2:0/2319896355 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa82c030d80 con 0x7fa8301074c0 2024-09-15T23:05:49.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.229+0000 7fa837fa9640 1 -- 172.21.15.2:0/2319896355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83019bd00 con 0x7fa8301074c0 2024-09-15T23:05:49.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.229+0000 7fa826ffd640 1 -- 172.21.15.2:0/2319896355 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa82c037040 con 0x7fa8301074c0 2024-09-15T23:05:49.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.229+0000 7fa837fa9640 1 -- 172.21.15.2:0/2319896355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83019e9f0 con 0x7fa8301074c0 2024-09-15T23:05:49.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.230+0000 7fa826ffd640 1 -- 172.21.15.2:0/2319896355 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fa82c045070 con 0x7fa8301074c0 2024-09-15T23:05:49.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.230+0000 7fa826ffd640 1 --2- 172.21.15.2:0/2319896355 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa81c039300 0x7fa81c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:49.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.230+0000 7fa837fa9640 1 -- 172.21.15.2:0/2319896355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83010bbf0 con 0x7fa8301074c0 2024-09-15T23:05:49.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.230+0000 7fa826ffd640 1 -- 172.21.15.2:0/2319896355 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa82c06c4b0 con 0x7fa8301074c0 2024-09-15T23:05:49.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.230+0000 7fa835544640 1 --2- 172.21.15.2:0/2319896355 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa81c039300 0x7fa81c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:49.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.230+0000 7fa835544640 1 --2- 172.21.15.2:0/2319896355 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa81c039300 0x7fa81c03b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa8200098c0 tx=0x7fa820006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:49.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.235+0000 7fa826ffd640 1 -- 172.21.15.2:0/2319896355 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa82c045360 con 0x7fa8301074c0 2024-09-15T23:05:49.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.500+0000 7fa837fa9640 1 -- 172.21.15.2:0/2319896355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fa83019ebc0 con 0x7fa8301074c0 2024-09-15T23:05:49.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.502+0000 7fa826ffd640 1 -- 172.21.15.2:0/2319896355 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v26)=0 set mgr/dashboard/cluster/status v26) ==== 153+0+0 (secure 0 0 0) 0x7fa82c02ed70 con 0x7fa8301074c0 2024-09-15T23:05:49.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-15T23:05:49.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.504+0000 7fa837fa9640 1 -- 172.21.15.2:0/2319896355 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa81c039300 msgr2=0x7fa81c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:49.284 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.504+0000 7fa837fa9640 1 --2- 172.21.15.2:0/2319896355 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa81c039300 0x7fa81c03b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa8200098c0 tx=0x7fa820006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:49.284 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.504+0000 7fa837fa9640 1 -- 172.21.15.2:0/2319896355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 msgr2=0x7fa83019b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:49.284 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.504+0000 7fa837fa9640 1 --2- 172.21.15.2:0/2319896355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 0x7fa83019b530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0097f0 tx=0x7fa82c030c70 comp rx=0 tx=0).stop 2024-09-15T23:05:49.284 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.504+0000 7fa837fa9640 1 -- 172.21.15.2:0/2319896355 shutdown_connections 2024-09-15T23:05:49.284 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.504+0000 7fa837fa9640 1 --2- 172.21.15.2:0/2319896355 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa81c039300 0x7fa81c03b7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:49.284 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.504+0000 7fa837fa9640 1 --2- 172.21.15.2:0/2319896355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8301074c0 0x7fa83019b530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:49.284 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.504+0000 7fa837fa9640 1 -- 172.21.15.2:0/2319896355 >> 172.21.15.2:0/2319896355 conn(0x7fa830102c70 msgr2=0x7fa8301037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:49.284 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.505+0000 7fa837fa9640 1 -- 172.21.15.2:0/2319896355 shutdown_connections 2024-09-15T23:05:49.284 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-15T23:05:48.505+0000 7fa837fa9640 1 -- 172.21.15.2:0/2319896355 wait complete. 2024-09-15T23:05:49.284 INFO:teuthology.orchestra.run.smithi002.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-15T23:05:49.284 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:05:49.284 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:05:49.285 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:05:49.285 INFO:teuthology.orchestra.run.smithi002.stdout:Or, if you are only running a single cluster on this host: 2024-09-15T23:05:49.285 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:05:49.285 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-15T23:05:49.285 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:05:49.285 INFO:teuthology.orchestra.run.smithi002.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-15T23:05:49.285 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:05:49.285 INFO:teuthology.orchestra.run.smithi002.stdout: ceph telemetry on 2024-09-15T23:05:49.285 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:05:49.285 INFO:teuthology.orchestra.run.smithi002.stdout:For more information see: 2024-09-15T23:05:49.285 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:05:49.285 INFO:teuthology.orchestra.run.smithi002.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-15T23:05:49.285 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:05:49.286 INFO:teuthology.orchestra.run.smithi002.stdout:Bootstrap complete. 2024-09-15T23:05:49.327 INFO:tasks.cephadm:Fetching config... 2024-09-15T23:05:49.327 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:05:49.327 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-15T23:05:49.345 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-15T23:05:49.345 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:05:49.345 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-15T23:05:49.404 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-15T23:05:49.404 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:05:49.404 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-15T23:05:49.472 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-15T23:05:49.472 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:05:49.472 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-15T23:05:49.528 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-15T23:05:49.529 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmho5faxLiHagNeQO/YpMWOGFy73N87TcSCY9CVEz7KViM+6SbqNbZ4wt5Vyq6QYg0Bh8i0T6762PKNKwhJoWlBn9iWHXcvcUiN6Jmrg2YvPKB/IS9V82/Awa6EjxE25D7O9wzD92yDjFcqQytT9HrTJ5a0vQTaqozyQwHkcLKMFi7aEfoMbbT1qkYeUC4lfBEgJd+rIDZYNAMylILRUbYsypQx0ghurMawh/ZkPbgzXrJWZeXmk5dXjTfh50Zh6WQRcN6NRrMMWKRoyxu8mW8botWt1FtQZCczcK4V4aIpFhENmZ8DSFyyoT4kcoCS70A6LA/mi+dFS4nXmQ6wubud120iE+n6bliMpRu7hCwC25K+hizOaXcwHwcQ/AngeLrn7TbujXvinxWxzqJ+zDlQbwY9fkmenWceymucs1NskA/lDlVhcy7rgVhnaGlXqEmUKJjWqj2cA2OjDoJ75iZ+uvK0EKBQ6OocnsyTZHF3RqNrxbgn2Ni+RW9PuEyfVU= ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T23:05:49.606 INFO:teuthology.orchestra.run.smithi002.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmho5faxLiHagNeQO/YpMWOGFy73N87TcSCY9CVEz7KViM+6SbqNbZ4wt5Vyq6QYg0Bh8i0T6762PKNKwhJoWlBn9iWHXcvcUiN6Jmrg2YvPKB/IS9V82/Awa6EjxE25D7O9wzD92yDjFcqQytT9HrTJ5a0vQTaqozyQwHkcLKMFi7aEfoMbbT1qkYeUC4lfBEgJd+rIDZYNAMylILRUbYsypQx0ghurMawh/ZkPbgzXrJWZeXmk5dXjTfh50Zh6WQRcN6NRrMMWKRoyxu8mW8botWt1FtQZCczcK4V4aIpFhENmZ8DSFyyoT4kcoCS70A6LA/mi+dFS4nXmQ6wubud120iE+n6bliMpRu7hCwC25K+hizOaXcwHwcQ/AngeLrn7TbujXvinxWxzqJ+zDlQbwY9fkmenWceymucs1NskA/lDlVhcy7rgVhnaGlXqEmUKJjWqj2cA2OjDoJ75iZ+uvK0EKBQ6OocnsyTZHF3RqNrxbgn2Ni+RW9PuEyfVU= ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:05:49.618 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmho5faxLiHagNeQO/YpMWOGFy73N87TcSCY9CVEz7KViM+6SbqNbZ4wt5Vyq6QYg0Bh8i0T6762PKNKwhJoWlBn9iWHXcvcUiN6Jmrg2YvPKB/IS9V82/Awa6EjxE25D7O9wzD92yDjFcqQytT9HrTJ5a0vQTaqozyQwHkcLKMFi7aEfoMbbT1qkYeUC4lfBEgJd+rIDZYNAMylILRUbYsypQx0ghurMawh/ZkPbgzXrJWZeXmk5dXjTfh50Zh6WQRcN6NRrMMWKRoyxu8mW8botWt1FtQZCczcK4V4aIpFhENmZ8DSFyyoT4kcoCS70A6LA/mi+dFS4nXmQ6wubud120iE+n6bliMpRu7hCwC25K+hizOaXcwHwcQ/AngeLrn7TbujXvinxWxzqJ+zDlQbwY9fkmenWceymucs1NskA/lDlVhcy7rgVhnaGlXqEmUKJjWqj2cA2OjDoJ75iZ+uvK0EKBQ6OocnsyTZHF3RqNrxbgn2Ni+RW9PuEyfVU= ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T23:05:49.719 INFO:teuthology.orchestra.run.smithi112.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmho5faxLiHagNeQO/YpMWOGFy73N87TcSCY9CVEz7KViM+6SbqNbZ4wt5Vyq6QYg0Bh8i0T6762PKNKwhJoWlBn9iWHXcvcUiN6Jmrg2YvPKB/IS9V82/Awa6EjxE25D7O9wzD92yDjFcqQytT9HrTJ5a0vQTaqozyQwHkcLKMFi7aEfoMbbT1qkYeUC4lfBEgJd+rIDZYNAMylILRUbYsypQx0ghurMawh/ZkPbgzXrJWZeXmk5dXjTfh50Zh6WQRcN6NRrMMWKRoyxu8mW8botWt1FtQZCczcK4V4aIpFhENmZ8DSFyyoT4kcoCS70A6LA/mi+dFS4nXmQ6wubud120iE+n6bliMpRu7hCwC25K+hizOaXcwHwcQ/AngeLrn7TbujXvinxWxzqJ+zDlQbwY9fkmenWceymucs1NskA/lDlVhcy7rgVhnaGlXqEmUKJjWqj2cA2OjDoJ75iZ+uvK0EKBQ6OocnsyTZHF3RqNrxbgn2Ni+RW9PuEyfVU= ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:05:49.732 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmho5faxLiHagNeQO/YpMWOGFy73N87TcSCY9CVEz7KViM+6SbqNbZ4wt5Vyq6QYg0Bh8i0T6762PKNKwhJoWlBn9iWHXcvcUiN6Jmrg2YvPKB/IS9V82/Awa6EjxE25D7O9wzD92yDjFcqQytT9HrTJ5a0vQTaqozyQwHkcLKMFi7aEfoMbbT1qkYeUC4lfBEgJd+rIDZYNAMylILRUbYsypQx0ghurMawh/ZkPbgzXrJWZeXmk5dXjTfh50Zh6WQRcN6NRrMMWKRoyxu8mW8botWt1FtQZCczcK4V4aIpFhENmZ8DSFyyoT4kcoCS70A6LA/mi+dFS4nXmQ6wubud120iE+n6bliMpRu7hCwC25K+hizOaXcwHwcQ/AngeLrn7TbujXvinxWxzqJ+zDlQbwY9fkmenWceymucs1NskA/lDlVhcy7rgVhnaGlXqEmUKJjWqj2cA2OjDoJ75iZ+uvK0EKBQ6OocnsyTZHF3RqNrxbgn2Ni+RW9PuEyfVU= ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T23:05:49.785 INFO:teuthology.orchestra.run.smithi145.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmho5faxLiHagNeQO/YpMWOGFy73N87TcSCY9CVEz7KViM+6SbqNbZ4wt5Vyq6QYg0Bh8i0T6762PKNKwhJoWlBn9iWHXcvcUiN6Jmrg2YvPKB/IS9V82/Awa6EjxE25D7O9wzD92yDjFcqQytT9HrTJ5a0vQTaqozyQwHkcLKMFi7aEfoMbbT1qkYeUC4lfBEgJd+rIDZYNAMylILRUbYsypQx0ghurMawh/ZkPbgzXrJWZeXmk5dXjTfh50Zh6WQRcN6NRrMMWKRoyxu8mW8botWt1FtQZCczcK4V4aIpFhENmZ8DSFyyoT4kcoCS70A6LA/mi+dFS4nXmQ6wubud120iE+n6bliMpRu7hCwC25K+hizOaXcwHwcQ/AngeLrn7TbujXvinxWxzqJ+zDlQbwY9fkmenWceymucs1NskA/lDlVhcy7rgVhnaGlXqEmUKJjWqj2cA2OjDoJ75iZ+uvK0EKBQ6OocnsyTZHF3RqNrxbgn2Ni+RW9PuEyfVU= ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:05:49.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-15T23:05:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:50.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.664+0000 7f55930b2640 1 -- 172.21.15.2:0/250567300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f558c100540 msgr2=0x7f558c100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:50.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.664+0000 7f55930b2640 1 --2- 172.21.15.2:0/250567300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f558c100540 0x7f558c100940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5574009880 tx=0x7f557402a5d0 comp rx=0 tx=0).stop 2024-09-15T23:05:50.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.664+0000 7f55930b2640 1 -- 172.21.15.2:0/250567300 shutdown_connections 2024-09-15T23:05:50.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.664+0000 7f55930b2640 1 --2- 172.21.15.2:0/250567300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f558c100540 0x7f558c100940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:50.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.664+0000 7f55930b2640 1 -- 172.21.15.2:0/250567300 >> 172.21.15.2:0/250567300 conn(0x7f558c0fbcd0 msgr2=0x7f558c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:50.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.664+0000 7f55930b2640 1 -- 172.21.15.2:0/250567300 shutdown_connections 2024-09-15T23:05:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.664+0000 7f55930b2640 1 -- 172.21.15.2:0/250567300 wait complete. 2024-09-15T23:05:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.665+0000 7f55930b2640 1 Processor -- start 2024-09-15T23:05:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.665+0000 7f55930b2640 1 -- start start 2024-09-15T23:05:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.665+0000 7f55930b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f558c100540 0x7f558c195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.665+0000 7f55930b2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f558c1064a0 con 0x7f558c100540 2024-09-15T23:05:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.665+0000 7f5590e4e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f558c100540 0x7f558c195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.665+0000 7f5590e4e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f558c100540 0x7f558c195bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46946/0 (socket says 172.21.15.2:46946) 2024-09-15T23:05:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.665+0000 7f5590e4e640 1 -- 172.21.15.2:0/1342543136 learned_addr learned my addr 172.21.15.2:0/1342543136 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.666+0000 7f5590e4e640 1 -- 172.21.15.2:0/1342543136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558c196100 con 0x7f558c100540 2024-09-15T23:05:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.666+0000 7f5590e4e640 1 --2- 172.21.15.2:0/1342543136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f558c100540 0x7f558c195bc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5574009230 tx=0x7f55740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.666+0000 7f5589ffb640 1 -- 172.21.15.2:0/1342543136 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557403f070 con 0x7f558c100540 2024-09-15T23:05:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.666+0000 7f5589ffb640 1 -- 172.21.15.2:0/1342543136 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5574003aa0 con 0x7f558c100540 2024-09-15T23:05:50.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.666+0000 7f55930b2640 1 -- 172.21.15.2:0/1342543136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558c196390 con 0x7f558c100540 2024-09-15T23:05:50.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.666+0000 7f5589ffb640 1 -- 172.21.15.2:0/1342543136 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5574035030 con 0x7f558c100540 2024-09-15T23:05:50.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.666+0000 7f55930b2640 1 -- 172.21.15.2:0/1342543136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f558c199080 con 0x7f558c100540 2024-09-15T23:05:50.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.667+0000 7f5589ffb640 1 -- 172.21.15.2:0/1342543136 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f5574042070 con 0x7f558c100540 2024-09-15T23:05:50.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.667+0000 7f5589ffb640 1 --2- 172.21.15.2:0/1342543136 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f55780392a0 0x7f557803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:50.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.667+0000 7f5589ffb640 1 -- 172.21.15.2:0/1342543136 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f557406d520 con 0x7f558c100540 2024-09-15T23:05:50.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.667+0000 7f558bfff640 1 --2- 172.21.15.2:0/1342543136 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f55780392a0 0x7f557803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:50.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.668+0000 7f55930b2640 1 -- 172.21.15.2:0/1342543136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f558c106c20 con 0x7f558c100540 2024-09-15T23:05:50.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.668+0000 7f558bfff640 1 --2- 172.21.15.2:0/1342543136 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f55780392a0 0x7f557803b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f557c00ad30 tx=0x7f557c0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:50.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.672+0000 7f5589ffb640 1 -- 172.21.15.2:0/1342543136 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f557402fdc0 con 0x7f558c100540 2024-09-15T23:05:50.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.875+0000 7f55930b2640 1 -- 172.21.15.2:0/1342543136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f558c18ecd0 con 0x7f558c100540 2024-09-15T23:05:50.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.878+0000 7f5589ffb640 1 -- 172.21.15.2:0/1342543136 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f557403b980 con 0x7f558c100540 2024-09-15T23:05:50.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.880+0000 7f55930b2640 1 -- 172.21.15.2:0/1342543136 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f55780392a0 msgr2=0x7f557803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:50.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.880+0000 7f55930b2640 1 --2- 172.21.15.2:0/1342543136 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f55780392a0 0x7f557803b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f557c00ad30 tx=0x7f557c0093f0 comp rx=0 tx=0).stop 2024-09-15T23:05:50.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.880+0000 7f55930b2640 1 -- 172.21.15.2:0/1342543136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f558c100540 msgr2=0x7f558c195bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:50.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.880+0000 7f55930b2640 1 --2- 172.21.15.2:0/1342543136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f558c100540 0x7f558c195bc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5574009230 tx=0x7f55740048f0 comp rx=0 tx=0).stop 2024-09-15T23:05:50.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.880+0000 7f55930b2640 1 -- 172.21.15.2:0/1342543136 shutdown_connections 2024-09-15T23:05:50.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.880+0000 7f55930b2640 1 --2- 172.21.15.2:0/1342543136 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f55780392a0 0x7f557803b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:50.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.880+0000 7f55930b2640 1 --2- 172.21.15.2:0/1342543136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f558c100540 0x7f558c195bc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:50.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.880+0000 7f55930b2640 1 -- 172.21.15.2:0/1342543136 >> 172.21.15.2:0/1342543136 conn(0x7f558c0fbcd0 msgr2=0x7f558c0fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:50.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.880+0000 7f55930b2640 1 -- 172.21.15.2:0/1342543136 shutdown_connections 2024-09-15T23:05:50.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:50.880+0000 7f55930b2640 1 -- 172.21.15.2:0/1342543136 wait complete. 2024-09-15T23:05:51.493 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-15T23:05:51.494 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-15T23:05:52.076 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:52.194 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:51 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1342543136' entity='client.admin' 2024-09-15T23:05:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.483+0000 7f0cc54ad640 1 -- 172.21.15.2:0/3627499362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cc0101600 msgr2=0x7f0cc0101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.483+0000 7f0cc54ad640 1 --2- 172.21.15.2:0/3627499362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cc0101600 0x7f0cc0101a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009880 tx=0x7f0cb002a5d0 comp rx=0 tx=0).stop 2024-09-15T23:05:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.483+0000 7f0cc54ad640 1 -- 172.21.15.2:0/3627499362 shutdown_connections 2024-09-15T23:05:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.483+0000 7f0cc54ad640 1 --2- 172.21.15.2:0/3627499362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cc0101600 0x7f0cc0101a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.483+0000 7f0cc54ad640 1 -- 172.21.15.2:0/3627499362 >> 172.21.15.2:0/3627499362 conn(0x7f0cc00fcdb0 msgr2=0x7f0cc00ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.483+0000 7f0cc54ad640 1 -- 172.21.15.2:0/3627499362 shutdown_connections 2024-09-15T23:05:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.483+0000 7f0cc54ad640 1 -- 172.21.15.2:0/3627499362 wait complete. 2024-09-15T23:05:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.484+0000 7f0cc54ad640 1 Processor -- start 2024-09-15T23:05:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.484+0000 7f0cc54ad640 1 -- start start 2024-09-15T23:05:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.484+0000 7f0cc54ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cc0101600 0x7f0cc0075eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.484+0000 7f0cc54ad640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc01075c0 con 0x7f0cc0101600 2024-09-15T23:05:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.484+0000 7f0cbeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cc0101600 0x7f0cc0075eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.484+0000 7f0cbeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cc0101600 0x7f0cc0075eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46954/0 (socket says 172.21.15.2:46954) 2024-09-15T23:05:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.484+0000 7f0cbeffd640 1 -- 172.21.15.2:0/2354935555 learned_addr learned my addr 172.21.15.2:0/2354935555 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.484+0000 7f0cbeffd640 1 -- 172.21.15.2:0/2354935555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc00763f0 con 0x7f0cc0101600 2024-09-15T23:05:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.485+0000 7f0cbeffd640 1 --2- 172.21.15.2:0/2354935555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cc0101600 0x7f0cc0075eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0005ab0 tx=0x7f0cb00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.485+0000 7f0cbcff9640 1 -- 172.21.15.2:0/2354935555 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb003f070 con 0x7f0cc0101600 2024-09-15T23:05:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.485+0000 7f0cbcff9640 1 -- 172.21.15.2:0/2354935555 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0cb0003aa0 con 0x7f0cc0101600 2024-09-15T23:05:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.485+0000 7f0cc54ad640 1 -- 172.21.15.2:0/2354935555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc00745e0 con 0x7f0cc0101600 2024-09-15T23:05:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.485+0000 7f0cbcff9640 1 -- 172.21.15.2:0/2354935555 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb0035030 con 0x7f0cc0101600 2024-09-15T23:05:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.485+0000 7f0cc54ad640 1 -- 172.21.15.2:0/2354935555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc0074b20 con 0x7f0cc0101600 2024-09-15T23:05:52.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.486+0000 7f0cbcff9640 1 -- 172.21.15.2:0/2354935555 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f0cb0042070 con 0x7f0cc0101600 2024-09-15T23:05:52.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.486+0000 7f0cc54ad640 1 -- 172.21.15.2:0/2354935555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc0107d40 con 0x7f0cc0101600 2024-09-15T23:05:52.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.486+0000 7f0cbcff9640 1 --2- 172.21.15.2:0/2354935555 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0cac0392a0 0x7f0cac03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:52.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.486+0000 7f0cbcff9640 1 -- 172.21.15.2:0/2354935555 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0cb006cf80 con 0x7f0cc0101600 2024-09-15T23:05:52.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.486+0000 7f0cb67fc640 1 --2- 172.21.15.2:0/2354935555 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0cac0392a0 0x7f0cac03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:52.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.487+0000 7f0cb67fc640 1 --2- 172.21.15.2:0/2354935555 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0cac0392a0 0x7f0cac03b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80098c0 tx=0x7f0ca8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:52.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.491+0000 7f0cbcff9640 1 -- 172.21.15.2:0/2354935555 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0cb00372d0 con 0x7f0cc0101600 2024-09-15T23:05:52.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.673+0000 7f0cc54ad640 1 -- 172.21.15.2:0/2354935555 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f0cc0190060 con 0x7f0cac0392a0 2024-09-15T23:05:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.676+0000 7f0cbcff9640 1 -- 172.21.15.2:0/2354935555 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0cc0190060 con 0x7f0cac0392a0 2024-09-15T23:05:52.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.678+0000 7f0cc54ad640 1 -- 172.21.15.2:0/2354935555 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0cac0392a0 msgr2=0x7f0cac03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.678+0000 7f0cc54ad640 1 --2- 172.21.15.2:0/2354935555 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0cac0392a0 0x7f0cac03b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80098c0 tx=0x7f0ca8006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.678+0000 7f0cc54ad640 1 -- 172.21.15.2:0/2354935555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cc0101600 msgr2=0x7f0cc0075eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.678+0000 7f0cc54ad640 1 --2- 172.21.15.2:0/2354935555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cc0101600 0x7f0cc0075eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0005ab0 tx=0x7f0cb00048f0 comp rx=0 tx=0).stop 2024-09-15T23:05:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.678+0000 7f0cc54ad640 1 -- 172.21.15.2:0/2354935555 shutdown_connections 2024-09-15T23:05:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.678+0000 7f0cc54ad640 1 --2- 172.21.15.2:0/2354935555 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0cac0392a0 0x7f0cac03b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.678+0000 7f0cc54ad640 1 --2- 172.21.15.2:0/2354935555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cc0101600 0x7f0cc0075eb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.678+0000 7f0cc54ad640 1 -- 172.21.15.2:0/2354935555 >> 172.21.15.2:0/2354935555 conn(0x7f0cc00fcdb0 msgr2=0x7f0cc00fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.678+0000 7f0cc54ad640 1 -- 172.21.15.2:0/2354935555 shutdown_connections 2024-09-15T23:05:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:52.678+0000 7f0cc54ad640 1 -- 172.21.15.2:0/2354935555 wait complete. 2024-09-15T23:05:53.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:53.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:53.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:05:53.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:53.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:05:53.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:53.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:53.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:05:53.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:05:53.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:05:53.480 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi112 2024-09-15T23:05:53.481 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:05:53.481 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.conf 2024-09-15T23:05:53.500 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:05:53.501 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:05:53.559 INFO:tasks.cephadm:Adding host smithi112 to orchestrator... 2024-09-15T23:05:53.560 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch host add smithi112 2024-09-15T23:05:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:54.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:53 smithi002 ceph-mon[31019]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:05:54.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:53 smithi002 ceph-mon[31019]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-15T23:05:54.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:53 smithi002 ceph-mon[31019]: Updating smithi002:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:05:54.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:53 smithi002 ceph-mon[31019]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:05:54.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:53 smithi002 ceph-mon[31019]: Updating smithi002:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:05:54.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:53 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:54.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:53 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:54.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:53 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:54.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.265+0000 7fbb47ee4640 1 -- 172.21.15.2:0/14322289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb40106560 msgr2=0x7fbb40106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:54.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.265+0000 7fbb47ee4640 1 --2- 172.21.15.2:0/14322289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb40106560 0x7fbb40106940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009880 tx=0x7fbb3c02a5d0 comp rx=0 tx=0).stop 2024-09-15T23:05:54.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.265+0000 7fbb47ee4640 1 -- 172.21.15.2:0/14322289 shutdown_connections 2024-09-15T23:05:54.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.265+0000 7fbb47ee4640 1 --2- 172.21.15.2:0/14322289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb40106560 0x7fbb40106940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:54.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.265+0000 7fbb47ee4640 1 -- 172.21.15.2:0/14322289 >> 172.21.15.2:0/14322289 conn(0x7fbb400fc1b0 msgr2=0x7fbb400fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:54.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.265+0000 7fbb47ee4640 1 -- 172.21.15.2:0/14322289 shutdown_connections 2024-09-15T23:05:54.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.265+0000 7fbb47ee4640 1 -- 172.21.15.2:0/14322289 wait complete. 2024-09-15T23:05:54.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.266+0000 7fbb47ee4640 1 Processor -- start 2024-09-15T23:05:54.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.266+0000 7fbb47ee4640 1 -- start start 2024-09-15T23:05:54.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.266+0000 7fbb47ee4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb40106560 0x7fbb400fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:54.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.266+0000 7fbb47ee4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4010aa40 con 0x7fbb40106560 2024-09-15T23:05:54.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.266+0000 7fbb45c80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb40106560 0x7fbb400fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:54.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.266+0000 7fbb45c80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb40106560 0x7fbb400fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46974/0 (socket says 172.21.15.2:46974) 2024-09-15T23:05:54.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.266+0000 7fbb45c80640 1 -- 172.21.15.2:0/463729500 learned_addr learned my addr 172.21.15.2:0/463729500 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:54.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.266+0000 7fbb45c80640 1 -- 172.21.15.2:0/463729500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb400fe550 con 0x7fbb40106560 2024-09-15T23:05:54.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.266+0000 7fbb45c80640 1 --2- 172.21.15.2:0/463729500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb40106560 0x7fbb400fc660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009230 tx=0x7fbb3c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:54.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.267+0000 7fbb36ffd640 1 -- 172.21.15.2:0/463729500 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb3c03f070 con 0x7fbb40106560 2024-09-15T23:05:54.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.267+0000 7fbb36ffd640 1 -- 172.21.15.2:0/463729500 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbb3c003aa0 con 0x7fbb40106560 2024-09-15T23:05:54.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.267+0000 7fbb36ffd640 1 -- 172.21.15.2:0/463729500 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb3c035030 con 0x7fbb40106560 2024-09-15T23:05:54.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.267+0000 7fbb47ee4640 1 -- 172.21.15.2:0/463729500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb400fcba0 con 0x7fbb40106560 2024-09-15T23:05:54.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.267+0000 7fbb47ee4640 1 -- 172.21.15.2:0/463729500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb400fd060 con 0x7fbb40106560 2024-09-15T23:05:54.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.268+0000 7fbb36ffd640 1 -- 172.21.15.2:0/463729500 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fbb3c042070 con 0x7fbb40106560 2024-09-15T23:05:54.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.268+0000 7fbb47ee4640 1 -- 172.21.15.2:0/463729500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb40101bd0 con 0x7fbb40106560 2024-09-15T23:05:54.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.268+0000 7fbb36ffd640 1 --2- 172.21.15.2:0/463729500 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbb2c039300 0x7fbb2c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:54.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.268+0000 7fbb36ffd640 1 -- 172.21.15.2:0/463729500 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbb3c06cee0 con 0x7fbb40106560 2024-09-15T23:05:54.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.268+0000 7fbb4547f640 1 --2- 172.21.15.2:0/463729500 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbb2c039300 0x7fbb2c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:54.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.269+0000 7fbb4547f640 1 --2- 172.21.15.2:0/463729500 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbb2c039300 0x7fbb2c03b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbb300098c0 tx=0x7fbb30006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:54.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.273+0000 7fbb36ffd640 1 -- 172.21.15.2:0/463729500 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb3c04a260 con 0x7fbb40106560 2024-09-15T23:05:54.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:54.450+0000 7fbb47ee4640 1 -- 172.21.15.2:0/463729500 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}) -- 0x7fbb400fdc00 con 0x7fbb2c039300 2024-09-15T23:05:55.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:55 smithi002 ceph-mon[31019]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:05:56.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:56 smithi002 ceph-mon[31019]: Deploying cephadm binary to smithi112 2024-09-15T23:05:58.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:58.424+0000 7fbb36ffd640 1 -- 172.21.15.2:0/463729500 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fbb400fdc00 con 0x7fbb2c039300 2024-09-15T23:05:58.425 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi112' with addr '172.21.15.112' 2024-09-15T23:05:58.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:58.426+0000 7fbb47ee4640 1 -- 172.21.15.2:0/463729500 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbb2c039300 msgr2=0x7fbb2c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:58.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:58.426+0000 7fbb47ee4640 1 --2- 172.21.15.2:0/463729500 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbb2c039300 0x7fbb2c03b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbb300098c0 tx=0x7fbb30006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:58.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:58.426+0000 7fbb47ee4640 1 -- 172.21.15.2:0/463729500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb40106560 msgr2=0x7fbb400fc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:58.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:58.426+0000 7fbb47ee4640 1 --2- 172.21.15.2:0/463729500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb40106560 0x7fbb400fc660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009230 tx=0x7fbb3c0048f0 comp rx=0 tx=0).stop 2024-09-15T23:05:58.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:58.426+0000 7fbb47ee4640 1 -- 172.21.15.2:0/463729500 shutdown_connections 2024-09-15T23:05:58.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:58.426+0000 7fbb47ee4640 1 --2- 172.21.15.2:0/463729500 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbb2c039300 0x7fbb2c03b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:58.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:58.426+0000 7fbb47ee4640 1 --2- 172.21.15.2:0/463729500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb40106560 0x7fbb400fc660 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:58.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:58.426+0000 7fbb47ee4640 1 -- 172.21.15.2:0/463729500 >> 172.21.15.2:0/463729500 conn(0x7fbb400fc1b0 msgr2=0x7fbb40069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:58.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:58.426+0000 7fbb47ee4640 1 -- 172.21.15.2:0/463729500 shutdown_connections 2024-09-15T23:05:58.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:58.426+0000 7fbb47ee4640 1 -- 172.21.15.2:0/463729500 wait complete. 2024-09-15T23:05:59.003 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T23:05:59.254 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:05:59.638 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:59 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:59.638 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:59 smithi002 ceph-mon[31019]: Added host smithi112 2024-09-15T23:05:59.638 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:59 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:05:59.638 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:59 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:59.638 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:05:59 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:05:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.720+0000 7f47f4933640 1 -- 172.21.15.2:0/1052651145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f01027d0 msgr2=0x7f47f0102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.720+0000 7f47f4933640 1 --2- 172.21.15.2:0/1052651145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f01027d0 0x7f47f0102bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009810 tx=0x7f47e002a540 comp rx=0 tx=0).stop 2024-09-15T23:05:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.720+0000 7f47f4933640 1 -- 172.21.15.2:0/1052651145 shutdown_connections 2024-09-15T23:05:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.720+0000 7f47f4933640 1 --2- 172.21.15.2:0/1052651145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f01027d0 0x7f47f0102bb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:59.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.720+0000 7f47f4933640 1 -- 172.21.15.2:0/1052651145 >> 172.21.15.2:0/1052651145 conn(0x7f47f0077310 msgr2=0x7f47f00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.720+0000 7f47f4933640 1 -- 172.21.15.2:0/1052651145 shutdown_connections 2024-09-15T23:05:59.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.720+0000 7f47f4933640 1 -- 172.21.15.2:0/1052651145 wait complete. 2024-09-15T23:05:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.721+0000 7f47f4933640 1 Processor -- start 2024-09-15T23:05:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.721+0000 7f47f4933640 1 -- start start 2024-09-15T23:05:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.721+0000 7f47f4933640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f01027d0 0x7f47f0197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.721+0000 7f47f4933640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f47f010bb30 con 0x7f47f01027d0 2024-09-15T23:05:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.721+0000 7f47ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f01027d0 0x7f47f0197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.721+0000 7f47ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f01027d0 0x7f47f0197060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38226/0 (socket says 172.21.15.2:38226) 2024-09-15T23:05:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.721+0000 7f47ee59c640 1 -- 172.21.15.2:0/140627966 learned_addr learned my addr 172.21.15.2:0/140627966 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:05:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.721+0000 7f47ee59c640 1 -- 172.21.15.2:0/140627966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f01975a0 con 0x7f47f01027d0 2024-09-15T23:05:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.721+0000 7f47ee59c640 1 --2- 172.21.15.2:0/140627966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f01027d0 0x7f47f0197060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f47e0030b00 tx=0x7f47e0030b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:59.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.722+0000 7f47df7fe640 1 -- 172.21.15.2:0/140627966 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e0040070 con 0x7f47f01027d0 2024-09-15T23:05:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.722+0000 7f47f4933640 1 -- 172.21.15.2:0/140627966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f0197830 con 0x7f47f01027d0 2024-09-15T23:05:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.722+0000 7f47df7fe640 1 -- 172.21.15.2:0/140627966 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47e00318b0 con 0x7f47f01027d0 2024-09-15T23:05:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.722+0000 7f47df7fe640 1 -- 172.21.15.2:0/140627966 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47e0003de0 con 0x7f47f01027d0 2024-09-15T23:05:59.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.722+0000 7f47f4933640 1 -- 172.21.15.2:0/140627966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f0197c90 con 0x7f47f01027d0 2024-09-15T23:05:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.723+0000 7f47df7fe640 1 -- 172.21.15.2:0/140627966 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f47e0039040 con 0x7f47f01027d0 2024-09-15T23:05:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.723+0000 7f47f4933640 1 -- 172.21.15.2:0/140627966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f0069ef0 con 0x7f47f01027d0 2024-09-15T23:05:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.723+0000 7f47df7fe640 1 --2- 172.21.15.2:0/140627966 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f47d80392a0 0x7f47d803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:05:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.723+0000 7f47df7fe640 1 -- 172.21.15.2:0/140627966 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f47e006da80 con 0x7f47f01027d0 2024-09-15T23:05:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.723+0000 7f47edd9b640 1 --2- 172.21.15.2:0/140627966 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f47d80392a0 0x7f47d803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:05:59.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.723+0000 7f47edd9b640 1 --2- 172.21.15.2:0/140627966 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f47d80392a0 0x7f47d803b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f47e40098c0 tx=0x7f47e4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:05:59.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.728+0000 7f47df7fe640 1 -- 172.21.15.2:0/140627966 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47e004d350 con 0x7f47f01027d0 2024-09-15T23:05:59.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.910+0000 7f47f4933640 1 -- 172.21.15.2:0/140627966 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47f0198430 con 0x7f47d80392a0 2024-09-15T23:05:59.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.911+0000 7f47df7fe640 1 -- 172.21.15.2:0/140627966 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f47f0198430 con 0x7f47d80392a0 2024-09-15T23:05:59.912 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:05:59.912 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.112", "hostname": "smithi112", "labels": [], "status": ""}] 2024-09-15T23:05:59.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.913+0000 7f47f4933640 1 -- 172.21.15.2:0/140627966 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f47d80392a0 msgr2=0x7f47d803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:59.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.913+0000 7f47f4933640 1 --2- 172.21.15.2:0/140627966 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f47d80392a0 0x7f47d803b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f47e40098c0 tx=0x7f47e4006db0 comp rx=0 tx=0).stop 2024-09-15T23:05:59.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.913+0000 7f47f4933640 1 -- 172.21.15.2:0/140627966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f01027d0 msgr2=0x7f47f0197060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:05:59.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.913+0000 7f47f4933640 1 --2- 172.21.15.2:0/140627966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f01027d0 0x7f47f0197060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f47e0030b00 tx=0x7f47e0030b30 comp rx=0 tx=0).stop 2024-09-15T23:05:59.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.913+0000 7f47f4933640 1 -- 172.21.15.2:0/140627966 shutdown_connections 2024-09-15T23:05:59.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.913+0000 7f47f4933640 1 --2- 172.21.15.2:0/140627966 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f47d80392a0 0x7f47d803b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:59.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.913+0000 7f47f4933640 1 --2- 172.21.15.2:0/140627966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47f01027d0 0x7f47f0197060 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:05:59.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.913+0000 7f47f4933640 1 -- 172.21.15.2:0/140627966 >> 172.21.15.2:0/140627966 conn(0x7f47f0077310 msgr2=0x7f47f0105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:05:59.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.913+0000 7f47f4933640 1 -- 172.21.15.2:0/140627966 shutdown_connections 2024-09-15T23:05:59.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:05:59.913+0000 7f47f4933640 1 -- 172.21.15.2:0/140627966 wait complete. 2024-09-15T23:06:00.521 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi145 2024-09-15T23:06:00.522 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-15T23:06:00.522 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/etc/ceph/ceph.conf 2024-09-15T23:06:00.541 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-15T23:06:00.542 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:06:00.600 INFO:tasks.cephadm:Adding host smithi145 to orchestrator... 2024-09-15T23:06:00.600 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch host add smithi145 2024-09-15T23:06:00.854 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:06:01.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:00 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:01.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:00 smithi002 ceph-mon[31019]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:06:01.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.301+0000 7fc3193e2640 1 -- 172.21.15.2:0/3132587702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141002e0 msgr2=0x7fc3141006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:01.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.301+0000 7fc3193e2640 1 --2- 172.21.15.2:0/3132587702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141002e0 0x7fc3141006c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc304009880 tx=0x7fc30402a5d0 comp rx=0 tx=0).stop 2024-09-15T23:06:01.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.301+0000 7fc3193e2640 1 -- 172.21.15.2:0/3132587702 shutdown_connections 2024-09-15T23:06:01.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.301+0000 7fc3193e2640 1 --2- 172.21.15.2:0/3132587702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141002e0 0x7fc3141006c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:01.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.301+0000 7fc3193e2640 1 -- 172.21.15.2:0/3132587702 >> 172.21.15.2:0/3132587702 conn(0x7fc3140fc1b0 msgr2=0x7fc3140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:01.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.301+0000 7fc3193e2640 1 -- 172.21.15.2:0/3132587702 shutdown_connections 2024-09-15T23:06:01.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.301+0000 7fc3193e2640 1 -- 172.21.15.2:0/3132587702 wait complete. 2024-09-15T23:06:01.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.302+0000 7fc3193e2640 1 Processor -- start 2024-09-15T23:06:01.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.302+0000 7fc3193e2640 1 -- start start 2024-09-15T23:06:01.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.302+0000 7fc3193e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141002e0 0x7fc3141992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:01.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.302+0000 7fc3193e2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc31410dd50 con 0x7fc3141002e0 2024-09-15T23:06:01.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.302+0000 7fc312ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141002e0 0x7fc3141992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:01.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.302+0000 7fc312ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141002e0 0x7fc3141992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38252/0 (socket says 172.21.15.2:38252) 2024-09-15T23:06:01.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.302+0000 7fc312ffd640 1 -- 172.21.15.2:0/1207423100 learned_addr learned my addr 172.21.15.2:0/1207423100 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:06:01.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.303+0000 7fc312ffd640 1 -- 172.21.15.2:0/1207423100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3141997e0 con 0x7fc3141002e0 2024-09-15T23:06:01.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.303+0000 7fc312ffd640 1 --2- 172.21.15.2:0/1207423100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141002e0 0x7fc3141992a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc304009230 tx=0x7fc3040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:01.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.303+0000 7fc2fbfff640 1 -- 172.21.15.2:0/1207423100 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30403f070 con 0x7fc3141002e0 2024-09-15T23:06:01.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.303+0000 7fc2fbfff640 1 -- 172.21.15.2:0/1207423100 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc304003aa0 con 0x7fc3141002e0 2024-09-15T23:06:01.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.303+0000 7fc3193e2640 1 -- 172.21.15.2:0/1207423100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc314199a70 con 0x7fc3141002e0 2024-09-15T23:06:01.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.303+0000 7fc2fbfff640 1 -- 172.21.15.2:0/1207423100 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc304035030 con 0x7fc3141002e0 2024-09-15T23:06:01.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.303+0000 7fc3193e2640 1 -- 172.21.15.2:0/1207423100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc314199ed0 con 0x7fc3141002e0 2024-09-15T23:06:01.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.304+0000 7fc2fbfff640 1 -- 172.21.15.2:0/1207423100 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fc304042070 con 0x7fc3141002e0 2024-09-15T23:06:01.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.304+0000 7fc2fbfff640 1 --2- 172.21.15.2:0/1207423100 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc2fc0392a0 0x7fc2fc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:01.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.304+0000 7fc3193e2640 1 -- 172.21.15.2:0/1207423100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc31406a7b0 con 0x7fc3141002e0 2024-09-15T23:06:01.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.304+0000 7fc2fbfff640 1 -- 172.21.15.2:0/1207423100 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc30406cfd0 con 0x7fc3141002e0 2024-09-15T23:06:01.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.304+0000 7fc3127fc640 1 --2- 172.21.15.2:0/1207423100 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc2fc0392a0 0x7fc2fc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:01.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.305+0000 7fc3127fc640 1 --2- 172.21.15.2:0/1207423100 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc2fc0392a0 0x7fc2fc03b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc3080098c0 tx=0x7fc308006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:01.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.309+0000 7fc2fbfff640 1 -- 172.21.15.2:0/1207423100 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3040433b0 con 0x7fc3141002e0 2024-09-15T23:06:01.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:01.489+0000 7fc3193e2640 1 -- 172.21.15.2:0/1207423100 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi145", "target": ["mon-mgr", ""]}) -- 0x7fc31419a600 con 0x7fc2fc0392a0 2024-09-15T23:06:02.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:02 smithi002 ceph-mon[31019]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:02.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:02 smithi002 ceph-mon[31019]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi145", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:06:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:03.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:03.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-15T23:06:03.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: Deploying cephadm binary to smithi145 2024-09-15T23:06:03.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: Updating smithi112:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:06:03.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:06:03.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: Updating smithi112:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:06:03.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:03.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:03.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:05.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:05.349+0000 7fc2fbfff640 1 -- 172.21.15.2:0/1207423100 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc31419a600 con 0x7fc2fc0392a0 2024-09-15T23:06:05.351 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi145' with addr '172.21.15.145' 2024-09-15T23:06:05.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:05.351+0000 7fc3193e2640 1 -- 172.21.15.2:0/1207423100 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc2fc0392a0 msgr2=0x7fc2fc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:05.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:05.351+0000 7fc3193e2640 1 --2- 172.21.15.2:0/1207423100 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc2fc0392a0 0x7fc2fc03b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc3080098c0 tx=0x7fc308006db0 comp rx=0 tx=0).stop 2024-09-15T23:06:05.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:05.351+0000 7fc3193e2640 1 -- 172.21.15.2:0/1207423100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141002e0 msgr2=0x7fc3141992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:05.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:05.351+0000 7fc3193e2640 1 --2- 172.21.15.2:0/1207423100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141002e0 0x7fc3141992a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc304009230 tx=0x7fc3040048f0 comp rx=0 tx=0).stop 2024-09-15T23:06:05.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:05.351+0000 7fc3193e2640 1 -- 172.21.15.2:0/1207423100 shutdown_connections 2024-09-15T23:06:05.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:05.351+0000 7fc3193e2640 1 --2- 172.21.15.2:0/1207423100 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc2fc0392a0 0x7fc2fc03b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:05.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:05.351+0000 7fc3193e2640 1 --2- 172.21.15.2:0/1207423100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3141002e0 0x7fc3141992a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:05.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:05.351+0000 7fc3193e2640 1 -- 172.21.15.2:0/1207423100 >> 172.21.15.2:0/1207423100 conn(0x7fc3140fc1b0 msgr2=0x7fc3140fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:05.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:05.351+0000 7fc3193e2640 1 -- 172.21.15.2:0/1207423100 shutdown_connections 2024-09-15T23:06:05.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:05.351+0000 7fc3193e2640 1 -- 172.21.15.2:0/1207423100 wait complete. 2024-09-15T23:06:05.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:05 smithi002 ceph-mon[31019]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:05.979 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T23:06:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:06:06.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:06.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:06 smithi002 ceph-mon[31019]: Added host smithi145 2024-09-15T23:06:06.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:06.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:06.676 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:06.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.674+0000 7fcc13351640 1 -- 172.21.15.2:0/4210530445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc0c1002e0 msgr2=0x7fcc0c1006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.674+0000 7fcc13351640 1 --2- 172.21.15.2:0/4210530445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc0c1002e0 0x7fcc0c1006c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009880 tx=0x7fcc0802a5d0 comp rx=0 tx=0).stop 2024-09-15T23:06:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.674+0000 7fcc13351640 1 -- 172.21.15.2:0/4210530445 shutdown_connections 2024-09-15T23:06:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.674+0000 7fcc13351640 1 --2- 172.21.15.2:0/4210530445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc0c1002e0 0x7fcc0c1006c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.674+0000 7fcc13351640 1 -- 172.21.15.2:0/4210530445 >> 172.21.15.2:0/4210530445 conn(0x7fcc0c0fc1b0 msgr2=0x7fcc0c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.675+0000 7fcc13351640 1 -- 172.21.15.2:0/4210530445 shutdown_connections 2024-09-15T23:06:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.675+0000 7fcc13351640 1 -- 172.21.15.2:0/4210530445 wait complete. 2024-09-15T23:06:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.675+0000 7fcc13351640 1 Processor -- start 2024-09-15T23:06:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.675+0000 7fcc13351640 1 -- start start 2024-09-15T23:06:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.676+0000 7fcc13351640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc0c1002e0 0x7fcc0c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.676+0000 7fcc13351640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c10dd50 con 0x7fcc0c1002e0 2024-09-15T23:06:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.676+0000 7fcc110ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc0c1002e0 0x7fcc0c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.676+0000 7fcc110ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc0c1002e0 0x7fcc0c1992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55812/0 (socket says 172.21.15.2:55812) 2024-09-15T23:06:06.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.676+0000 7fcc110ed640 1 -- 172.21.15.2:0/3090138275 learned_addr learned my addr 172.21.15.2:0/3090138275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:06:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.676+0000 7fcc110ed640 1 -- 172.21.15.2:0/3090138275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c1997e0 con 0x7fcc0c1002e0 2024-09-15T23:06:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.676+0000 7fcc110ed640 1 --2- 172.21.15.2:0/3090138275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc0c1002e0 0x7fcc0c1992a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009230 tx=0x7fcc080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.676+0000 7fcc027fc640 1 -- 172.21.15.2:0/3090138275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc0803f070 con 0x7fcc0c1002e0 2024-09-15T23:06:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.676+0000 7fcc027fc640 1 -- 172.21.15.2:0/3090138275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc08003aa0 con 0x7fcc0c1002e0 2024-09-15T23:06:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.676+0000 7fcc13351640 1 -- 172.21.15.2:0/3090138275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc0c199a70 con 0x7fcc0c1002e0 2024-09-15T23:06:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.676+0000 7fcc027fc640 1 -- 172.21.15.2:0/3090138275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc08035030 con 0x7fcc0c1002e0 2024-09-15T23:06:06.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.676+0000 7fcc13351640 1 -- 172.21.15.2:0/3090138275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc0c199ed0 con 0x7fcc0c1002e0 2024-09-15T23:06:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.678+0000 7fcc027fc640 1 -- 172.21.15.2:0/3090138275 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fcc08042070 con 0x7fcc0c1002e0 2024-09-15T23:06:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.678+0000 7fcc13351640 1 -- 172.21.15.2:0/3090138275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc0c06a7b0 con 0x7fcc0c1002e0 2024-09-15T23:06:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.678+0000 7fcc027fc640 1 --2- 172.21.15.2:0/3090138275 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcbf8039300 0x7fcbf803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.678+0000 7fcc027fc640 1 -- 172.21.15.2:0/3090138275 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcc0806cf10 con 0x7fcc0c1002e0 2024-09-15T23:06:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.678+0000 7fcc108ec640 1 --2- 172.21.15.2:0/3090138275 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcbf8039300 0x7fcbf803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:06.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.678+0000 7fcc108ec640 1 --2- 172.21.15.2:0/3090138275 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcbf8039300 0x7fcbf803b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0098c0 tx=0x7fcbfc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:06.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.683+0000 7fcc027fc640 1 -- 172.21.15.2:0/3090138275 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc0804c350 con 0x7fcc0c1002e0 2024-09-15T23:06:06.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.862+0000 7fcc13351640 1 -- 172.21.15.2:0/3090138275 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc0c19a660 con 0x7fcbf8039300 2024-09-15T23:06:06.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.863+0000 7fcc027fc640 1 -- 172.21.15.2:0/3090138275 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7fcc0c19a660 con 0x7fcbf8039300 2024-09-15T23:06:06.865 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:06:06.865 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.112", "hostname": "smithi112", "labels": [], "status": ""}, {"addr": "172.21.15.145", "hostname": "smithi145", "labels": [], "status": ""}] 2024-09-15T23:06:06.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.865+0000 7fcc13351640 1 -- 172.21.15.2:0/3090138275 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcbf8039300 msgr2=0x7fcbf803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:06.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.865+0000 7fcc13351640 1 --2- 172.21.15.2:0/3090138275 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcbf8039300 0x7fcbf803b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0098c0 tx=0x7fcbfc006db0 comp rx=0 tx=0).stop 2024-09-15T23:06:06.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.865+0000 7fcc13351640 1 -- 172.21.15.2:0/3090138275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc0c1002e0 msgr2=0x7fcc0c1992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:06.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.865+0000 7fcc13351640 1 --2- 172.21.15.2:0/3090138275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc0c1002e0 0x7fcc0c1992a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009230 tx=0x7fcc080048f0 comp rx=0 tx=0).stop 2024-09-15T23:06:06.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.865+0000 7fcc13351640 1 -- 172.21.15.2:0/3090138275 shutdown_connections 2024-09-15T23:06:06.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.865+0000 7fcc13351640 1 --2- 172.21.15.2:0/3090138275 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcbf8039300 0x7fcbf803b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:06.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.865+0000 7fcc13351640 1 --2- 172.21.15.2:0/3090138275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc0c1002e0 0x7fcc0c1992a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:06.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.865+0000 7fcc13351640 1 -- 172.21.15.2:0/3090138275 >> 172.21.15.2:0/3090138275 conn(0x7fcc0c0fc1b0 msgr2=0x7fcc0c0fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:06.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.866+0000 7fcc13351640 1 -- 172.21.15.2:0/3090138275 shutdown_connections 2024-09-15T23:06:06.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:06.866+0000 7fcc13351640 1 -- 172.21.15.2:0/3090138275 wait complete. 2024-09-15T23:06:07.426 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-15T23:06:07.426 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-15T23:06:07.445 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:07 smithi002 ceph-mon[31019]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:07.445 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:07 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:07.682 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:06:08.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.158+0000 7f647aae7640 1 -- 172.21.15.2:0/1415766137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6474102730 msgr2=0x7f6474102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:08.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.158+0000 7f647aae7640 1 --2- 172.21.15.2:0/1415766137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6474102730 0x7f6474102b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6464009810 tx=0x7f646402a540 comp rx=0 tx=0).stop 2024-09-15T23:06:08.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.158+0000 7f647aae7640 1 -- 172.21.15.2:0/1415766137 shutdown_connections 2024-09-15T23:06:08.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.158+0000 7f647aae7640 1 --2- 172.21.15.2:0/1415766137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6474102730 0x7f6474102b10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:08.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.158+0000 7f647aae7640 1 -- 172.21.15.2:0/1415766137 >> 172.21.15.2:0/1415766137 conn(0x7f6474077310 msgr2=0x7f64740fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:08.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.158+0000 7f647aae7640 1 -- 172.21.15.2:0/1415766137 shutdown_connections 2024-09-15T23:06:08.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.158+0000 7f647aae7640 1 -- 172.21.15.2:0/1415766137 wait complete. 2024-09-15T23:06:08.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.159+0000 7f647aae7640 1 Processor -- start 2024-09-15T23:06:08.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.159+0000 7f647aae7640 1 -- start start 2024-09-15T23:06:08.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.159+0000 7f647aae7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6474102730 0x7f6474100390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:08.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.159+0000 7f647aae7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f647410bb30 con 0x7f6474102730 2024-09-15T23:06:08.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.159+0000 7f6478883640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6474102730 0x7f6474100390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:08.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.159+0000 7f6478883640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6474102730 0x7f6474100390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55836/0 (socket says 172.21.15.2:55836) 2024-09-15T23:06:08.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.159+0000 7f6478883640 1 -- 172.21.15.2:0/1265924244 learned_addr learned my addr 172.21.15.2:0/1265924244 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:06:08.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.160+0000 7f6478883640 1 -- 172.21.15.2:0/1265924244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6474102280 con 0x7f6474102730 2024-09-15T23:06:08.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.160+0000 7f6478883640 1 --2- 172.21.15.2:0/1265924244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6474102730 0x7f6474100390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6464030b30 tx=0x7f6464030b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:08.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.160+0000 7f6471ffb640 1 -- 172.21.15.2:0/1265924244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464040070 con 0x7f6474102730 2024-09-15T23:06:08.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.160+0000 7f6471ffb640 1 -- 172.21.15.2:0/1265924244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f64640318b0 con 0x7f6474102730 2024-09-15T23:06:08.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.160+0000 7f647aae7640 1 -- 172.21.15.2:0/1265924244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64741008d0 con 0x7f6474102730 2024-09-15T23:06:08.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.160+0000 7f6471ffb640 1 -- 172.21.15.2:0/1265924244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464004950 con 0x7f6474102730 2024-09-15T23:06:08.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.160+0000 7f647aae7640 1 -- 172.21.15.2:0/1265924244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6474100d90 con 0x7f6474102730 2024-09-15T23:06:08.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.161+0000 7f6471ffb640 1 -- 172.21.15.2:0/1265924244 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f6464039040 con 0x7f6474102730 2024-09-15T23:06:08.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.161+0000 7f647aae7640 1 -- 172.21.15.2:0/1265924244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6474069f90 con 0x7f6474102730 2024-09-15T23:06:08.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.162+0000 7f6471ffb640 1 --2- 172.21.15.2:0/1265924244 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f645c039300 0x7f645c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:08.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.162+0000 7f6471ffb640 1 -- 172.21.15.2:0/1265924244 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f646406d390 con 0x7f6474102730 2024-09-15T23:06:08.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.162+0000 7f6473fff640 1 --2- 172.21.15.2:0/1265924244 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f645c039300 0x7f645c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:08.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.162+0000 7f6473fff640 1 --2- 172.21.15.2:0/1265924244 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f645c039300 0x7f645c03b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f64680098c0 tx=0x7f6468006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:08.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.166+0000 7f6471ffb640 1 -- 172.21.15.2:0/1265924244 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f646403bde0 con 0x7f6474102730 2024-09-15T23:06:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.347+0000 7f647aae7640 1 -- 172.21.15.2:0/1265924244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f64741018c0 con 0x7f6474102730 2024-09-15T23:06:08.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.354+0000 7f6471ffb640 1 -- 172.21.15.2:0/1265924244 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f6464043e30 con 0x7f6474102730 2024-09-15T23:06:08.355 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-09-15T23:06:08.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.356+0000 7f647aae7640 1 -- 172.21.15.2:0/1265924244 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f645c039300 msgr2=0x7f645c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:08.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.356+0000 7f647aae7640 1 --2- 172.21.15.2:0/1265924244 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f645c039300 0x7f645c03b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f64680098c0 tx=0x7f6468006db0 comp rx=0 tx=0).stop 2024-09-15T23:06:08.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.356+0000 7f647aae7640 1 -- 172.21.15.2:0/1265924244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6474102730 msgr2=0x7f6474100390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:08.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.356+0000 7f647aae7640 1 --2- 172.21.15.2:0/1265924244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6474102730 0x7f6474100390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6464030b30 tx=0x7f6464030b60 comp rx=0 tx=0).stop 2024-09-15T23:06:08.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.356+0000 7f647aae7640 1 -- 172.21.15.2:0/1265924244 shutdown_connections 2024-09-15T23:06:08.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.356+0000 7f647aae7640 1 --2- 172.21.15.2:0/1265924244 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f645c039300 0x7f645c03b7c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:08.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.356+0000 7f647aae7640 1 --2- 172.21.15.2:0/1265924244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6474102730 0x7f6474100390 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:08.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.356+0000 7f647aae7640 1 -- 172.21.15.2:0/1265924244 >> 172.21.15.2:0/1265924244 conn(0x7f6474077310 msgr2=0x7f64741034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:08.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.356+0000 7f647aae7640 1 -- 172.21.15.2:0/1265924244 shutdown_connections 2024-09-15T23:06:08.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:08.356+0000 7f647aae7640 1 -- 172.21.15.2:0/1265924244 wait complete. 2024-09-15T23:06:08.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:08 smithi002 ceph-mon[31019]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:06:08.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:08 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1265924244' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T23:06:08.955 INFO:tasks.cephadm:Adding mon.a on smithi002 2024-09-15T23:06:08.955 INFO:tasks.cephadm:Adding mon.b on smithi112 2024-09-15T23:06:08.955 INFO:tasks.cephadm:Adding mon.c on smithi145 2024-09-15T23:06:08.955 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi002:172.21.15.2=a;smithi112:172.21.15.112=b;smithi145:172.21.15.145=c' 2024-09-15T23:06:09.524 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-15T23:06:09.568 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-15T23:06:09.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:09 smithi002 ceph-mon[31019]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:09 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1265924244' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T23:06:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:09 smithi002 ceph-mon[31019]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:06:10.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.100+0000 7f07169b4640 1 -- 172.21.15.145:0/3280007679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0710102140 msgr2=0x7f0710104530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:10.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.100+0000 7f07169b4640 1 --2- 172.21.15.145:0/3280007679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0710102140 0x7f0710104530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0700009880 tx=0x7f070002a5d0 comp rx=0 tx=0).stop 2024-09-15T23:06:10.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.100+0000 7f07169b4640 1 -- 172.21.15.145:0/3280007679 shutdown_connections 2024-09-15T23:06:10.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.100+0000 7f07169b4640 1 --2- 172.21.15.145:0/3280007679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0710102140 0x7f0710104530 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:10.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.100+0000 7f07169b4640 1 -- 172.21.15.145:0/3280007679 >> 172.21.15.145:0/3280007679 conn(0x7f07100fbca0 msgr2=0x7f07100fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:10.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.100+0000 7f07169b4640 1 -- 172.21.15.145:0/3280007679 shutdown_connections 2024-09-15T23:06:10.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.100+0000 7f07169b4640 1 -- 172.21.15.145:0/3280007679 wait complete. 2024-09-15T23:06:10.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.100+0000 7f07169b4640 1 Processor -- start 2024-09-15T23:06:10.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.100+0000 7f07169b4640 1 -- start start 2024-09-15T23:06:10.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.101+0000 7f07169b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0710102140 0x7f0710196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:10.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.101+0000 7f07169b4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f07101075c0 con 0x7f0710102140 2024-09-15T23:06:10.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.101+0000 7f070ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0710102140 0x7f0710196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:10.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.101+0000 7f070ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0710102140 0x7f0710196c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.145:42430/0 (socket says 172.21.15.145:42430) 2024-09-15T23:06:10.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.101+0000 7f070ffff640 1 -- 172.21.15.145:0/7071603 learned_addr learned my addr 172.21.15.145:0/7071603 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-15T23:06:10.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.101+0000 7f070ffff640 1 -- 172.21.15.145:0/7071603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07101971d0 con 0x7f0710102140 2024-09-15T23:06:10.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.101+0000 7f070ffff640 1 --2- 172.21.15.145:0/7071603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0710102140 0x7f0710196c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0700009230 tx=0x7f07000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:10.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.102+0000 7f070d7fa640 1 -- 172.21.15.145:0/7071603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f070003f070 con 0x7f0710102140 2024-09-15T23:06:10.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.102+0000 7f070d7fa640 1 -- 172.21.15.145:0/7071603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0700003aa0 con 0x7f0710102140 2024-09-15T23:06:10.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.102+0000 7f07169b4640 1 -- 172.21.15.145:0/7071603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0710197460 con 0x7f0710102140 2024-09-15T23:06:10.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.102+0000 7f070d7fa640 1 -- 172.21.15.145:0/7071603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0700035030 con 0x7f0710102140 2024-09-15T23:06:10.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.102+0000 7f07169b4640 1 -- 172.21.15.145:0/7071603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f071019a150 con 0x7f0710102140 2024-09-15T23:06:10.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.103+0000 7f070d7fa640 1 -- 172.21.15.145:0/7071603 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f0700042070 con 0x7f0710102140 2024-09-15T23:06:10.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.103+0000 7f07169b4640 1 -- 172.21.15.145:0/7071603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0710107d40 con 0x7f0710102140 2024-09-15T23:06:10.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.103+0000 7f070d7fa640 1 --2- 172.21.15.145:0/7071603 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f06f80392a0 0x7f06f803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:10.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.103+0000 7f070d7fa640 1 -- 172.21.15.145:0/7071603 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f070006d2c0 con 0x7f0710102140 2024-09-15T23:06:10.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.103+0000 7f070f7fe640 1 --2- 172.21.15.145:0/7071603 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f06f80392a0 0x7f06f803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:10.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.104+0000 7f070f7fe640 1 --2- 172.21.15.145:0/7071603 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f06f80392a0 0x7f06f803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f07040098c0 tx=0x7f0704006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:10.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.108+0000 7f070d7fa640 1 -- 172.21.15.145:0/7071603 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0700039350 con 0x7f0710102140 2024-09-15T23:06:10.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.298+0000 7f07169b4640 1 -- 172.21.15.145:0/7071603 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi112:172.21.15.112=b;smithi145:172.21.15.145=c", "target": ["mon-mgr", ""]}) -- 0x7f071002d8f0 con 0x7f06f80392a0 2024-09-15T23:06:10.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.303+0000 7f070d7fa640 1 -- 172.21.15.145:0/7071603 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f071002d8f0 con 0x7f06f80392a0 2024-09-15T23:06:10.305 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled mon update... 2024-09-15T23:06:10.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.306+0000 7f07169b4640 1 -- 172.21.15.145:0/7071603 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f06f80392a0 msgr2=0x7f06f803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:10.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.306+0000 7f07169b4640 1 --2- 172.21.15.145:0/7071603 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f06f80392a0 0x7f06f803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f07040098c0 tx=0x7f0704006db0 comp rx=0 tx=0).stop 2024-09-15T23:06:10.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.306+0000 7f07169b4640 1 -- 172.21.15.145:0/7071603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0710102140 msgr2=0x7f0710196c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:10.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.306+0000 7f07169b4640 1 --2- 172.21.15.145:0/7071603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0710102140 0x7f0710196c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0700009230 tx=0x7f07000048f0 comp rx=0 tx=0).stop 2024-09-15T23:06:10.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.306+0000 7f07169b4640 1 -- 172.21.15.145:0/7071603 shutdown_connections 2024-09-15T23:06:10.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.306+0000 7f07169b4640 1 --2- 172.21.15.145:0/7071603 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f06f80392a0 0x7f06f803b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:10.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.306+0000 7f07169b4640 1 --2- 172.21.15.145:0/7071603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0710102140 0x7f0710196c90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:10.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.306+0000 7f07169b4640 1 -- 172.21.15.145:0/7071603 >> 172.21.15.145:0/7071603 conn(0x7f07100fbca0 msgr2=0x7f07100fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:10.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.306+0000 7f07169b4640 1 -- 172.21.15.145:0/7071603 shutdown_connections 2024-09-15T23:06:10.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:10.306+0000 7f07169b4640 1 -- 172.21.15.145:0/7071603 wait complete. 2024-09-15T23:06:10.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:10.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:10.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:10.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi145", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-15T23:06:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: Updating smithi145:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:06:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:06:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: Updating smithi145:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:06:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi112:172.21.15.112=b;smithi145:172.21.15.145=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:06:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi112:172.21.15.112=b;smithi145:172.21.15.145=c;count:3 2024-09-15T23:06:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:10.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:10.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:10.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:06:10.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:10.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:10 smithi002 ceph-mon[31019]: Deploying daemon mon.c on smithi145 2024-09-15T23:06:10.931 DEBUG:teuthology.orchestra.run.smithi112:mon.b> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.b.service 2024-09-15T23:06:10.934 DEBUG:teuthology.orchestra.run.smithi145:mon.c> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.c.service 2024-09-15T23:06:10.937 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T23:06:10.938 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T23:06:11.577 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:06:12.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:12 smithi002 ceph-mon[31019]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:13.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.563+0000 7feee09ef640 1 -- 172.21.15.145:0/3884834090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feedc107650 msgr2=0x7feedc107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:13.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.563+0000 7feee09ef640 1 --2- 172.21.15.145:0/3884834090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feedc107650 0x7feedc107a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feecc009880 tx=0x7feecc02a5d0 comp rx=0 tx=0).stop 2024-09-15T23:06:13.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.564+0000 7feee09ef640 1 -- 172.21.15.145:0/3884834090 shutdown_connections 2024-09-15T23:06:13.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.564+0000 7feee09ef640 1 --2- 172.21.15.145:0/3884834090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feedc107650 0x7feedc107a30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:13.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.564+0000 7feee09ef640 1 -- 172.21.15.145:0/3884834090 >> 172.21.15.145:0/3884834090 conn(0x7feedc0fd2a0 msgr2=0x7feedc0ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:13.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.564+0000 7feee09ef640 1 -- 172.21.15.145:0/3884834090 shutdown_connections 2024-09-15T23:06:13.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.564+0000 7feee09ef640 1 -- 172.21.15.145:0/3884834090 wait complete. 2024-09-15T23:06:13.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.565+0000 7feee09ef640 1 Processor -- start 2024-09-15T23:06:13.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.565+0000 7feee09ef640 1 -- start start 2024-09-15T23:06:13.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.565+0000 7feee09ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feedc107650 0x7feedc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:13.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.565+0000 7feee09ef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feedc10bb10 con 0x7feedc107650 2024-09-15T23:06:13.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.565+0000 7feeda59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feedc107650 0x7feedc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:13.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.565+0000 7feeda59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feedc107650 0x7feedc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.145:44032/0 (socket says 172.21.15.145:44032) 2024-09-15T23:06:13.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.565+0000 7feeda59c640 1 -- 172.21.15.145:0/2488962662 learned_addr learned my addr 172.21.15.145:0/2488962662 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-15T23:06:13.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.566+0000 7feeda59c640 1 -- 172.21.15.145:0/2488962662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc0763e0 con 0x7feedc107650 2024-09-15T23:06:13.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.566+0000 7feeda59c640 1 --2- 172.21.15.145:0/2488962662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feedc107650 0x7feedc0744f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feecc009230 tx=0x7feecc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:13.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.566+0000 7feecb7fe640 1 -- 172.21.15.145:0/2488962662 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feecc03f070 con 0x7feedc107650 2024-09-15T23:06:13.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.566+0000 7feee09ef640 1 -- 172.21.15.145:0/2488962662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feedc074a90 con 0x7feedc107650 2024-09-15T23:06:13.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.566+0000 7feecb7fe640 1 -- 172.21.15.145:0/2488962662 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feecc004d10 con 0x7feedc107650 2024-09-15T23:06:13.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.566+0000 7feecb7fe640 1 -- 172.21.15.145:0/2488962662 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feecc035030 con 0x7feedc107650 2024-09-15T23:06:13.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.566+0000 7feee09ef640 1 -- 172.21.15.145:0/2488962662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feedc074f50 con 0x7feedc107650 2024-09-15T23:06:13.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.567+0000 7feecb7fe640 1 -- 172.21.15.145:0/2488962662 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7feecc042070 con 0x7feedc107650 2024-09-15T23:06:13.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.567+0000 7feee09ef640 1 -- 172.21.15.145:0/2488962662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feedc102d00 con 0x7feedc107650 2024-09-15T23:06:13.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.567+0000 7feecb7fe640 1 --2- 172.21.15.145:0/2488962662 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7feec40392a0 0x7feec403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:13.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.567+0000 7feecb7fe640 1 -- 172.21.15.145:0/2488962662 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7feecc06df00 con 0x7feedc107650 2024-09-15T23:06:13.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.567+0000 7feed9d9b640 1 --2- 172.21.15.145:0/2488962662 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7feec40392a0 0x7feec403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:13.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.568+0000 7feed9d9b640 1 --2- 172.21.15.145:0/2488962662 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7feec40392a0 0x7feec403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feed00098c0 tx=0x7feed0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:13.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.572+0000 7feecb7fe640 1 -- 172.21.15.145:0/2488962662 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feecc0055c0 con 0x7feedc107650 2024-09-15T23:06:13.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.819+0000 7feee09ef640 1 -- 172.21.15.145:0/2488962662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7feedc075a20 con 0x7feedc107650 2024-09-15T23:06:13.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.820+0000 7feecb7fe640 1 -- 172.21.15.145:0/2488962662 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7feecc06c810 con 0x7feedc107650 2024-09-15T23:06:13.822 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:06:13.822 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":1,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","modified":"2024-09-15T23:04:42.039015Z","created":"2024-09-15T23:04:42.039015Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-15T23:06:13.822 INFO:teuthology.orchestra.run.smithi145.stderr:dumped monmap epoch 1 2024-09-15T23:06:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.823+0000 7feee09ef640 1 -- 172.21.15.145:0/2488962662 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7feec40392a0 msgr2=0x7feec403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.823+0000 7feee09ef640 1 --2- 172.21.15.145:0/2488962662 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7feec40392a0 0x7feec403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feed00098c0 tx=0x7feed0006db0 comp rx=0 tx=0).stop 2024-09-15T23:06:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.823+0000 7feee09ef640 1 -- 172.21.15.145:0/2488962662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feedc107650 msgr2=0x7feedc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.823+0000 7feee09ef640 1 --2- 172.21.15.145:0/2488962662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feedc107650 0x7feedc0744f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feecc009230 tx=0x7feecc0048f0 comp rx=0 tx=0).stop 2024-09-15T23:06:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.823+0000 7feee09ef640 1 -- 172.21.15.145:0/2488962662 shutdown_connections 2024-09-15T23:06:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.823+0000 7feee09ef640 1 --2- 172.21.15.145:0/2488962662 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7feec40392a0 0x7feec403b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.823+0000 7feee09ef640 1 --2- 172.21.15.145:0/2488962662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feedc107650 0x7feedc0744f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.823+0000 7feee09ef640 1 -- 172.21.15.145:0/2488962662 >> 172.21.15.145:0/2488962662 conn(0x7feedc0fd2a0 msgr2=0x7feedc0fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.823+0000 7feee09ef640 1 -- 172.21.15.145:0/2488962662 shutdown_connections 2024-09-15T23:06:13.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:13.823+0000 7feee09ef640 1 -- 172.21.15.145:0/2488962662 wait complete. 2024-09-15T23:06:14.135 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 systemd[1]: Starting Ceph mon.c for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:06:14.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 podman[34882]: 2024-09-15 23:06:14.593860667 +0000 UTC m=+0.097597755 container create 8a6e68471bbdc00d8b091e57896b657906cd5ee8d4010256b5a46f5f6bb4d354 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-15T23:06:14.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 podman[34882]: 2024-09-15 23:06:14.511910595 +0000 UTC m=+0.015647693 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:06:14.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:14 smithi002 ceph-mon[31019]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:14.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:14 smithi002 ceph-mon[31019]: from='client.? 172.21.15.145:0/2488962662' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:06:15.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 podman[34882]: 2024-09-15 23:06:14.854551703 +0000 UTC m=+0.358288795 container init 8a6e68471bbdc00d8b091e57896b657906cd5ee8d4010256b5a46f5f6bb4d354 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-c, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-15T23:06:15.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 podman[34882]: 2024-09-15 23:06:14.857694674 +0000 UTC m=+0.361431762 container start 8a6e68471bbdc00d8b091e57896b657906cd5ee8d4010256b5a46f5f6bb4d354 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-c, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:06:15.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T23:06:15.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T23:06:15.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: pidfile_write: ignore empty --pid-file 2024-09-15T23:06:15.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: load: jerasure load: lrc 2024-09-15T23:06:15.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: RocksDB version: 7.9.2 2024-09-15T23:06:15.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Git sha 0 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: DB SUMMARY 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: DB Session ID: U6JNKDAG7552ORAKW4TG 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: CURRENT file: CURRENT 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.error_if_exists: 0 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.create_if_missing: 0 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.paranoid_checks: 1 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T23:06:15.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T23:06:15.210 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.env: 0x5617154f8940 2024-09-15T23:06:15.210 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T23:06:15.210 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.info_log: 0x5617163836e0 2024-09-15T23:06:15.210 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T23:06:15.211 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.statistics: (nil) 2024-09-15T23:06:15.211 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.use_fsync: 0 2024-09-15T23:06:15.211 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_log_file_size: 0 2024-09-15T23:06:15.211 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T23:06:15.211 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T23:06:15.211 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T23:06:15.211 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T23:06:15.211 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.allow_fallocate: 1 2024-09-15T23:06:15.211 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T23:06:15.211 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T23:06:15.211 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.use_direct_reads: 0 2024-09-15T23:06:15.211 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T23:06:15.212 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T23:06:15.212 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.db_log_dir: 2024-09-15T23:06:15.212 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.wal_dir: 2024-09-15T23:06:15.212 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T23:06:15.212 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T23:06:15.212 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T23:06:15.212 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T23:06:15.212 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T23:06:15.212 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T23:06:15.212 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T23:06:15.212 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T23:06:15.212 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.write_buffer_manager: 0x561716392dc0 2024-09-15T23:06:15.212 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.unordered_write: 0 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.row_cache: None 2024-09-15T23:06:15.213 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.wal_filter: None 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.two_write_queues: 0 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.wal_compression: 0 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.atomic_flush: 0 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.log_readahead_size: 0 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T23:06:15.214 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_background_jobs: 2 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_background_compactions: -1 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_subcompactions: 1 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T23:06:15.215 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_open_files: -1 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_background_flushes: -1 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Compression algorithms supported: 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: kZSTD supported: 0 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: kXpressCompression supported: 0 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: kBZip2Compression supported: 0 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: kLZ4Compression supported: 1 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: kZlibCompression supported: 1 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T23:06:15.216 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: kSnappyCompression supported: 1 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.merge_operator: 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compaction_filter: None 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561716383320) 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout: cache_index_and_filter_blocks: 1 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T23:06:15.217 INFO:journalctl@ceph.mon.c.smithi145.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: pin_top_level_index_and_filter: 1 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: index_type: 0 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: data_block_index_type: 0 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: index_shortening: 1 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: checksum: 4 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: no_block_cache: 0 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: block_cache: 0x5617163771f0 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: block_cache_name: BinnedLRUCache 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: block_cache_options: 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: capacity : 536870912 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: num_shard_bits : 4 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: strict_capacity_limit : 0 2024-09-15T23:06:15.218 INFO:journalctl@ceph.mon.c.smithi145.stdout: high_pri_pool_ratio: 0.000 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: block_cache_compressed: (nil) 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: persistent_cache: (nil) 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: block_size: 4096 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: block_size_deviation: 10 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: block_restart_interval: 16 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: index_block_restart_interval: 1 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: metadata_block_size: 4096 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: partition_filters: 0 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: use_delta_encoding: 1 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: filter_policy: bloomfilter 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: whole_key_filtering: 1 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: verify_compression: 0 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: read_amp_bytes_per_bit: 0 2024-09-15T23:06:15.219 INFO:journalctl@ceph.mon.c.smithi145.stdout: format_version: 5 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout: enable_index_compression: 1 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout: block_align: 0 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout: max_auto_readahead_size: 262144 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout: prepopulate_block_cache: 0 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout: initial_auto_readahead_size: 8192 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compression: NoCompression 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.num_levels: 7 2024-09-15T23:06:15.220 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T23:06:15.221 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T23:06:15.222 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T23:06:15.223 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T23:06:15.223 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T23:06:15.223 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T23:06:15.223 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T23:06:15.224 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T23:06:15.225 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T23:06:15.225 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T23:06:15.225 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T23:06:15.225 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T23:06:15.225 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T23:06:15.225 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T23:06:15.225 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T23:06:15.225 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T23:06:15.225 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T23:06:15.225 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T23:06:15.225 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T23:06:15.225 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.inplace_update_support: 0 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.bloom_locality: 0 2024-09-15T23:06:15.226 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.max_successive_merges: 0 2024-09-15T23:06:15.227 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T23:06:15.227 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T23:06:15.227 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T23:06:15.227 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T23:06:15.227 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.ttl: 2592000 2024-09-15T23:06:15.227 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T23:06:15.227 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T23:06:15.228 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T23:06:15.228 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.enable_blob_files: false 2024-09-15T23:06:15.228 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.min_blob_size: 0 2024-09-15T23:06:15.228 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T23:06:15.228 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T23:06:15.228 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T23:06:15.228 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T23:06:15.228 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T23:06:15.229 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T23:06:15.229 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T23:06:15.229 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T23:06:15.229 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-15T23:06:15.229 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-15T23:06:15.229 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3480da4c-a7b4-474f-a78f-4beb188b39d6 2024-09-15T23:06:15.229 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726441574884250, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-15T23:06:15.229 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-15T23:06:15.229 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726441574884682, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726441574, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3480da4c-a7b4-474f-a78f-4beb188b39d6", "db_session_id": "U6JNKDAG7552ORAKW4TG", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-15T23:06:15.229 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726441574884773, "job": 1, "event": "recovery_finished"} 2024-09-15T23:06:15.229 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-15T23:06:15.229 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5617163a4e00 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: DB pointer 0x5617164a0000 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout: ** DB Stats ** 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout: 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout: ** Compaction Stats [default] ** 2024-09-15T23:06:15.230 INFO:journalctl@ceph.mon.c.smithi145.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: ** Compaction Stats [default] ** 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T23:06:15.231 INFO:journalctl@ceph.mon.c.smithi145.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T23:06:15.232 INFO:journalctl@ceph.mon.c.smithi145.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T23:06:15.232 INFO:journalctl@ceph.mon.c.smithi145.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T23:06:15.232 INFO:journalctl@ceph.mon.c.smithi145.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T23:06:15.232 INFO:journalctl@ceph.mon.c.smithi145.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T23:06:15.232 INFO:journalctl@ceph.mon.c.smithi145.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T23:06:15.232 INFO:journalctl@ceph.mon.c.smithi145.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T23:06:15.232 INFO:journalctl@ceph.mon.c.smithi145.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T23:06:15.232 INFO:journalctl@ceph.mon.c.smithi145.stdout: Block cache BinnedLRUCache@0x5617163771f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-15T23:06:15.232 INFO:journalctl@ceph.mon.c.smithi145.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-15T23:06:15.232 INFO:journalctl@ceph.mon.c.smithi145.stdout: 2024-09-15T23:06:15.232 INFO:journalctl@ceph.mon.c.smithi145.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T23:06:15.232 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-15T23:06:15.232 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: using public_addr v2:172.21.15.145:0/0 -> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] 2024-09-15T23:06:15.233 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: starting mon.c rank -1 at public addrs [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] at bind addrs [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:15.233 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(???) e0 preinit fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:15.233 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(synchronizing).mds e1 new map 2024-09-15T23:06:15.233 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-15T23:06:15.233 INFO:journalctl@ceph.mon.c.smithi145.stdout: e1 2024-09-15T23:06:15.233 INFO:journalctl@ceph.mon.c.smithi145.stdout: btime 2024-09-15T23:04:45:101276+0000 2024-09-15T23:06:15.233 INFO:journalctl@ceph.mon.c.smithi145.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T23:06:15.233 INFO:journalctl@ceph.mon.c.smithi145.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T23:06:15.233 INFO:journalctl@ceph.mon.c.smithi145.stdout: legacy client fscid: -1 2024-09-15T23:06:15.233 INFO:journalctl@ceph.mon.c.smithi145.stdout: 2024-09-15T23:06:15.233 INFO:journalctl@ceph.mon.c.smithi145.stdout: No filesystems configured 2024-09-15T23:06:15.233 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-15T23:06:15.233 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1265924244' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1265924244' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:15.234 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi145", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: Updating smithi145:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: Updating smithi145:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi112:172.21.15.112=b;smithi145:172.21.15.145=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi112:172.21.15.112=b;smithi145:172.21.15.145=c;count:3 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:15.235 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:15.236 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:15.236 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:15.236 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:06:15.236 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:15.236 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: Deploying daemon mon.c on smithi145 2024-09-15T23:06:15.236 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:15.236 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:15.236 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: from='client.? 172.21.15.145:0/2488962662' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:06:15.236 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 ceph-mon[34901]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-15T23:06:15.236 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 bash[34882]: 8a6e68471bbdc00d8b091e57896b657906cd5ee8d4010256b5a46f5f6bb4d354 2024-09-15T23:06:15.236 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:14 smithi145 systemd[1]: Started Ceph mon.c for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:06:15.422 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T23:06:15.423 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T23:06:15.667 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:06:20.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:06:20.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: mon.a calling monitor election 2024-09-15T23:06:20.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:20.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: mon.c calling monitor election 2024-09-15T23:06:20.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:20.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: monmap epoch 2 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: last_changed 2024-09-15T23:06:14.909431+0000 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: created 2024-09-15T23:04:42.039015+0000 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: min_mon_release 19 (squid) 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: election_strategy: 1 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: fsmap 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: mgrmap e13: x(active, since 38s) 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: overall HEALTH_OK 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:20.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:20.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:20.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:06:20.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:20.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:06:20.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: mon.a calling monitor election 2024-09-15T23:06:20.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:20.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: mon.c calling monitor election 2024-09-15T23:06:20.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:20.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: monmap epoch 2 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: last_changed 2024-09-15T23:06:14.909431+0000 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: created 2024-09-15T23:04:42.039015+0000 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: min_mon_release 19 (squid) 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: election_strategy: 1 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: fsmap 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:06:20.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: mgrmap e13: x(active, since 38s) 2024-09-15T23:06:20.460 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: overall HEALTH_OK 2024-09-15T23:06:20.460 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:20.460 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:20.460 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:20.460 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:06:20.460 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:20.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.508+0000 7f2882692640 1 -- 172.21.15.145:0/3679553400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2864003530 msgr2=0x7f28640059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:20.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.508+0000 7f2882692640 1 --2- 172.21.15.145:0/3679553400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2864003530 0x7f28640059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f287c101170 tx=0x7f286c02cbf0 comp rx=0 tx=0).stop 2024-09-15T23:06:20.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.508+0000 7f2882692640 1 -- 172.21.15.145:0/3679553400 shutdown_connections 2024-09-15T23:06:20.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.508+0000 7f2882692640 1 --2- 172.21.15.145:0/3679553400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2864003530 0x7f28640059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:20.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.508+0000 7f2882692640 1 -- 172.21.15.145:0/3679553400 >> 172.21.15.145:0/3679553400 conn(0x7f287c0fb9a0 msgr2=0x7f287c0fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:20.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.508+0000 7f2882692640 1 -- 172.21.15.145:0/3679553400 shutdown_connections 2024-09-15T23:06:20.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.508+0000 7f2882692640 1 -- 172.21.15.145:0/3679553400 wait complete. 2024-09-15T23:06:20.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.509+0000 7f2882692640 1 Processor -- start 2024-09-15T23:06:20.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.509+0000 7f2882692640 1 -- start start 2024-09-15T23:06:20.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f2882692640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2864003530 0x7f287c197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:20.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f2882692640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c197750 0x7f287c19bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:20.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f2882692640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f287c107430 con 0x7f2864003530 2024-09-15T23:06:20.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f2882692640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f287c1072b0 con 0x7f287c197750 2024-09-15T23:06:20.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f287b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c197750 0x7f287c19bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:20.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f287bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2864003530 0x7f287c197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:20.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f287b7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c197750 0x7f287c19bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:53464/0 (socket says 172.21.15.145:53464) 2024-09-15T23:06:20.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f287b7fe640 1 -- 172.21.15.145:0/683777452 learned_addr learned my addr 172.21.15.145:0/683777452 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-15T23:06:20.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f287b7fe640 1 -- 172.21.15.145:0/683777452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c197750 msgr2=0x7f287c19bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-15T23:06:20.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f287b7fe640 1 -- 172.21.15.145:0/683777452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c197750 msgr2=0x7f287c19bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T23:06:20.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f287b7fe640 1 --2- 172.21.15.145:0/683777452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c197750 0x7f287c19bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:06:20.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f287b7fe640 1 --2- 172.21.15.145:0/683777452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c197750 0x7f287c19bae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:06:20.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f287bfff640 1 -- 172.21.15.145:0/683777452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c197750 msgr2=0x7f287c19bae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:06:20.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f287bfff640 1 --2- 172.21.15.145:0/683777452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c197750 0x7f287c19bae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:20.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.510+0000 7f287bfff640 1 -- 172.21.15.145:0/683777452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287c197d70 con 0x7f2864003530 2024-09-15T23:06:20.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.511+0000 7f287bfff640 1 --2- 172.21.15.145:0/683777452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2864003530 0x7f287c197210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f286c005f30 tx=0x7f286c02ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:20.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.511+0000 7f28797fa640 1 -- 172.21.15.145:0/683777452 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f286c005050 con 0x7f2864003530 2024-09-15T23:06:20.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.511+0000 7f28797fa640 1 -- 172.21.15.145:0/683777452 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f286c03c070 con 0x7f2864003530 2024-09-15T23:06:20.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.511+0000 7f28797fa640 1 -- 172.21.15.145:0/683777452 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f286c038400 con 0x7f2864003530 2024-09-15T23:06:20.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.511+0000 7f2882692640 1 -- 172.21.15.145:0/683777452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287c19c020 con 0x7f2864003530 2024-09-15T23:06:20.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.511+0000 7f2882692640 1 -- 172.21.15.145:0/683777452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f287c19c500 con 0x7f2864003530 2024-09-15T23:06:20.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.512+0000 7f28797fa640 1 -- 172.21.15.145:0/683777452 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f286c047060 con 0x7f2864003530 2024-09-15T23:06:20.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.512+0000 7f28797fa640 1 --2- 172.21.15.145:0/683777452 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f2868039090 0x7f286803b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:20.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.512+0000 7f2882692640 1 -- 172.21.15.145:0/683777452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f287c101420 con 0x7f2864003530 2024-09-15T23:06:20.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.512+0000 7f28797fa640 1 -- 172.21.15.145:0/683777452 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f286c06dc30 con 0x7f2864003530 2024-09-15T23:06:20.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.513+0000 7f287b7fe640 1 --2- 172.21.15.145:0/683777452 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f2868039090 0x7f286803b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:20.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.513+0000 7f287b7fe640 1 --2- 172.21.15.145:0/683777452 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f2868039090 0x7f286803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2870009100 tx=0x7f2870008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:20.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.518+0000 7f28797fa640 1 -- 172.21.15.145:0/683777452 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f286c034030 con 0x7f2864003530 2024-09-15T23:06:20.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.749+0000 7f2882692640 1 -- 172.21.15.145:0/683777452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f287c190bb0 con 0x7f2864003530 2024-09-15T23:06:20.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.750+0000 7f28797fa640 1 -- 172.21.15.145:0/683777452 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f286c02dc60 con 0x7f2864003530 2024-09-15T23:06:20.751 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:06:20.751 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":2,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","modified":"2024-09-15T23:06:14.909431Z","created":"2024-09-15T23:04:42.039015Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3300","nonce":0},{"type":"v1","addr":"172.21.15.145:6789","nonce":0}]},"addr":"172.21.15.145:6789/0","public_addr":"172.21.15.145:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T23:06:20.751 INFO:teuthology.orchestra.run.smithi145.stderr:dumped monmap epoch 2 2024-09-15T23:06:20.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.752+0000 7f2882692640 1 -- 172.21.15.145:0/683777452 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f2868039090 msgr2=0x7f286803b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:20.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.752+0000 7f2882692640 1 --2- 172.21.15.145:0/683777452 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f2868039090 0x7f286803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2870009100 tx=0x7f2870008040 comp rx=0 tx=0).stop 2024-09-15T23:06:20.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.752+0000 7f2882692640 1 -- 172.21.15.145:0/683777452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2864003530 msgr2=0x7f287c197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:20.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.752+0000 7f2882692640 1 --2- 172.21.15.145:0/683777452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2864003530 0x7f287c197210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f286c005f30 tx=0x7f286c02ec30 comp rx=0 tx=0).stop 2024-09-15T23:06:20.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.752+0000 7f2882692640 1 -- 172.21.15.145:0/683777452 shutdown_connections 2024-09-15T23:06:20.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.752+0000 7f2882692640 1 --2- 172.21.15.145:0/683777452 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f2868039090 0x7f286803b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:20.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.752+0000 7f2882692640 1 --2- 172.21.15.145:0/683777452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f287c197750 0x7f287c19bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:20.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.752+0000 7f2882692640 1 --2- 172.21.15.145:0/683777452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2864003530 0x7f287c197210 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:20.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.752+0000 7f2882692640 1 -- 172.21.15.145:0/683777452 >> 172.21.15.145:0/683777452 conn(0x7f287c0fb9a0 msgr2=0x7f287c0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:20.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.752+0000 7f2882692640 1 -- 172.21.15.145:0/683777452 shutdown_connections 2024-09-15T23:06:20.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:20.752+0000 7f2882692640 1 -- 172.21.15.145:0/683777452 wait complete. 2024-09-15T23:06:21.110 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:20 smithi145 ceph-mon[34901]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:21.110 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:20 smithi145 ceph-mon[34901]: Deploying daemon mon.b on smithi112 2024-09-15T23:06:21.110 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:20 smithi145 ceph-mon[34901]: from='client.? 172.21.15.145:0/683777452' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:06:21.110 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:20 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:20 smithi002 ceph-mon[31019]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:20 smithi002 ceph-mon[31019]: Deploying daemon mon.b on smithi112 2024-09-15T23:06:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:20 smithi002 ceph-mon[31019]: from='client.? 172.21.15.145:0/683777452' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:06:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:20 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:22.399 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T23:06:22.399 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T23:06:22.652 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:06:23.077 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:22 smithi145 ceph-mon[34901]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:23.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.076+0000 7f66a8ca9640 1 -- 172.21.15.145:0/778832530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a4106630 msgr2=0x7f66a4106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:23.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.076+0000 7f66a8ca9640 1 --2- 172.21.15.145:0/778832530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a4106630 0x7f66a4106a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6694009880 tx=0x7f669402a5d0 comp rx=0 tx=0).stop 2024-09-15T23:06:23.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.076+0000 7f66a8ca9640 1 -- 172.21.15.145:0/778832530 shutdown_connections 2024-09-15T23:06:23.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.076+0000 7f66a8ca9640 1 --2- 172.21.15.145:0/778832530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a4106630 0x7f66a4106a10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:23.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.076+0000 7f66a8ca9640 1 -- 172.21.15.145:0/778832530 >> 172.21.15.145:0/778832530 conn(0x7f66a40fc220 msgr2=0x7f66a40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:23.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.076+0000 7f66a8ca9640 1 -- 172.21.15.145:0/778832530 shutdown_connections 2024-09-15T23:06:23.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.076+0000 7f66a8ca9640 1 -- 172.21.15.145:0/778832530 wait complete. 2024-09-15T23:06:23.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.076+0000 7f66a8ca9640 1 Processor -- start 2024-09-15T23:06:23.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a8ca9640 1 -- start start 2024-09-15T23:06:23.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a8ca9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66a4106630 0x7f66a4198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:23.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a8ca9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41985a0 0x7f66a4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:23.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a8ca9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f66a410ab10 con 0x7f66a41985a0 2024-09-15T23:06:23.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a8ca9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f66a410a990 con 0x7f66a4106630 2024-09-15T23:06:23.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66a4106630 0x7f66a4198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:23.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a259c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66a4106630 0x7f66a4198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:53472/0 (socket says 172.21.15.145:53472) 2024-09-15T23:06:23.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a259c640 1 -- 172.21.15.145:0/2551529208 learned_addr learned my addr 172.21.15.145:0/2551529208 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-15T23:06:23.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a259c640 1 -- 172.21.15.145:0/2551529208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66a4106630 msgr2=0x7f66a4198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-15T23:06:23.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a259c640 1 -- 172.21.15.145:0/2551529208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66a4106630 msgr2=0x7f66a4198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T23:06:23.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a259c640 1 --2- 172.21.15.145:0/2551529208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66a4106630 0x7f66a4198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:06:23.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a259c640 1 --2- 172.21.15.145:0/2551529208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66a4106630 0x7f66a4198060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:06:23.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a1d9b640 1 --2- 172.21.15.145:0/2551529208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41985a0 0x7f66a4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:23.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a1d9b640 1 -- 172.21.15.145:0/2551529208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66a4106630 msgr2=0x7f66a4198060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:06:23.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a1d9b640 1 --2- 172.21.15.145:0/2551529208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66a4106630 0x7f66a4198060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:23.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.077+0000 7f66a1d9b640 1 -- 172.21.15.145:0/2551529208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a41a10d0 con 0x7f66a41985a0 2024-09-15T23:06:23.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.078+0000 7f66a1d9b640 1 --2- 172.21.15.145:0/2551529208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41985a0 0x7f66a4198a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f669800b400 tx=0x7f669800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:23.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.078+0000 7f66937fe640 1 -- 172.21.15.145:0/2551529208 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6698011630 con 0x7f66a41985a0 2024-09-15T23:06:23.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.078+0000 7f66937fe640 1 -- 172.21.15.145:0/2551529208 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6698011c80 con 0x7f66a41985a0 2024-09-15T23:06:23.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.078+0000 7f66a8ca9640 1 -- 172.21.15.145:0/2551529208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a41a12a0 con 0x7f66a41985a0 2024-09-15T23:06:23.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.078+0000 7f66937fe640 1 -- 172.21.15.145:0/2551529208 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6698010d10 con 0x7f66a41985a0 2024-09-15T23:06:23.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.078+0000 7f66a8ca9640 1 -- 172.21.15.145:0/2551529208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a41a1800 con 0x7f66a41985a0 2024-09-15T23:06:23.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.079+0000 7f66937fe640 1 -- 172.21.15.145:0/2551529208 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f6698018020 con 0x7f66a41985a0 2024-09-15T23:06:23.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.079+0000 7f66a8ca9640 1 -- 172.21.15.145:0/2551529208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a4101ca0 con 0x7f66a41985a0 2024-09-15T23:06:23.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.079+0000 7f66937fe640 1 --2- 172.21.15.145:0/2551529208 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f668c039040 0x7f668c03b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:23.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.079+0000 7f66937fe640 1 -- 172.21.15.145:0/2551529208 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f669804bf50 con 0x7f66a41985a0 2024-09-15T23:06:23.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.079+0000 7f66a259c640 1 --2- 172.21.15.145:0/2551529208 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f668c039040 0x7f668c03b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:23.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.080+0000 7f66a259c640 1 --2- 172.21.15.145:0/2551529208 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f668c039040 0x7f668c03b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f669402abc0 tx=0x7f669402aad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:23.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.084+0000 7f66937fe640 1 -- 172.21.15.145:0/2551529208 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f669801f020 con 0x7f66a41985a0 2024-09-15T23:06:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:22 smithi002 ceph-mon[31019]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:23.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.313+0000 7f66a8ca9640 1 -- 172.21.15.145:0/2551529208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f66a41a1b40 con 0x7f66a41985a0 2024-09-15T23:06:23.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.314+0000 7f66937fe640 1 -- 172.21.15.145:0/2551529208 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f6698018550 con 0x7f66a41985a0 2024-09-15T23:06:23.315 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:06:23.315 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":2,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","modified":"2024-09-15T23:06:14.909431Z","created":"2024-09-15T23:04:42.039015Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3300","nonce":0},{"type":"v1","addr":"172.21.15.145:6789","nonce":0}]},"addr":"172.21.15.145:6789/0","public_addr":"172.21.15.145:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T23:06:23.316 INFO:teuthology.orchestra.run.smithi145.stderr:dumped monmap epoch 2 2024-09-15T23:06:23.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.316+0000 7f66a8ca9640 1 -- 172.21.15.145:0/2551529208 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f668c039040 msgr2=0x7f668c03b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:23.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.316+0000 7f66a8ca9640 1 --2- 172.21.15.145:0/2551529208 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f668c039040 0x7f668c03b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f669402abc0 tx=0x7f669402aad0 comp rx=0 tx=0).stop 2024-09-15T23:06:23.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.316+0000 7f66a8ca9640 1 -- 172.21.15.145:0/2551529208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41985a0 msgr2=0x7f66a4198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:23.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.316+0000 7f66a8ca9640 1 --2- 172.21.15.145:0/2551529208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41985a0 0x7f66a4198a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f669800b400 tx=0x7f669800b8c0 comp rx=0 tx=0).stop 2024-09-15T23:06:23.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.316+0000 7f66a8ca9640 1 -- 172.21.15.145:0/2551529208 shutdown_connections 2024-09-15T23:06:23.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.316+0000 7f66a8ca9640 1 --2- 172.21.15.145:0/2551529208 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f668c039040 0x7f668c03b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:23.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.316+0000 7f66a8ca9640 1 --2- 172.21.15.145:0/2551529208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41985a0 0x7f66a4198a00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:23.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.316+0000 7f66a8ca9640 1 --2- 172.21.15.145:0/2551529208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66a4106630 0x7f66a4198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:23.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.316+0000 7f66a8ca9640 1 -- 172.21.15.145:0/2551529208 >> 172.21.15.145:0/2551529208 conn(0x7f66a40fc220 msgr2=0x7f66a40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:23.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.316+0000 7f66a8ca9640 1 -- 172.21.15.145:0/2551529208 shutdown_connections 2024-09-15T23:06:23.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:23.316+0000 7f66a8ca9640 1 -- 172.21.15.145:0/2551529208 wait complete. 2024-09-15T23:06:23.786 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(???) e0 preinit fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:23.786 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(synchronizing).mds e1 new map 2024-09-15T23:06:23.786 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-15T23:06:23.786 INFO:journalctl@ceph.mon.b.smithi112.stdout: e1 2024-09-15T23:06:23.786 INFO:journalctl@ceph.mon.b.smithi112.stdout: btime 2024-09-15T23:04:45:101276+0000 2024-09-15T23:06:23.786 INFO:journalctl@ceph.mon.b.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T23:06:23.786 INFO:journalctl@ceph.mon.b.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T23:06:23.786 INFO:journalctl@ceph.mon.b.smithi112.stdout: legacy client fscid: -1 2024-09-15T23:06:23.786 INFO:journalctl@ceph.mon.b.smithi112.stdout: 2024-09-15T23:06:23.787 INFO:journalctl@ceph.mon.b.smithi112.stdout: No filesystems configured 2024-09-15T23:06:23.787 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-15T23:06:24.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-15T23:06:24.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-15T23:06:24.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-15T23:06:24.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-15T23:06:24.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-15T23:06:24.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T23:06:24.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:06:24.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:06:24.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:06:24.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:06:24.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1265924244' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T23:06:24.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:24.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1265924244' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T23:06:24.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:06:24.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:24.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:24.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:24.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:24.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:24.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi145", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:06:24.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:24.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:24.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-15T23:06:24.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: Updating smithi145:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:06:24.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:06:24.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: Updating smithi145:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:06:24.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi112:172.21.15.112=b;smithi145:172.21.15.145=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:06:24.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi112:172.21.15.112=b;smithi145:172.21.15.145=c;count:3 2024-09-15T23:06:24.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:24.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:24.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:24.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: Deploying daemon mon.c on smithi145 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='client.? 172.21.15.145:0/2488962662' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.a calling monitor election 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.c calling monitor election 2024-09-15T23:06:24.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: monmap epoch 2 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: last_changed 2024-09-15T23:06:14.909431+0000 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: created 2024-09-15T23:04:42.039015+0000 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: min_mon_release 19 (squid) 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: election_strategy: 1 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: fsmap 2024-09-15T23:06:24.251 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:06:24.252 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mgrmap e13: x(active, since 38s) 2024-09-15T23:06:24.252 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: overall HEALTH_OK 2024-09-15T23:06:24.252 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:24.252 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:24.252 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:24.252 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:06:24.252 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:24.252 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:24.252 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: Deploying daemon mon.b on smithi112 2024-09-15T23:06:24.252 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='client.? 172.21.15.145:0/683777452' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:06:24.252 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:24.252 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:24.253 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 ceph-mon[34367]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-15T23:06:24.253 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 bash[34348]: 13d6f16dcb23b0f06d6ae763c7aa63a508f62bc0e7b2d006aa9ceed37b35235d 2024-09-15T23:06:24.253 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:23 smithi112 systemd[1]: Started Ceph mon.b for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:06:24.930 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T23:06:24.930 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T23:06:25.179 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:06:29.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.190+0000 7f313bb5b640 1 -- 172.21.15.145:0/3327875363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f311c003530 msgr2=0x7f311c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:29.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.190+0000 7f313bb5b640 1 --2- 172.21.15.145:0/3327875363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f311c003530 0x7f311c0059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3134102b00 tx=0x7f312402bdd0 comp rx=0 tx=0).stop 2024-09-15T23:06:29.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.190+0000 7f313bb5b640 1 -- 172.21.15.145:0/3327875363 shutdown_connections 2024-09-15T23:06:29.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.190+0000 7f313bb5b640 1 --2- 172.21.15.145:0/3327875363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f311c003530 0x7f311c0059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:29.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.190+0000 7f313bb5b640 1 -- 172.21.15.145:0/3327875363 >> 172.21.15.145:0/3327875363 conn(0x7f31340fd330 msgr2=0x7f31340ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:29.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.190+0000 7f313bb5b640 1 -- 172.21.15.145:0/3327875363 shutdown_connections 2024-09-15T23:06:29.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.190+0000 7f313bb5b640 1 -- 172.21.15.145:0/3327875363 wait complete. 2024-09-15T23:06:29.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.191+0000 7f313bb5b640 1 Processor -- start 2024-09-15T23:06:29.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.191+0000 7f313bb5b640 1 -- start start 2024-09-15T23:06:29.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.191+0000 7f313bb5b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c003530 0x7f31340744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:29.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:29.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:06:29.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:29.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: mon.c calling monitor election 2024-09-15T23:06:29.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: mon.a calling monitor election 2024-09-15T23:06:29.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:29.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:29.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:29.194 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:29.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:29.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:29.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:29.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:29.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T23:06:29.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: monmap epoch 3 2024-09-15T23:06:29.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:29.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: last_changed 2024-09-15T23:06:23.791065+0000 2024-09-15T23:06:29.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: created 2024-09-15T23:04:42.039015+0000 2024-09-15T23:06:29.195 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: min_mon_release 19 (squid) 2024-09-15T23:06:29.196 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: election_strategy: 1 2024-09-15T23:06:29.196 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-15T23:06:29.196 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-15T23:06:29.196 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: 2: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-09-15T23:06:29.196 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: fsmap 2024-09-15T23:06:29.196 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:06:29.196 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: mgrmap e13: x(active, since 47s) 2024-09-15T23:06:29.196 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: overall HEALTH_OK 2024-09-15T23:06:29.196 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:29.196 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:29.196 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:29.196 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:28 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f313bb5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3134074a30 0x7f3134074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f313bb5b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31341a3520 0x7f31341a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f31398f7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c003530 0x7f31340744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f31398f7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c003530 0x7f31340744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:53484/0 (socket says 172.21.15.145:53484) 2024-09-15T23:06:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f313bb5b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31341095e0 con 0x7f3134074a30 2024-09-15T23:06:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f313bb5b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3134109460 con 0x7f31341a3520 2024-09-15T23:06:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f313bb5b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3134109760 con 0x7f311c003530 2024-09-15T23:06:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f31398f7640 1 -- 172.21.15.145:0/1001717118 learned_addr learned my addr 172.21.15.145:0/1001717118 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-15T23:06:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f31390f6640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3134074a30 0x7f3134074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f313a0f8640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31341a3520 0x7f31341a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f31398f7640 1 -- 172.21.15.145:0/1001717118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c003530 msgr2=0x7f31340744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-15T23:06:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f31398f7640 1 -- 172.21.15.145:0/1001717118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c003530 msgr2=0x7f31340744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T23:06:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f31398f7640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c003530 0x7f31340744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:06:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f31398f7640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c003530 0x7f31340744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:06:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f313a0f8640 1 -- 172.21.15.145:0/1001717118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31341a3520 msgr2=0x7f31341a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-15T23:06:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f313a0f8640 1 -- 172.21.15.145:0/1001717118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31341a3520 msgr2=0x7f31341a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T23:06:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f313a0f8640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31341a3520 0x7f31341a5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:06:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f313a0f8640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31341a3520 0x7f31341a5910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:06:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f31390f6640 1 -- 172.21.15.145:0/1001717118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c003530 msgr2=0x7f31340744f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:06:29.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f31390f6640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c003530 0x7f31340744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f31390f6640 1 -- 172.21.15.145:0/1001717118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31341a3520 msgr2=0x7f31341a5910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f31390f6640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31341a3520 0x7f31341a5910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.192+0000 7f31390f6640 1 -- 172.21.15.145:0/1001717118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31341a5fe0 con 0x7f3134074a30 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.193+0000 7f31390f6640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3134074a30 0x7f3134074e90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f312800b450 tx=0x7f312800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.193+0000 7f3132ffd640 1 -- 172.21.15.145:0/1001717118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3128004230 con 0x7f3134074a30 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.193+0000 7f313bb5b640 1 -- 172.21.15.145:0/1001717118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31341a62d0 con 0x7f3134074a30 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.193+0000 7f3132ffd640 1 -- 172.21.15.145:0/1001717118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31280043d0 con 0x7f3134074a30 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.193+0000 7f3132ffd640 1 -- 172.21.15.145:0/1001717118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3128003be0 con 0x7f3134074a30 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.193+0000 7f313bb5b640 1 -- 172.21.15.145:0/1001717118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31341a6860 con 0x7f3134074a30 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.194+0000 7f313bb5b640 1 -- 172.21.15.145:0/1001717118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f313410a710 con 0x7f3134074a30 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.194+0000 7f3132ffd640 1 -- 172.21.15.145:0/1001717118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f312800f050 con 0x7f3134074a30 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.195+0000 7f3132ffd640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3120039730 0x7f312003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.195+0000 7f3132ffd640 1 -- 172.21.15.145:0/1001717118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f312804c010 con 0x7f3134074a30 2024-09-15T23:06:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.195+0000 7f31398f7640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3120039730 0x7f312003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.195+0000 7f31398f7640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3120039730 0x7f312003bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3124009b30 tx=0x7f312402e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.200+0000 7f3132ffd640 1 -- 172.21.15.145:0/1001717118 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f312800d040 con 0x7f3134074a30 2024-09-15T23:06:29.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:29.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:06:29.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:29.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: mon.c calling monitor election 2024-09-15T23:06:29.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: mon.a calling monitor election 2024-09-15T23:06:29.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:29.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:29.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:29.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:29.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:29.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:29.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: monmap epoch 3 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: last_changed 2024-09-15T23:06:23.791065+0000 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: created 2024-09-15T23:04:42.039015+0000 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: min_mon_release 19 (squid) 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: election_strategy: 1 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: 2: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: fsmap 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: mgrmap e13: x(active, since 47s) 2024-09-15T23:06:29.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: overall HEALTH_OK 2024-09-15T23:06:29.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:29.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:29.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:29.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:28 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:29.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.447+0000 7f313bb5b640 1 -- 172.21.15.145:0/1001717118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3134190d40 con 0x7f3134074a30 2024-09-15T23:06:29.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.448+0000 7f3132ffd640 1 -- 172.21.15.145:0/1001717118 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f3128021c20 con 0x7f3134074a30 2024-09-15T23:06:29.449 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:06:29.449 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":3,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","modified":"2024-09-15T23:06:23.791065Z","created":"2024-09-15T23:04:42.039015Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3300","nonce":0},{"type":"v1","addr":"172.21.15.145:6789","nonce":0}]},"addr":"172.21.15.145:6789/0","public_addr":"172.21.15.145:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T23:06:29.450 INFO:teuthology.orchestra.run.smithi145.stderr:dumped monmap epoch 3 2024-09-15T23:06:29.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.450+0000 7f313bb5b640 1 -- 172.21.15.145:0/1001717118 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3120039730 msgr2=0x7f312003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:29.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.450+0000 7f313bb5b640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3120039730 0x7f312003bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3124009b30 tx=0x7f312402e040 comp rx=0 tx=0).stop 2024-09-15T23:06:29.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.450+0000 7f313bb5b640 1 -- 172.21.15.145:0/1001717118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3134074a30 msgr2=0x7f3134074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:29.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.450+0000 7f313bb5b640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3134074a30 0x7f3134074e90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f312800b450 tx=0x7f312800b910 comp rx=0 tx=0).stop 2024-09-15T23:06:29.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.450+0000 7f313bb5b640 1 -- 172.21.15.145:0/1001717118 shutdown_connections 2024-09-15T23:06:29.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.450+0000 7f313bb5b640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3120039730 0x7f312003bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:29.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.450+0000 7f313bb5b640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31341a3520 0x7f31341a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:29.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.450+0000 7f313bb5b640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3134074a30 0x7f3134074e90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:29.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.450+0000 7f313bb5b640 1 --2- 172.21.15.145:0/1001717118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c003530 0x7f31340744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:29.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.450+0000 7f313bb5b640 1 -- 172.21.15.145:0/1001717118 >> 172.21.15.145:0/1001717118 conn(0x7f31340fd330 msgr2=0x7f3134106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:29.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.450+0000 7f313bb5b640 1 -- 172.21.15.145:0/1001717118 shutdown_connections 2024-09-15T23:06:29.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:29.450+0000 7f313bb5b640 1 -- 172.21.15.145:0/1001717118 wait complete. 2024-09-15T23:06:30.117 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:29 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:30.117 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:29 smithi145 ceph-mon[34901]: from='client.? 172.21.15.145:0/1001717118' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:06:30.118 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:29 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:30.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:29 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:30.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:29 smithi002 ceph-mon[31019]: from='client.? 172.21.15.145:0/1001717118' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:06:30.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:29 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:30.646 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-15T23:06:30.646 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-15T23:06:30.901 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:06:31.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:31.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:06:31.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:31.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: mon.c calling monitor election 2024-09-15T23:06:31.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: mon.a calling monitor election 2024-09-15T23:06:31.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:06:31.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:31.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:31.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:31.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:31.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:31.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:31.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:31.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T23:06:31.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: monmap epoch 3 2024-09-15T23:06:31.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:31.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: last_changed 2024-09-15T23:06:23.791065+0000 2024-09-15T23:06:31.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: created 2024-09-15T23:04:42.039015+0000 2024-09-15T23:06:31.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: min_mon_release 19 (squid) 2024-09-15T23:06:31.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: election_strategy: 1 2024-09-15T23:06:31.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-15T23:06:31.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-15T23:06:31.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: 2: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-09-15T23:06:31.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: fsmap 2024-09-15T23:06:31.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:06:31.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: mgrmap e13: x(active, since 47s) 2024-09-15T23:06:31.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: overall HEALTH_OK 2024-09-15T23:06:31.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:31.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:31.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:31.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:31.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:31.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='client.? 172.21.15.145:0/1001717118' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:06:31.249 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:31.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.363+0000 7fc471b72640 1 -- 172.21.15.2:0/4277836507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c1027f0 msgr2=0x7fc46c102bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:31.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.363+0000 7fc471b72640 1 --2- 172.21.15.2:0/4277836507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c1027f0 0x7fc46c102bd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009810 tx=0x7fc45c02a540 comp rx=0 tx=0).stop 2024-09-15T23:06:31.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.363+0000 7fc471b72640 1 -- 172.21.15.2:0/4277836507 shutdown_connections 2024-09-15T23:06:31.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.363+0000 7fc471b72640 1 --2- 172.21.15.2:0/4277836507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c1027f0 0x7fc46c102bd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:31.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.363+0000 7fc471b72640 1 -- 172.21.15.2:0/4277836507 >> 172.21.15.2:0/4277836507 conn(0x7fc46c077310 msgr2=0x7fc46c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:31.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.363+0000 7fc471b72640 1 -- 172.21.15.2:0/4277836507 shutdown_connections 2024-09-15T23:06:31.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.363+0000 7fc471b72640 1 -- 172.21.15.2:0/4277836507 wait complete. 2024-09-15T23:06:31.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.364+0000 7fc471b72640 1 Processor -- start 2024-09-15T23:06:31.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.364+0000 7fc471b72640 1 -- start start 2024-09-15T23:06:31.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.364+0000 7fc471b72640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc46c1027f0 0x7fc46c197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:31.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.364+0000 7fc471b72640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc46c197850 0x7fc46c19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:31.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.364+0000 7fc471b72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c19c120 0x7fc46c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:31.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.364+0000 7fc471b72640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c10bae0 con 0x7fc46c19c120 2024-09-15T23:06:31.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.364+0000 7fc471b72640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c10b960 con 0x7fc46c197850 2024-09-15T23:06:31.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.364+0000 7fc471b72640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c10bc60 con 0x7fc46c1027f0 2024-09-15T23:06:31.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.364+0000 7fc46bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c19c120 0x7fc46c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:31.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc46bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c19c120 0x7fc46c19c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52154/0 (socket says 172.21.15.2:52154) 2024-09-15T23:06:31.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc46bfff640 1 -- 172.21.15.2:0/4037641328 learned_addr learned my addr 172.21.15.2:0/4037641328 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:06:31.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc46b7fe640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc46c1027f0 0x7fc46c197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:31.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc46affd640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc46c197850 0x7fc46c19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:31.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc46bfff640 1 -- 172.21.15.2:0/4037641328 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc46c1027f0 msgr2=0x7fc46c197310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:31.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc46bfff640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc46c1027f0 0x7fc46c197310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:31.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc46bfff640 1 -- 172.21.15.2:0/4037641328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc46c197850 msgr2=0x7fc46c19bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:31.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc46bfff640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc46c197850 0x7fc46c19bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:31.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc46bfff640 1 -- 172.21.15.2:0/4037641328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46c1a3e90 con 0x7fc46c19c120 2024-09-15T23:06:31.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc46affd640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc46c197850 0x7fc46c19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:06:31.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc46bfff640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c19c120 0x7fc46c19c5d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc46400ba50 tx=0x7fc46400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:31.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc468ff9640 1 -- 172.21.15.2:0/4037641328 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc464019070 con 0x7fc46c19c120 2024-09-15T23:06:31.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc468ff9640 1 -- 172.21.15.2:0/4037641328 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc46400cbe0 con 0x7fc46c19c120 2024-09-15T23:06:31.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc468ff9640 1 -- 172.21.15.2:0/4037641328 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4640075d0 con 0x7fc46c19c120 2024-09-15T23:06:31.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc471b72640 1 -- 172.21.15.2:0/4037641328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc46c1a40c0 con 0x7fc46c19c120 2024-09-15T23:06:31.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.365+0000 7fc471b72640 1 -- 172.21.15.2:0/4037641328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc46c1a45d0 con 0x7fc46c19c120 2024-09-15T23:06:31.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.366+0000 7fc468ff9640 1 -- 172.21.15.2:0/4037641328 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fc46401c070 con 0x7fc46c19c120 2024-09-15T23:06:31.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.366+0000 7fc471b72640 1 -- 172.21.15.2:0/4037641328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc46c069ed0 con 0x7fc46c19c120 2024-09-15T23:06:31.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.367+0000 7fc468ff9640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc454039730 0x7fc45403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:31.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.367+0000 7fc468ff9640 1 -- 172.21.15.2:0/4037641328 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc46404bd00 con 0x7fc46c19c120 2024-09-15T23:06:31.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.367+0000 7fc46b7fe640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc454039730 0x7fc45403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:31.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.367+0000 7fc46b7fe640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc454039730 0x7fc45403bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc45c005e60 tx=0x7fc45c005870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:31.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.372+0000 7fc468ff9640 1 -- 172.21.15.2:0/4037641328 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc4640112a0 con 0x7fc46c19c120 2024-09-15T23:06:31.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.550+0000 7fc471b72640 1 -- 172.21.15.2:0/4037641328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fc46c1a4970 con 0x7fc46c19c120 2024-09-15T23:06:31.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.550+0000 7fc468ff9640 1 -- 172.21.15.2:0/4037641328 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7fc46400e090 con 0x7fc46c19c120 2024-09-15T23:06:31.552 INFO:teuthology.orchestra.run.smithi002.stdout:# minimal ceph.conf for cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:31.552 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-09-15T23:06:31.552 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:31.552 INFO:teuthology.orchestra.run.smithi002.stdout: mon_host = [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] 2024-09-15T23:06:31.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.552+0000 7fc471b72640 1 -- 172.21.15.2:0/4037641328 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc454039730 msgr2=0x7fc45403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:31.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.552+0000 7fc471b72640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc454039730 0x7fc45403bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc45c005e60 tx=0x7fc45c005870 comp rx=0 tx=0).stop 2024-09-15T23:06:31.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.552+0000 7fc471b72640 1 -- 172.21.15.2:0/4037641328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c19c120 msgr2=0x7fc46c19c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:31.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.552+0000 7fc471b72640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c19c120 0x7fc46c19c5d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc46400ba50 tx=0x7fc46400bf10 comp rx=0 tx=0).stop 2024-09-15T23:06:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.553+0000 7fc471b72640 1 -- 172.21.15.2:0/4037641328 shutdown_connections 2024-09-15T23:06:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.553+0000 7fc471b72640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc454039730 0x7fc45403bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.553+0000 7fc471b72640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc46c19c120 0x7fc46c19c5d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.553+0000 7fc471b72640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc46c197850 0x7fc46c19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.553+0000 7fc471b72640 1 --2- 172.21.15.2:0/4037641328 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc46c1027f0 0x7fc46c197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.553+0000 7fc471b72640 1 -- 172.21.15.2:0/4037641328 >> 172.21.15.2:0/4037641328 conn(0x7fc46c077310 msgr2=0x7fc46c103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.553+0000 7fc471b72640 1 -- 172.21.15.2:0/4037641328 shutdown_connections 2024-09-15T23:06:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:31.553+0000 7fc471b72640 1 -- 172.21.15.2:0/4037641328 wait complete. 2024-09-15T23:06:31.701 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: mon.b calling monitor election 2024-09-15T23:06:31.701 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T23:06:31.701 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: Reconfiguring daemon mon.a on smithi002 2024-09-15T23:06:31.701 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: mon.b calling monitor election 2024-09-15T23:06:31.701 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: mon.c calling monitor election 2024-09-15T23:06:31.701 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: mon.a calling monitor election 2024-09-15T23:06:31.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: mon.b calling monitor election 2024-09-15T23:06:31.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T23:06:31.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: Reconfiguring daemon mon.a on smithi002 2024-09-15T23:06:31.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: mon.b calling monitor election 2024-09-15T23:06:31.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: mon.c calling monitor election 2024-09-15T23:06:31.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: mon.a calling monitor election 2024-09-15T23:06:31.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T23:06:31.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: monmap epoch 3 2024-09-15T23:06:31.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:31.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: last_changed 2024-09-15T23:06:23.791065+0000 2024-09-15T23:06:31.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: created 2024-09-15T23:04:42.039015+0000 2024-09-15T23:06:31.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: min_mon_release 19 (squid) 2024-09-15T23:06:31.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: election_strategy: 1 2024-09-15T23:06:31.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-15T23:06:31.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-15T23:06:31.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: 2: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-09-15T23:06:31.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: fsmap 2024-09-15T23:06:31.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:06:31.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: mgrmap e13: x(active, since 49s) 2024-09-15T23:06:31.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: overall HEALTH_OK 2024-09-15T23:06:31.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:31.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:31 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/4037641328' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:31.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: mon.b calling monitor election 2024-09-15T23:06:31.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T23:06:31.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: Reconfiguring daemon mon.a on smithi002 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: mon.b calling monitor election 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: mon.c calling monitor election 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: mon.a calling monitor election 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: monmap epoch 3 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: last_changed 2024-09-15T23:06:23.791065+0000 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: created 2024-09-15T23:04:42.039015+0000 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: min_mon_release 19 (squid) 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: election_strategy: 1 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: 2: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-09-15T23:06:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: fsmap 2024-09-15T23:06:31.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:06:31.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: mgrmap e13: x(active, since 49s) 2024-09-15T23:06:31.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: overall HEALTH_OK 2024-09-15T23:06:31.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:31.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:31 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/4037641328' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:31.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T23:06:31.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: monmap epoch 3 2024-09-15T23:06:31.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:06:31.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: last_changed 2024-09-15T23:06:23.791065+0000 2024-09-15T23:06:31.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: created 2024-09-15T23:04:42.039015+0000 2024-09-15T23:06:31.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: min_mon_release 19 (squid) 2024-09-15T23:06:31.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: election_strategy: 1 2024-09-15T23:06:31.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-15T23:06:31.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: 1: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.c 2024-09-15T23:06:31.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: 2: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-09-15T23:06:31.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: fsmap 2024-09-15T23:06:31.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:06:31.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: mgrmap e13: x(active, since 49s) 2024-09-15T23:06:31.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: overall HEALTH_OK 2024-09-15T23:06:31.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:31.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:31 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/4037641328' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:32.273 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-15T23:06:32.273 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:06:32.273 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T23:06:32.301 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:06:32.301 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:06:32.367 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:06:32.367 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T23:06:32.396 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:06:32.396 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:06:32.461 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-15T23:06:32.462 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T23:06:32.494 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-15T23:06:32.494 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:06:32.563 INFO:tasks.cephadm:Adding mgr.x on smithi002 2024-09-15T23:06:32.563 INFO:tasks.cephadm:Adding mgr.y on smithi112 2024-09-15T23:06:32.563 INFO:tasks.cephadm:Adding mgr.z on smithi145 2024-09-15T23:06:32.563 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi002=x;smithi112=y;smithi145=z' 2024-09-15T23:06:32.847 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:06:32.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:32 smithi145 ceph-mon[34901]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:32.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:32 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:32.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:32 smithi112 ceph-mon[34367]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:32.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:32 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:33.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:32 smithi002 ceph-mon[31019]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:33.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:32 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:06:33.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.270+0000 7f8e7256d640 1 -- 172.21.15.145:0/2172505237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e6c1005e0 msgr2=0x7f8e6c1009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.270+0000 7f8e7256d640 1 --2- 172.21.15.145:0/2172505237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e6c1005e0 0x7f8e6c1009e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009880 tx=0x7f8e5c02a5d0 comp rx=0 tx=0).stop 2024-09-15T23:06:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.270+0000 7f8e7256d640 1 -- 172.21.15.145:0/2172505237 shutdown_connections 2024-09-15T23:06:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.270+0000 7f8e7256d640 1 --2- 172.21.15.145:0/2172505237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e6c1005e0 0x7f8e6c1009e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.270+0000 7f8e7256d640 1 -- 172.21.15.145:0/2172505237 >> 172.21.15.145:0/2172505237 conn(0x7f8e6c0fbdb0 msgr2=0x7f8e6c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.270+0000 7f8e7256d640 1 -- 172.21.15.145:0/2172505237 shutdown_connections 2024-09-15T23:06:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.270+0000 7f8e7256d640 1 -- 172.21.15.145:0/2172505237 wait complete. 2024-09-15T23:06:33.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e7256d640 1 Processor -- start 2024-09-15T23:06:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e7256d640 1 -- start start 2024-09-15T23:06:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e7256d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e6c1005e0 0x7f8e6c195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e7256d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e6c196340 0x7f8e6c19b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e7256d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c1967c0 0x7f8e6c19d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e7256d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c106580 con 0x7f8e6c196340 2024-09-15T23:06:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e7256d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c106400 con 0x7f8e6c1967c0 2024-09-15T23:06:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e7256d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c106700 con 0x7f8e6c1005e0 2024-09-15T23:06:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e6bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e6c1005e0 0x7f8e6c195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e6bfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e6c1005e0 0x7f8e6c195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:54834/0 (socket says 172.21.15.145:54834) 2024-09-15T23:06:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e6bfff640 1 -- 172.21.15.145:0/1678598305 learned_addr learned my addr 172.21.15.145:0/1678598305 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-15T23:06:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e70b0a640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c1967c0 0x7f8e6c19d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e63fff640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e6c196340 0x7f8e6c19b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:33.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e6bfff640 1 -- 172.21.15.145:0/1678598305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c1967c0 msgr2=0x7f8e6c19d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e6bfff640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c1967c0 0x7f8e6c19d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e6bfff640 1 -- 172.21.15.145:0/1678598305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e6c196340 msgr2=0x7f8e6c19b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e6bfff640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e6c196340 0x7f8e6c19b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e6bfff640 1 -- 172.21.15.145:0/1678598305 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6c19e200 con 0x7f8e6c1005e0 2024-09-15T23:06:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.271+0000 7f8e63fff640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e6c196340 0x7f8e6c19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:06:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.272+0000 7f8e6bfff640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e6c1005e0 0x7f8e6c195e00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c006010 tx=0x7f8e5c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.272+0000 7f8e69ffb640 1 -- 172.21.15.145:0/1678598305 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c046070 con 0x7f8e6c1005e0 2024-09-15T23:06:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.272+0000 7f8e7256d640 1 -- 172.21.15.145:0/1678598305 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6c069c10 con 0x7f8e6c1005e0 2024-09-15T23:06:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.272+0000 7f8e69ffb640 1 -- 172.21.15.145:0/1678598305 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e5c003cb0 con 0x7f8e6c1005e0 2024-09-15T23:06:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.272+0000 7f8e69ffb640 1 -- 172.21.15.145:0/1678598305 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c035050 con 0x7f8e6c1005e0 2024-09-15T23:06:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.272+0000 7f8e7256d640 1 -- 172.21.15.145:0/1678598305 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e6c06a1c0 con 0x7f8e6c1005e0 2024-09-15T23:06:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.273+0000 7f8e69ffb640 1 -- 172.21.15.145:0/1678598305 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f8e5c049070 con 0x7f8e6c1005e0 2024-09-15T23:06:33.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.273+0000 7f8e69ffb640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8e58039730 0x7f8e5803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:33.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.273+0000 7f8e7256d640 1 -- 172.21.15.145:0/1678598305 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6c100a60 con 0x7f8e6c1005e0 2024-09-15T23:06:33.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.273+0000 7f8e69ffb640 1 -- 172.21.15.145:0/1678598305 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8e5c06e390 con 0x7f8e6c1005e0 2024-09-15T23:06:33.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.273+0000 7f8e63fff640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8e58039730 0x7f8e5803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:33.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.273+0000 7f8e63fff640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8e58039730 0x7f8e5803bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8e54006fd0 tx=0x7f8e54008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:33.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.278+0000 7f8e69ffb640 1 -- 172.21.15.145:0/1678598305 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e5c050020 con 0x7f8e6c1005e0 2024-09-15T23:06:33.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.453+0000 7f8e7256d640 1 -- 172.21.15.145:0/1678598305 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi112=y;smithi145=z", "target": ["mon-mgr", ""]}) -- 0x7f8e6c06a420 con 0x7f8e58039730 2024-09-15T23:06:33.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.458+0000 7f8e69ffb640 1 -- 172.21.15.145:0/1678598305 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8e6c06a420 con 0x7f8e58039730 2024-09-15T23:06:33.459 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled mgr update... 2024-09-15T23:06:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.460+0000 7f8e7256d640 1 -- 172.21.15.145:0/1678598305 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8e58039730 msgr2=0x7f8e5803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.460+0000 7f8e7256d640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8e58039730 0x7f8e5803bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8e54006fd0 tx=0x7f8e54008040 comp rx=0 tx=0).stop 2024-09-15T23:06:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.460+0000 7f8e7256d640 1 -- 172.21.15.145:0/1678598305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e6c1005e0 msgr2=0x7f8e6c195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.460+0000 7f8e7256d640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e6c1005e0 0x7f8e6c195e00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c006010 tx=0x7f8e5c004270 comp rx=0 tx=0).stop 2024-09-15T23:06:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.460+0000 7f8e7256d640 1 -- 172.21.15.145:0/1678598305 shutdown_connections 2024-09-15T23:06:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.460+0000 7f8e7256d640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8e58039730 0x7f8e5803bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.460+0000 7f8e7256d640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8e6c1967c0 0x7f8e6c19d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.460+0000 7f8e7256d640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e6c196340 0x7f8e6c19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.460+0000 7f8e7256d640 1 --2- 172.21.15.145:0/1678598305 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e6c1005e0 0x7f8e6c195e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:33.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.460+0000 7f8e7256d640 1 -- 172.21.15.145:0/1678598305 >> 172.21.15.145:0/1678598305 conn(0x7f8e6c0fbdb0 msgr2=0x7f8e6c0fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.460+0000 7f8e7256d640 1 -- 172.21.15.145:0/1678598305 shutdown_connections 2024-09-15T23:06:33.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:06:33.460+0000 7f8e7256d640 1 -- 172.21.15.145:0/1678598305 wait complete. 2024-09-15T23:06:34.037 DEBUG:teuthology.orchestra.run.smithi112:mgr.y> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.y.service 2024-09-15T23:06:34.040 DEBUG:teuthology.orchestra.run.smithi145:mgr.z> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.z.service 2024-09-15T23:06:34.042 INFO:tasks.cephadm:Deploying OSDs... 2024-09-15T23:06:34.043 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:06:34.043 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T23:06:34.063 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T23:06:34.063 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-09-15T23:06:34.124 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T23:06:34.124 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:06:34.125 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-15T23:06:34.125 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:06:34.125 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:06:34.125 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-15 23:05:50.137920845 +0000 2024-09-15T23:06:34.125 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-15 23:01:49.426327552 +0000 2024-09-15T23:06:34.125 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-15 23:01:49.426327552 +0000 2024-09-15T23:06:34.125 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-15 23:01:49.426327552 +0000 2024-09-15T23:06:34.125 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T23:06:34.196 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-15T23:06:34.196 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-15T23:06:34.196 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000127184 s, 4.0 MB/s 2024-09-15T23:06:34.197 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T23:06:34.258 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-09-15T23:06:34.317 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T23:06:34.317 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:06:34.317 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-15T23:06:34.317 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:06:34.317 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:06:34.317 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-15 23:05:50.171920098 +0000 2024-09-15T23:06:34.317 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-15 23:01:49.770319942 +0000 2024-09-15T23:06:34.317 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-15 23:01:49.770319942 +0000 2024-09-15T23:06:34.317 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-15 23:01:49.770319942 +0000 2024-09-15T23:06:34.318 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T23:06:34.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:34 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:34.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:34 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:34.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:34 smithi002 ceph-mon[31019]: Reconfiguring mon.b (monmap changed)... 2024-09-15T23:06:34.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:34 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:06:34.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:34 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:06:34.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:34 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:34.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:34 smithi002 ceph-mon[31019]: Reconfiguring daemon mon.b on smithi112 2024-09-15T23:06:34.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:34 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:34.386 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-15T23:06:34.386 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-15T23:06:34.386 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000130279 s, 3.9 MB/s 2024-09-15T23:06:34.388 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T23:06:34.429 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:34 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:34.429 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:34 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:34.429 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:34 smithi112 ceph-mon[34367]: Reconfiguring mon.b (monmap changed)... 2024-09-15T23:06:34.429 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:34 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:06:34.429 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:34 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:06:34.430 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:34 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:34.430 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:34 smithi112 ceph-mon[34367]: Reconfiguring daemon mon.b on smithi112 2024-09-15T23:06:34.430 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:34 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:34.448 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-09-15T23:06:34.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:34 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:34.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:34 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:34.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:34 smithi145 ceph-mon[34901]: Reconfiguring mon.b (monmap changed)... 2024-09-15T23:06:34.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:34 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:06:34.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:34 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:06:34.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:34 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:34.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:34 smithi145 ceph-mon[34901]: Reconfiguring daemon mon.b on smithi112 2024-09-15T23:06:34.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:34 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:34.506 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T23:06:34.507 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:06:34.507 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-15T23:06:34.507 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:06:34.507 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:06:34.507 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-15 23:05:50.207919306 +0000 2024-09-15T23:06:34.507 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-15 23:01:50.083313018 +0000 2024-09-15T23:06:34.507 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-15 23:01:50.083313018 +0000 2024-09-15T23:06:34.507 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-15 23:01:50.083313018 +0000 2024-09-15T23:06:34.507 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T23:06:34.576 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-15T23:06:34.577 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-15T23:06:34.577 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000119434 s, 4.3 MB/s 2024-09-15T23:06:34.577 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T23:06:34.636 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-09-15T23:06:34.693 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T23:06:34.694 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:06:34.694 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-15T23:06:34.694 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:06:34.694 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:06:34.694 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-15 23:05:50.242918537 +0000 2024-09-15T23:06:34.694 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-15 23:01:50.423305497 +0000 2024-09-15T23:06:34.694 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-15 23:01:50.423305497 +0000 2024-09-15T23:06:34.694 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-15 23:01:50.423305497 +0000 2024-09-15T23:06:34.694 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T23:06:34.762 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-15T23:06:34.762 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-15T23:06:34.762 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000115054 s, 4.5 MB/s 2024-09-15T23:06:34.764 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T23:06:34.823 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-15T23:06:34.823 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T23:06:34.839 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T23:06:34.839 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-09-15T23:06:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T23:06:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:06:34.895 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-15T23:06:34.895 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:06:34.895 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:06:34.895 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-15 23:06:23.236938381 +0000 2024-09-15T23:06:34.895 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-15 23:01:44.740215847 +0000 2024-09-15T23:06:34.895 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-15 23:01:44.740215847 +0000 2024-09-15T23:06:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-15 23:01:44.740215847 +0000 2024-09-15T23:06:34.895 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T23:06:34.959 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-15T23:06:34.959 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-15T23:06:34.959 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000233869 s, 2.2 MB/s 2024-09-15T23:06:34.961 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T23:06:35.017 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-09-15T23:06:35.073 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T23:06:35.073 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:06:35.073 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-15T23:06:35.073 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:06:35.073 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:06:35.073 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-15 23:06:23.236938381 +0000 2024-09-15T23:06:35.073 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-15 23:01:45.081206998 +0000 2024-09-15T23:06:35.073 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-15 23:01:45.081206998 +0000 2024-09-15T23:06:35.073 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-15 23:01:45.081206998 +0000 2024-09-15T23:06:35.074 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T23:06:35.136 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-15T23:06:35.136 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-15T23:06:35.137 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000196088 s, 2.6 MB/s 2024-09-15T23:06:35.138 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T23:06:35.194 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-09-15T23:06:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:35 smithi112 ceph-mon[34367]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:35 smithi112 ceph-mon[34367]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi112=y;smithi145=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:06:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:35 smithi112 ceph-mon[34367]: Saving service mgr spec with placement smithi002=x;smithi112=y;smithi145=z;count:3 2024-09-15T23:06:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:06:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:06:35.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:35.249 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T23:06:35.249 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:06:35.249 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-15T23:06:35.249 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:06:35.249 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:06:35.249 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-15 23:06:23.237938355 +0000 2024-09-15T23:06:35.249 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-15 23:01:45.398198771 +0000 2024-09-15T23:06:35.250 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-15 23:01:45.398198771 +0000 2024-09-15T23:06:35.250 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-15 23:01:45.398198771 +0000 2024-09-15T23:06:35.250 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T23:06:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-15T23:06:35.312 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-15T23:06:35.313 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000208034 s, 2.5 MB/s 2024-09-15T23:06:35.314 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T23:06:35.370 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-09-15T23:06:35.427 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T23:06:35.427 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:06:35.427 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-15T23:06:35.427 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:06:35.427 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:06:35.427 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-15 23:06:23.237938355 +0000 2024-09-15T23:06:35.427 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-15 23:01:45.729190181 +0000 2024-09-15T23:06:35.427 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-15 23:01:45.729190181 +0000 2024-09-15T23:06:35.427 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-15 23:01:45.729190181 +0000 2024-09-15T23:06:35.428 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T23:06:35.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:35 smithi145 ceph-mon[34901]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:35 smithi145 ceph-mon[34901]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi112=y;smithi145=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:06:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:35 smithi145 ceph-mon[34901]: Saving service mgr spec with placement smithi002=x;smithi112=y;smithi145=z;count:3 2024-09-15T23:06:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:06:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:06:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-15T23:06:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-15T23:06:35.490 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000192979 s, 2.7 MB/s 2024-09-15T23:06:35.491 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T23:06:35.548 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-15T23:06:35.548 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T23:06:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:35 smithi002 ceph-mon[31019]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:35 smithi002 ceph-mon[31019]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi112=y;smithi145=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:06:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:35 smithi002 ceph-mon[31019]: Saving service mgr spec with placement smithi002=x;smithi112=y;smithi145=z;count:3 2024-09-15T23:06:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:06:35.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:06:35.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:35.565 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T23:06:35.566 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2024-09-15T23:06:35.622 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T23:06:35.622 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:06:35.622 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-15T23:06:35.622 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:06:35.622 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:06:35.623 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-15 23:06:13.975649026 +0000 2024-09-15T23:06:35.623 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-15 23:01:44.738604998 +0000 2024-09-15T23:06:35.623 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-15 23:01:44.738604998 +0000 2024-09-15T23:06:35.623 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-15 23:01:44.738604998 +0000 2024-09-15T23:06:35.623 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T23:06:35.688 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-15T23:06:35.688 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-15T23:06:35.689 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000211627 s, 2.4 MB/s 2024-09-15T23:06:35.690 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T23:06:35.747 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2024-09-15T23:06:35.805 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T23:06:35.805 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:06:35.805 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-15T23:06:35.805 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:06:35.805 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:06:35.806 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-15 23:06:13.976649004 +0000 2024-09-15T23:06:35.806 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-15 23:01:45.058597773 +0000 2024-09-15T23:06:35.806 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-15 23:01:45.058597773 +0000 2024-09-15T23:06:35.806 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-15 23:01:45.058597773 +0000 2024-09-15T23:06:35.806 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T23:06:35.871 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-15T23:06:35.871 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-15T23:06:35.871 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000238265 s, 2.1 MB/s 2024-09-15T23:06:35.872 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T23:06:35.928 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2024-09-15T23:06:35.985 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T23:06:35.986 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:06:35.986 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-15T23:06:35.986 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:06:35.986 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:06:35.986 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-15 23:06:13.976649004 +0000 2024-09-15T23:06:35.986 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-15 23:01:45.402590006 +0000 2024-09-15T23:06:35.986 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-15 23:01:45.402590006 +0000 2024-09-15T23:06:35.986 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-15 23:01:45.402590006 +0000 2024-09-15T23:06:35.986 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T23:06:36.050 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-15T23:06:36.051 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-15T23:06:36.051 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000215249 s, 2.4 MB/s 2024-09-15T23:06:36.052 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T23:06:36.109 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2024-09-15T23:06:36.166 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T23:06:36.166 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:06:36.166 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-15T23:06:36.166 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:06:36.166 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:06:36.167 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-15 23:06:13.976649004 +0000 2024-09-15T23:06:36.167 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-15 23:01:45.732582555 +0000 2024-09-15T23:06:36.167 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-15 23:01:45.732582555 +0000 2024-09-15T23:06:36.167 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-15 23:01:45.732582555 +0000 2024-09-15T23:06:36.167 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T23:06:36.231 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-15T23:06:36.231 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-15T23:06:36.231 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000203731 s, 2.5 MB/s 2024-09-15T23:06:36.232 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T23:06:36.288 INFO:tasks.cephadm:Deploying osd.0 on smithi002 with /dev/vg_nvme/lv_4... 2024-09-15T23:06:36.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T23:06:36.390 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:36 smithi145 ceph-mon[34901]: Reconfiguring mon.c (monmap changed)... 2024-09-15T23:06:36.390 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:36 smithi145 ceph-mon[34901]: Reconfiguring daemon mon.c on smithi145 2024-09-15T23:06:36.390 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:36.390 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:36.390 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:36.390 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:36.391 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:36.391 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:36.391 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:06:36.391 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T23:06:36.391 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:06:36.391 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:36.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:36 smithi112 ceph-mon[34367]: Reconfiguring mon.c (monmap changed)... 2024-09-15T23:06:36.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:36 smithi112 ceph-mon[34367]: Reconfiguring daemon mon.c on smithi145 2024-09-15T23:06:36.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:36.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:36.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:36.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:36.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:36.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:36.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:06:36.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T23:06:36.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:06:36.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:06:36.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:36 smithi002 ceph-mon[31019]: Reconfiguring mon.c (monmap changed)... 2024-09-15T23:06:36.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:36 smithi002 ceph-mon[31019]: Reconfiguring daemon mon.c on smithi145 2024-09-15T23:06:36.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:36.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:36.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:36.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:36.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:36.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:36.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:06:36.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T23:06:36.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:06:36.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:37.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:37 smithi002 ceph-mon[31019]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:37.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:37 smithi002 ceph-mon[31019]: Deploying daemon mgr.z on smithi145 2024-09-15T23:06:37.349 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:37 smithi145 ceph-mon[34901]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:37.349 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:37 smithi145 ceph-mon[34901]: Deploying daemon mgr.z on smithi145 2024-09-15T23:06:37.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:37 smithi112 ceph-mon[34367]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:37.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:37 smithi112 ceph-mon[34367]: Deploying daemon mgr.z on smithi145 2024-09-15T23:06:37.707 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:37 smithi145 systemd[1]: Starting Ceph mgr.z for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:06:38.002 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:37 smithi145 podman[36693]: 2024-09-15 23:06:37.715497297 +0000 UTC m=+0.111804162 container create 443e6d5a71de7cf0ff9a2f911a63d89177c25abb7a64444b0db62dc56139143e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-15T23:06:38.002 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:37 smithi145 podman[36693]: 2024-09-15 23:06:37.619311362 +0000 UTC m=+0.015618239 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:06:38.002 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:37 smithi145 podman[36693]: 2024-09-15 23:06:37.92632172 +0000 UTC m=+0.322628580 container init 443e6d5a71de7cf0ff9a2f911a63d89177c25abb7a64444b0db62dc56139143e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-15T23:06:38.002 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:37 smithi145 podman[36693]: 2024-09-15 23:06:37.929290997 +0000 UTC m=+0.325597860 container start 443e6d5a71de7cf0ff9a2f911a63d89177c25abb7a64444b0db62dc56139143e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=) 2024-09-15T23:06:38.002 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:37 smithi145 ceph-mgr[36712]: -- 172.21.15.145:0/106567245 <== mon.1 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560f564b30e0 con 0x560f56490800 2024-09-15T23:06:38.002 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:38 smithi145 bash[36693]: 443e6d5a71de7cf0ff9a2f911a63d89177c25abb7a64444b0db62dc56139143e 2024-09-15T23:06:38.259 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:38 smithi145 systemd[1]: Started Ceph mgr.z for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:06:38.259 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:38.051+0000 7fbf3e1b6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:06:38.259 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:38.110+0000 7fbf3e1b6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:06:38.259 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:38.257+0000 7fbf3e1b6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:06:38.609 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:38.323+0000 7fbf3e1b6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:06:38.609 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:38.470+0000 7fbf3e1b6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:06:38.609 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:38.608+0000 7fbf3e1b6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:06:39.016 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:06:39.047 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_4 2024-09-15T23:06:39.207 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:38.916+0000 7fbf3e1b6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:06:39.207 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:38.976+0000 7fbf3e1b6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:06:39.207 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:39 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:39.159+0000 7fbf3e1b6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:06:39.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:39 smithi145 ceph-mon[34901]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:39.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:39 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:39.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:39 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:39.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:39 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:39.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:39 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:06:39.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:39 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T23:06:39.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:39 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:06:39.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:39 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:39.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:39 smithi145 ceph-mon[34901]: Deploying daemon mgr.y on smithi112 2024-09-15T23:06:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:06:39.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:39 smithi002 ceph-mon[31019]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:39.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:39 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:39.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:39 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:39.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:39 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:39.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:39 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:06:39.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:39 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T23:06:39.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:39 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:06:39.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:39 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:39.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:39 smithi002 ceph-mon[31019]: Deploying daemon mgr.y on smithi112 2024-09-15T23:06:39.377 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:39 smithi112 ceph-mon[34367]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:39.377 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:39 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:39.377 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:39 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:39.377 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:39 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:39.377 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:39 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:06:39.377 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:39 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T23:06:39.377 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:39 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:06:39.377 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:39 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:39.377 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:39 smithi112 ceph-mon[34367]: Deploying daemon mgr.y on smithi112 2024-09-15T23:06:39.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.760+0000 7f98d24be640 1 -- 172.21.15.2:0/684971569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc107900 msgr2=0x7f98cc109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.760+0000 7f98d24be640 1 --2- 172.21.15.2:0/684971569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc107900 0x7f98cc109d50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009ca0 tx=0x7f98c402a8c0 comp rx=0 tx=0).stop 2024-09-15T23:06:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.760+0000 7f98d24be640 1 -- 172.21.15.2:0/684971569 shutdown_connections 2024-09-15T23:06:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.760+0000 7f98d24be640 1 --2- 172.21.15.2:0/684971569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc107900 0x7f98cc109d50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.760+0000 7f98d24be640 1 --2- 172.21.15.2:0/684971569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc104fd0 0x7f98cc1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.760+0000 7f98d24be640 1 --2- 172.21.15.2:0/684971569 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98cc1026a0 0x7f98cc104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.760+0000 7f98d24be640 1 -- 172.21.15.2:0/684971569 >> 172.21.15.2:0/684971569 conn(0x7f98cc0fc2a0 msgr2=0x7f98cc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:06:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.760+0000 7f98d24be640 1 -- 172.21.15.2:0/684971569 shutdown_connections 2024-09-15T23:06:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.760+0000 7f98d24be640 1 -- 172.21.15.2:0/684971569 wait complete. 2024-09-15T23:06:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.760+0000 7f98d24be640 1 Processor -- start 2024-09-15T23:06:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.760+0000 7f98d24be640 1 -- start start 2024-09-15T23:06:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d24be640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98cc1026a0 0x7f98cc102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d24be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc104fd0 0x7f98cc100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:39.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d24be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc107900 0x7f98cc100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:39.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d24be640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc10d7c0 con 0x7f98cc107900 2024-09-15T23:06:39.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d24be640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc10d640 con 0x7f98cc104fd0 2024-09-15T23:06:39.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d24be640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc10d940 con 0x7f98cc1026a0 2024-09-15T23:06:39.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d0a5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc107900 0x7f98cc100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:39.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98cbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98cc1026a0 0x7f98cc102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:39.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98cb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc104fd0 0x7f98cc100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:39.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d0a5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc107900 0x7f98cc100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36470/0 (socket says 172.21.15.2:36470) 2024-09-15T23:06:39.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98cbfff640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98cc1026a0 0x7f98cc102000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:40362/0 (socket says 172.21.15.2:40362) 2024-09-15T23:06:39.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d0a5b640 1 -- 172.21.15.2:0/3291296183 learned_addr learned my addr 172.21.15.2:0/3291296183 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:06:39.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d0a5b640 1 -- 172.21.15.2:0/3291296183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98cc1026a0 msgr2=0x7f98cc102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:39.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d0a5b640 1 --2- 172.21.15.2:0/3291296183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98cc1026a0 0x7f98cc102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d0a5b640 1 -- 172.21.15.2:0/3291296183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc104fd0 msgr2=0x7f98cc100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:06:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d0a5b640 1 --2- 172.21.15.2:0/3291296183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc104fd0 0x7f98cc100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:06:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d0a5b640 1 -- 172.21.15.2:0/3291296183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98cc101450 con 0x7f98cc107900 2024-09-15T23:06:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d0a5b640 1 --2- 172.21.15.2:0/3291296183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc107900 0x7f98cc100b90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f98c4031040 tx=0x7f98c4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98c97fa640 1 -- 172.21.15.2:0/3291296183 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4032ec0 con 0x7f98cc107900 2024-09-15T23:06:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98c97fa640 1 -- 172.21.15.2:0/3291296183 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98c40044f0 con 0x7f98cc107900 2024-09-15T23:06:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98d24be640 1 -- 172.21.15.2:0/3291296183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98cc1a1ec0 con 0x7f98cc107900 2024-09-15T23:06:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.761+0000 7f98c97fa640 1 -- 172.21.15.2:0/3291296183 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4030c30 con 0x7f98cc107900 2024-09-15T23:06:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.762+0000 7f98d24be640 1 -- 172.21.15.2:0/3291296183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98cc1a23c0 con 0x7f98cc107900 2024-09-15T23:06:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.762+0000 7f98c97fa640 1 -- 172.21.15.2:0/3291296183 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f98c404e440 con 0x7f98cc107900 2024-09-15T23:06:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.762+0000 7f98d24be640 1 -- 172.21.15.2:0/3291296183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98cc0fdd90 con 0x7f98cc107900 2024-09-15T23:06:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.763+0000 7f98c97fa640 1 --2- 172.21.15.2:0/3291296183 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f98b4039670 0x7f98b403bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:06:39.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.763+0000 7f98c97fa640 1 -- 172.21.15.2:0/3291296183 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f98c406db00 con 0x7f98cc107900 2024-09-15T23:06:39.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.763+0000 7f98cbfff640 1 --2- 172.21.15.2:0/3291296183 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f98b4039670 0x7f98b403bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:06:39.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.763+0000 7f98cbfff640 1 --2- 172.21.15.2:0/3291296183 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f98b4039670 0x7f98b403bb30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98bc005fd0 tx=0x7f98bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:06:39.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.767+0000 7f98c97fa640 1 -- 172.21.15.2:0/3291296183 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98c404d3a0 con 0x7f98cc107900 2024-09-15T23:06:39.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:39.951+0000 7f98d24be640 1 -- 172.21.15.2:0/3291296183 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f98cc062630 con 0x7f98b4039670 2024-09-15T23:06:39.996 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:39 smithi112 systemd[1]: Starting Ceph mgr.y for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:06:40.306 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:06:40.306 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:06:40.307 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:40.307 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:40 smithi112 podman[35715]: 2024-09-15 23:06:39.934443688 +0000 UTC m=+0.015606986 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:06:40.307 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:40 smithi112 podman[35715]: 2024-09-15 23:06:40.036871167 +0000 UTC m=+0.118034452 container create 657b3f07186c9b200e2638be90094b2da08d3601bb8b10ff0fb8bd6787f265f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=) 2024-09-15T23:06:40.307 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:40 smithi112 podman[35715]: 2024-09-15 23:06:40.23102483 +0000 UTC m=+0.312188115 container init 657b3f07186c9b200e2638be90094b2da08d3601bb8b10ff0fb8bd6787f265f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-15T23:06:40.307 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:40 smithi112 podman[35715]: 2024-09-15 23:06:40.234353186 +0000 UTC m=+0.315516471 container start 657b3f07186c9b200e2638be90094b2da08d3601bb8b10ff0fb8bd6787f265f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=) 2024-09-15T23:06:40.307 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:40 smithi112 ceph-mgr[35735]: -- 172.21.15.112:0/131181603 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d03378f0e0 con 0x55d03376c800 2024-09-15T23:06:40.307 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:40 smithi112 bash[35715]: 657b3f07186c9b200e2638be90094b2da08d3601bb8b10ff0fb8bd6787f265f6 2024-09-15T23:06:40.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:06:40.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:06:40.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:40.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:06:40.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:06:40.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:40.458 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:40 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:40.035+0000 7fbf3e1b6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:06:40.458 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:40 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:40.104+0000 7fbf3e1b6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:06:40.574 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:40 smithi112 systemd[1]: Started Ceph mgr.y for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:06:40.574 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:40.356+0000 7fb30b223040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:06:40.574 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:40.416+0000 7fb30b223040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:06:40.574 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:40.572+0000 7fb30b223040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:06:40.959 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:40.641+0000 7fb30b223040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:06:40.959 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:40.809+0000 7fb30b223040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:06:40.959 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:40.957+0000 7fb30b223040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:06:41.119 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:40 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:40.853+0000 7fbf3e1b6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:06:41.120 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:40 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:40.973+0000 7fbf3e1b6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:06:41.120 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:41.117+0000 7fbf3e1b6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:06:41.374 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:41.187+0000 7fbf3e1b6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:06:41.375 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:41.340+0000 7fbf3e1b6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:06:41.496 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:41 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:41.281+0000 7fb30b223040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:06:41.496 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:41 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:41.344+0000 7fb30b223040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:06:41.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:41 smithi112 ceph-mon[34367]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:41.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:41 smithi112 ceph-mon[34367]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:06:41.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:41.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:41.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:41.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:41.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:41.614 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:41 smithi002 ceph-mon[31019]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:41.615 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:41 smithi002 ceph-mon[31019]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:06:41.615 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:41.615 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:41.615 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:41.615 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:41.615 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:41.638 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-mon[34901]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:41.639 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-mon[34901]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:06:41.639 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:41.639 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:41.639 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:41.639 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:41.639 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:41.639 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:41.409+0000 7fbf3e1b6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:06:41.639 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:41.469+0000 7fbf3e1b6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:06:41.639 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:41.637+0000 7fbf3e1b6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:06:41.913 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:41.706+0000 7fbf3e1b6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:06:41.913 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:41.772+0000 7fbf3e1b6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:06:41.913 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:41.853+0000 7fbf3e1b6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:06:41.996 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:41 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:41.537+0000 7fb30b223040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:06:42.207 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:41.912+0000 7fbf3e1b6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:06:42.207 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:41.970+0000 7fbf3e1b6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:06:42.746 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:42.427+0000 7fb30b223040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:06:42.746 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:42.496+0000 7fb30b223040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:06:42.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:42.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:42.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:42.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T23:06:42.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:06:42.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:06:42.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:42.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: Reconfiguring daemon mgr.x on smithi002 2024-09-15T23:06:42.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/131879912' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40ff4fd9-3904-4178-a9cb-51f4647be540"}]: dispatch 2024-09-15T23:06:42.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/131879912' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40ff4fd9-3904-4178-a9cb-51f4647be540"}]': finished 2024-09-15T23:06:42.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T23:06:42.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:06:42.752 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: Reconfiguring daemon mgr.x on smithi002 2024-09-15T23:06:42.753 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/131879912' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40ff4fd9-3904-4178-a9cb-51f4647be540"}]: dispatch 2024-09-15T23:06:42.754 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/131879912' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40ff4fd9-3904-4178-a9cb-51f4647be540"}]': finished 2024-09-15T23:06:42.754 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T23:06:42.754 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:06:42.757 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:42.757 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.758 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.758 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.758 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.758 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.758 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:42.758 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:42.758 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:42.758 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T23:06:42.758 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:06:42.758 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:06:42.758 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:42.758 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: Reconfiguring daemon mgr.x on smithi002 2024-09-15T23:06:42.758 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/131879912' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40ff4fd9-3904-4178-a9cb-51f4647be540"}]: dispatch 2024-09-15T23:06:42.759 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/131879912' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40ff4fd9-3904-4178-a9cb-51f4647be540"}]': finished 2024-09-15T23:06:42.759 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T23:06:42.759 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:06:43.207 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:06:42 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:06:42.751+0000 7fbf3e1b6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:06:43.461 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:43.209+0000 7fb30b223040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:06:43.461 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:43.322+0000 7fb30b223040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:06:43.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:43.468+0000 7f98c97fa640 1 -- 172.21.15.2:0/3291296183 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 14) ==== 92407+0+0 (secure 0 0 0) 0x7f98c403b410 con 0x7f98cc107900 2024-09-15T23:06:43.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-mon[34367]: Standby manager daemon z started 2024-09-15T23:06:43.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.145:0/4257281969' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T23:06:43.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.145:0/4257281969' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:06:43.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.145:0/4257281969' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T23:06:43.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.145:0/4257281969' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:06:43.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1570397366' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:06:43.743 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:43.464+0000 7fb30b223040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:06:43.743 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:43.526+0000 7fb30b223040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:06:43.743 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:43.673+0000 7fb30b223040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:06:43.743 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:43.741+0000 7fb30b223040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:06:43.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:43 smithi002 ceph-mon[31019]: Standby manager daemon z started 2024-09-15T23:06:43.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:43 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.145:0/4257281969' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T23:06:43.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:43 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.145:0/4257281969' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:06:43.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:43 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.145:0/4257281969' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T23:06:43.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:43 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.145:0/4257281969' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:06:43.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:43 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1570397366' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:06:43.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:43 smithi145 ceph-mon[34901]: Standby manager daemon z started 2024-09-15T23:06:43.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:43 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.145:0/4257281969' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T23:06:43.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:43 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.145:0/4257281969' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:06:43.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:43 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.145:0/4257281969' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T23:06:43.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:43 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.145:0/4257281969' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:06:43.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:43 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1570397366' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:06:43.996 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:43.802+0000 7fb30b223040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:06:43.996 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:43.960+0000 7fb30b223040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:06:44.293 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:44 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:44.025+0000 7fb30b223040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:06:44.293 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:44 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:44.092+0000 7fb30b223040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:06:44.293 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:44 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:44.174+0000 7fb30b223040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:06:44.293 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:44 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:44.233+0000 7fb30b223040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:06:44.293 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:44 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:44.291+0000 7fb30b223040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:06:44.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:44 smithi112 ceph-mon[34367]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:44.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:44 smithi112 ceph-mon[34367]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-15T23:06:44.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:44 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T23:06:44.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:44 smithi002 ceph-mon[31019]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:44.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:44 smithi002 ceph-mon[31019]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-15T23:06:44.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:44 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T23:06:44.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:44 smithi145 ceph-mon[34901]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:44.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:44 smithi145 ceph-mon[34901]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-15T23:06:44.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:44 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T23:06:45.475 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:06:45 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:06:45.072+0000 7fb30b223040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:06:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:06:45.478+0000 7f98c97fa640 1 -- 172.21.15.2:0/3291296183 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f98c40393b0 con 0x7f98cc107900 2024-09-15T23:06:45.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:45 smithi112 ceph-mon[34367]: Standby manager daemon y started 2024-09-15T23:06:45.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:45 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.112:0/1193906573' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T23:06:45.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:45 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.112:0/1193906573' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:06:45.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:45 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.112:0/1193906573' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T23:06:45.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:45 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.112:0/1193906573' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:06:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:45 smithi002 ceph-mon[31019]: Standby manager daemon y started 2024-09-15T23:06:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:45 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.112:0/1193906573' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T23:06:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:45 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.112:0/1193906573' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:06:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:45 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.112:0/1193906573' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T23:06:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:45 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.112:0/1193906573' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:06:45.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:45 smithi145 ceph-mon[34901]: Standby manager daemon y started 2024-09-15T23:06:45.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:45 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.112:0/1193906573' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T23:06:45.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:45 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.112:0/1193906573' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:06:45.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:45 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.112:0/1193906573' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T23:06:45.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:45 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.112:0/1193906573' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:06:46.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:46 smithi112 ceph-mon[34367]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:46.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:46 smithi112 ceph-mon[34367]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-15T23:06:46.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:46 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T23:06:46.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:46 smithi002 ceph-mon[31019]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:46.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:46 smithi002 ceph-mon[31019]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-15T23:06:46.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:46 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T23:06:46.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:46 smithi145 ceph-mon[34901]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:46.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:46 smithi145 ceph-mon[34901]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-15T23:06:46.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:46 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T23:06:48.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:48 smithi112 ceph-mon[34367]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:48.786 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:48 smithi002 ceph-mon[31019]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:48.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:48 smithi145 ceph-mon[34901]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:50.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:50.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:50.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:50.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:50.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:50.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:50.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:50.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:50.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:50.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:50.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:50.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:50.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:50.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:50.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:50.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:50.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:06:50.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:51.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:51 smithi002 ceph-mon[31019]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:51.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:51 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T23:06:51.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:51 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:51.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:51 smithi145 ceph-mon[34901]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:51.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:51 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T23:06:51.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:51 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:51.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:51 smithi112 ceph-mon[34367]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:51.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:51 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T23:06:51.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:51 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:06:52.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:52 smithi145 ceph-mon[34901]: Deploying daemon osd.0 on smithi002 2024-09-15T23:06:52.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:52 smithi112 ceph-mon[34367]: Deploying daemon osd.0 on smithi002 2024-09-15T23:06:52.776 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:52 smithi002 ceph-mon[31019]: Deploying daemon osd.0 on smithi002 2024-09-15T23:06:53.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:53 smithi002 ceph-mon[31019]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:53.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:53 smithi145 ceph-mon[34901]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:53.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:53 smithi112 ceph-mon[34367]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:55.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:55 smithi145 ceph-mon[34901]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:55.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:55 smithi112 ceph-mon[34367]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:55.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:55 smithi002 ceph-mon[31019]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:57.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:57 smithi145 ceph-mon[34901]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:57.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:57 smithi112 ceph-mon[34367]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:57.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:57 smithi002 ceph-mon[31019]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:58.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:58.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:58.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:58.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:58.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:58.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:58.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:06:58.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:58.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:06:59.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:06:59 smithi002 ceph-mon[31019]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:59.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:06:59 smithi145 ceph-mon[34901]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:06:59.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:06:59 smithi112 ceph-mon[34367]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:07:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:01 smithi002 ceph-mon[31019]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:07:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:01.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:01 smithi145 ceph-mon[34901]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:07:01.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:01.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:01.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:01.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:01.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:01.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:01 smithi112 ceph-mon[34367]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:07:01.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:01.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:01.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:01.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:01.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:01.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:01.858+0000 7f98c97fa640 1 -- 172.21.15.2:0/3291296183 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f98cc062630 con 0x7f98b4039670 2024-09-15T23:07:01.860 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 0 on host 'smithi002' 2024-09-15T23:07:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:01.861+0000 7f98d24be640 1 -- 172.21.15.2:0/3291296183 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f98b4039670 msgr2=0x7f98b403bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:01.861+0000 7f98d24be640 1 --2- 172.21.15.2:0/3291296183 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f98b4039670 0x7f98b403bb30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98bc005fd0 tx=0x7f98bc00b390 comp rx=0 tx=0).stop 2024-09-15T23:07:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:01.861+0000 7f98d24be640 1 -- 172.21.15.2:0/3291296183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc107900 msgr2=0x7f98cc100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:01.861+0000 7f98d24be640 1 --2- 172.21.15.2:0/3291296183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc107900 0x7f98cc100b90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f98c4031040 tx=0x7f98c4003ba0 comp rx=0 tx=0).stop 2024-09-15T23:07:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:01.861+0000 7f98d24be640 1 -- 172.21.15.2:0/3291296183 shutdown_connections 2024-09-15T23:07:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:01.861+0000 7f98d24be640 1 --2- 172.21.15.2:0/3291296183 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f98b4039670 0x7f98b403bb30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:01.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:01.861+0000 7f98d24be640 1 --2- 172.21.15.2:0/3291296183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc107900 0x7f98cc100b90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:01.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:01.861+0000 7f98d24be640 1 --2- 172.21.15.2:0/3291296183 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc104fd0 0x7f98cc100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:01.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:01.861+0000 7f98d24be640 1 --2- 172.21.15.2:0/3291296183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98cc1026a0 0x7f98cc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:01.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:01.861+0000 7f98d24be640 1 -- 172.21.15.2:0/3291296183 >> 172.21.15.2:0/3291296183 conn(0x7f98cc0fc2a0 msgr2=0x7f98cc102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:07:01.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:01.861+0000 7f98d24be640 1 -- 172.21.15.2:0/3291296183 shutdown_connections 2024-09-15T23:07:01.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:01.861+0000 7f98d24be640 1 -- 172.21.15.2:0/3291296183 wait complete. 2024-09-15T23:07:02.546 DEBUG:teuthology.orchestra.run.smithi002:osd.0> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.0.service 2024-09-15T23:07:02.548 INFO:tasks.cephadm:Deploying osd.1 on smithi112 with /dev/vg_nvme/lv_4... 2024-09-15T23:07:02.548 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T23:07:02.570 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:02 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:02.570 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:02 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:02.570 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:02 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:02.571 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:02 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:02.571 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:02 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:02.571 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:02 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:02.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:02 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:02.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:02 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:02.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:02 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:02.790 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:07:03.308 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:07:02 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0[42558]: 2024-09-15T23:07:02.928+0000 7f1297f40640 -1 osd.0 0 log_to_monitors true 2024-09-15T23:07:03.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:03 smithi112 ceph-mon[34367]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:07:03.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:03 smithi112 ceph-mon[34367]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T23:07:03.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:03 smithi145 ceph-mon[34901]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:07:03.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:03 smithi145 ceph-mon[34901]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T23:07:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:03 smithi002 ceph-mon[31019]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:07:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:03 smithi002 ceph-mon[31019]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T23:07:04.445 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:04 smithi112 ceph-mon[34367]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T23:07:04.445 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:04 smithi112 ceph-mon[34367]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T23:07:04.445 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:04 smithi112 ceph-mon[34367]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-15T23:07:04.445 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:04 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:04.445 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:04 smithi112 ceph-mon[34367]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-15T23:07:04.445 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:04 smithi112 ceph-mon[34367]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T23:07:04.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:04 smithi002 ceph-mon[31019]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T23:07:04.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:04 smithi002 ceph-mon[31019]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T23:07:04.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:04 smithi002 ceph-mon[31019]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-15T23:07:04.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:04 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:04.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:04 smithi002 ceph-mon[31019]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-15T23:07:04.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:04 smithi002 ceph-mon[31019]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T23:07:04.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:04 smithi145 ceph-mon[34901]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T23:07:04.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:04 smithi145 ceph-mon[34901]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T23:07:04.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:04 smithi145 ceph-mon[34901]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-15T23:07:04.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:04 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:04.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:04 smithi145 ceph-mon[34901]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-15T23:07:04.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:04 smithi145 ceph-mon[34901]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T23:07:04.977 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:07:04 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0[42558]: 2024-09-15T23:07:04.790+0000 7f1293ec3640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T23:07:04.977 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:07:04 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0[42558]: 2024-09-15T23:07:04.794+0000 7f128bce3640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:07:05.083 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:07:05.109 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_4 2024-09-15T23:07:05.401 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:07:05.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:05 smithi002 ceph-mon[31019]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:07:05.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:05 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:05.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:05 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:05.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:05 smithi002 ceph-mon[31019]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' 2024-09-15T23:07:05.606 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:05 smithi112 ceph-mon[34367]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:07:05.606 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:05 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:05.606 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:05 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:05.606 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:05 smithi112 ceph-mon[34367]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' 2024-09-15T23:07:05.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:05 smithi145 ceph-mon[34901]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:07:05.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:05 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:05.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:05 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:05.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:05 smithi145 ceph-mon[34901]: from='osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401]' entity='osd.0' 2024-09-15T23:07:05.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.900+0000 7fc90c4f9640 1 -- 172.21.15.112:0/3392160819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc904101cd0 msgr2=0x7fc904102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:05.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.900+0000 7fc90c4f9640 1 --2- 172.21.15.112:0/3392160819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc904101cd0 0x7fc904102150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc900009900 tx=0x7fc90002a410 comp rx=0 tx=0).stop 2024-09-15T23:07:05.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.900+0000 7fc90c4f9640 1 -- 172.21.15.112:0/3392160819 shutdown_connections 2024-09-15T23:07:05.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.900+0000 7fc90c4f9640 1 --2- 172.21.15.112:0/3392160819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc904102690 0x7fc904108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:05.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.900+0000 7fc90c4f9640 1 --2- 172.21.15.112:0/3392160819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc904101cd0 0x7fc904102150 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:05.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.900+0000 7fc90c4f9640 1 --2- 172.21.15.112:0/3392160819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc904100ad0 0x7fc904100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:05.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.900+0000 7fc90c4f9640 1 -- 172.21.15.112:0/3392160819 >> 172.21.15.112:0/3392160819 conn(0x7fc9040fc280 msgr2=0x7fc9040fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:07:05.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.900+0000 7fc90c4f9640 1 -- 172.21.15.112:0/3392160819 shutdown_connections 2024-09-15T23:07:05.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.900+0000 7fc90c4f9640 1 -- 172.21.15.112:0/3392160819 wait complete. 2024-09-15T23:07:05.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc90c4f9640 1 Processor -- start 2024-09-15T23:07:05.902 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc90c4f9640 1 -- start start 2024-09-15T23:07:05.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc90c4f9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc904100ad0 0x7fc904197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:07:05.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc90c4f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc904101cd0 0x7fc904198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:07:05.905 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc90c4f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc904102690 0x7fc90419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:07:05.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc90c4f9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc90410c5e0 con 0x7fc904102690 2024-09-15T23:07:05.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc90c4f9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc90410c460 con 0x7fc904101cd0 2024-09-15T23:07:05.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc90c4f9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc90410c760 con 0x7fc904100ad0 2024-09-15T23:07:05.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc909a94640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc904101cd0 0x7fc904198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:07:05.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc909a94640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc904101cd0 0x7fc904198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37298/0 (socket says 172.21.15.112:37298) 2024-09-15T23:07:05.906 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc909a94640 1 -- 172.21.15.112:0/1096502840 learned_addr learned my addr 172.21.15.112:0/1096502840 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:07:05.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc90a295640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc904100ad0 0x7fc904197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:07:05.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc90aa96640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc904102690 0x7fc90419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:07:05.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc909a94640 1 -- 172.21.15.112:0/1096502840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc904100ad0 msgr2=0x7fc904197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:05.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc909a94640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc904100ad0 0x7fc904197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:05.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc909a94640 1 -- 172.21.15.112:0/1096502840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc904102690 msgr2=0x7fc90419f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:05.907 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc909a94640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc904102690 0x7fc90419f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:05.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.901+0000 7fc909a94640 1 -- 172.21.15.112:0/1096502840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90419fa20 con 0x7fc904101cd0 2024-09-15T23:07:05.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.902+0000 7fc909a94640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc904101cd0 0x7fc904198330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc900005940 tx=0x7fc9000042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:07:05.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.902+0000 7fc8fb7fe640 1 -- 172.21.15.112:0/1096502840 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90003f030 con 0x7fc904101cd0 2024-09-15T23:07:05.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.902+0000 7fc90c4f9640 1 -- 172.21.15.112:0/1096502840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc90419fcb0 con 0x7fc904101cd0 2024-09-15T23:07:05.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.902+0000 7fc8fb7fe640 1 -- 172.21.15.112:0/1096502840 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc900003cb0 con 0x7fc904101cd0 2024-09-15T23:07:05.908 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.902+0000 7fc8fb7fe640 1 -- 172.21.15.112:0/1096502840 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900035070 con 0x7fc904101cd0 2024-09-15T23:07:05.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.902+0000 7fc90c4f9640 1 -- 172.21.15.112:0/1096502840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9041a0190 con 0x7fc904101cd0 2024-09-15T23:07:05.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.903+0000 7fc90c4f9640 1 -- 172.21.15.112:0/1096502840 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9041a0360 con 0x7fc904101cd0 2024-09-15T23:07:05.909 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.904+0000 7fc8fb7fe640 1 -- 172.21.15.112:0/1096502840 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fc900042030 con 0x7fc904101cd0 2024-09-15T23:07:05.910 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.904+0000 7fc8fb7fe640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc8f00a31e0 0x7fc8f00a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:07:05.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.905+0000 7fc8fb7fe640 1 -- 172.21.15.112:0/1096502840 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7fc9000ee370 con 0x7fc904101cd0 2024-09-15T23:07:05.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.905+0000 7fc90a295640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc8f00a31e0 0x7fc8f00a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:07:05.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.905+0000 7fc90a295640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc8f00a31e0 0x7fc8f00a56a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc904101b30 tx=0x7fc8f400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:07:05.911 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:05.909+0000 7fc8fb7fe640 1 -- 172.21.15.112:0/1096502840 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9000bc4b0 con 0x7fc904101cd0 2024-09-15T23:07:06.090 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:06.089+0000 7fc90c4f9640 1 -- 172.21.15.112:0/1096502840 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc90406a6f0 con 0x7fc8f00a31e0 2024-09-15T23:07:06.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: purged_snaps scrub starts 2024-09-15T23:07:06.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: purged_snaps scrub ok 2024-09-15T23:07:06.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:06.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:06.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:06.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:07:06.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:06.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:06.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:06.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:06.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401] boot 2024-09-15T23:07:06.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T23:07:06.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:06.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:07:06.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:07:06.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:06.625 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: purged_snaps scrub starts 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: purged_snaps scrub ok 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401] boot 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:07:06.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:07:06.627 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:06.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: purged_snaps scrub starts 2024-09-15T23:07:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: purged_snaps scrub ok 2024-09-15T23:07:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:07:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: osd.0 [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401] boot 2024-09-15T23:07:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T23:07:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:07:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:07:06.709 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:07:06.709 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:07.600 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:07 smithi112 ceph-mon[34367]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:07:07.600 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:07 smithi112 ceph-mon[34367]: Detected new or changed devices on smithi002 2024-09-15T23:07:07.600 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:07 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-15T23:07:07.600 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:07 smithi112 ceph-mon[34367]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:07:07.600 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:07 smithi112 ceph-mon[34367]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T23:07:07.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:07 smithi145 ceph-mon[34901]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:07:07.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:07 smithi145 ceph-mon[34901]: Detected new or changed devices on smithi002 2024-09-15T23:07:07.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:07 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-15T23:07:07.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:07 smithi145 ceph-mon[34901]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:07:07.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:07 smithi145 ceph-mon[34901]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T23:07:07.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:07 smithi002 ceph-mon[31019]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:07:07.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:07 smithi002 ceph-mon[31019]: Detected new or changed devices on smithi002 2024-09-15T23:07:07.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:07 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi002 to 17092M 2024-09-15T23:07:07.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:07 smithi002 ceph-mon[31019]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:07:07.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:07 smithi002 ceph-mon[31019]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T23:07:09.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:09 smithi145 ceph-mon[34901]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:09.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:09 smithi145 ceph-mon[34901]: from='client.? 172.21.15.112:0/1265203360' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af5e265d-fe45-4d9c-a34c-6f0b103d75d2"}]: dispatch 2024-09-15T23:07:09.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:09 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af5e265d-fe45-4d9c-a34c-6f0b103d75d2"}]: dispatch 2024-09-15T23:07:09.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:09 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af5e265d-fe45-4d9c-a34c-6f0b103d75d2"}]': finished 2024-09-15T23:07:09.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:09 smithi145 ceph-mon[34901]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T23:07:09.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:09 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:09.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:09 smithi145 ceph-mon[34901]: from='client.? 172.21.15.112:0/2966621464' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:07:09.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:09 smithi112 ceph-mon[34367]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:09.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:09 smithi112 ceph-mon[34367]: from='client.? 172.21.15.112:0/1265203360' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af5e265d-fe45-4d9c-a34c-6f0b103d75d2"}]: dispatch 2024-09-15T23:07:09.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:09 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af5e265d-fe45-4d9c-a34c-6f0b103d75d2"}]: dispatch 2024-09-15T23:07:09.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:09 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af5e265d-fe45-4d9c-a34c-6f0b103d75d2"}]': finished 2024-09-15T23:07:09.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:09 smithi112 ceph-mon[34367]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T23:07:09.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:09 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:09.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:09 smithi112 ceph-mon[34367]: from='client.? 172.21.15.112:0/2966621464' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:07:09.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:09 smithi002 ceph-mon[31019]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:09.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:09 smithi002 ceph-mon[31019]: from='client.? 172.21.15.112:0/1265203360' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af5e265d-fe45-4d9c-a34c-6f0b103d75d2"}]: dispatch 2024-09-15T23:07:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:09 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af5e265d-fe45-4d9c-a34c-6f0b103d75d2"}]: dispatch 2024-09-15T23:07:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:09 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af5e265d-fe45-4d9c-a34c-6f0b103d75d2"}]': finished 2024-09-15T23:07:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:09 smithi002 ceph-mon[31019]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T23:07:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:09 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:09 smithi002 ceph-mon[31019]: from='client.? 172.21.15.112:0/2966621464' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:07:11.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:11 smithi145 ceph-mon[34901]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:11.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:11 smithi112 ceph-mon[34367]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:11.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:11 smithi002 ceph-mon[31019]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:13.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:13 smithi112 ceph-mon[34367]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:13.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:13 smithi145 ceph-mon[34901]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:13.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:13 smithi002 ceph-mon[31019]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:15.462 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:15 smithi112 ceph-mon[34367]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:15.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:15 smithi145 ceph-mon[34901]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:15.783 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:15 smithi002 ceph-mon[31019]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:17.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:17 smithi145 ceph-mon[34901]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:17.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:17 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T23:07:17.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:17 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:17.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:17 smithi112 ceph-mon[34367]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:17.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:17 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T23:07:17.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:17 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:17.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:17 smithi002 ceph-mon[31019]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:17.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:17 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T23:07:17.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:17 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:18.566 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:18 smithi112 ceph-mon[34367]: Deploying daemon osd.1 on smithi112 2024-09-15T23:07:18.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:18 smithi145 ceph-mon[34901]: Deploying daemon osd.1 on smithi112 2024-09-15T23:07:18.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:18 smithi002 ceph-mon[31019]: Deploying daemon osd.1 on smithi112 2024-09-15T23:07:19.704 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:19 smithi112 ceph-mon[34367]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:19.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:19 smithi145 ceph-mon[34901]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:19.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:19 smithi002 ceph-mon[31019]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:21.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:21 smithi145 ceph-mon[34901]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:21.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:21 smithi112 ceph-mon[34367]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:21.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:21 smithi002 ceph-mon[31019]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:23.662 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:23 smithi112 ceph-mon[34367]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:23.663 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:23.663 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:23.663 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:23.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:23 smithi145 ceph-mon[34901]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:23.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:23.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:23.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:23.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:23 smithi002 ceph-mon[31019]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:23.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:23.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:23.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:25.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:25 smithi145 ceph-mon[34901]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:25.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:25 smithi112 ceph-mon[34367]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:25.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:25 smithi002 ceph-mon[31019]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:26.706 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:26.704+0000 7fc8fb7fe640 1 -- 172.21.15.112:0/1096502840 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc90406a6f0 con 0x7fc8f00a31e0 2024-09-15T23:07:26.706 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 1 on host 'smithi112' 2024-09-15T23:07:26.708 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:26.707+0000 7fc90c4f9640 1 -- 172.21.15.112:0/1096502840 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc8f00a31e0 msgr2=0x7fc8f00a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:26.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:26.707+0000 7fc90c4f9640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc8f00a31e0 0x7fc8f00a56a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc904101b30 tx=0x7fc8f400b390 comp rx=0 tx=0).stop 2024-09-15T23:07:26.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:26.707+0000 7fc90c4f9640 1 -- 172.21.15.112:0/1096502840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc904101cd0 msgr2=0x7fc904198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:26.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:26.707+0000 7fc90c4f9640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc904101cd0 0x7fc904198330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc900005940 tx=0x7fc9000042f0 comp rx=0 tx=0).stop 2024-09-15T23:07:26.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:26.707+0000 7fc90c4f9640 1 -- 172.21.15.112:0/1096502840 shutdown_connections 2024-09-15T23:07:26.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:26.707+0000 7fc90c4f9640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc8f00a31e0 0x7fc8f00a56a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:26.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:26.707+0000 7fc90c4f9640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc904102690 0x7fc90419f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:26.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:26.707+0000 7fc90c4f9640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc904101cd0 0x7fc904198330 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:26.709 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:26.707+0000 7fc90c4f9640 1 --2- 172.21.15.112:0/1096502840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc904100ad0 0x7fc904197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:26.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:26.707+0000 7fc90c4f9640 1 -- 172.21.15.112:0/1096502840 >> 172.21.15.112:0/1096502840 conn(0x7fc9040fc280 msgr2=0x7fc904069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:07:26.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:26.707+0000 7fc90c4f9640 1 -- 172.21.15.112:0/1096502840 shutdown_connections 2024-09-15T23:07:26.710 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:07:26.707+0000 7fc90c4f9640 1 -- 172.21.15.112:0/1096502840 wait complete. 2024-09-15T23:07:26.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:26 smithi112 ceph-mon[34367]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:26.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:26.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:27.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:26 smithi002 ceph-mon[31019]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:27.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:27.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:27.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:27.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:27.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:27.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:27.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:27.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:27.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:26 smithi145 ceph-mon[34901]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:27.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:27.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:27.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:27.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:27.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:27.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:27.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:27.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:27.303 DEBUG:teuthology.orchestra.run.smithi112:osd.1> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.1.service 2024-09-15T23:07:27.306 INFO:tasks.cephadm:Deploying osd.2 on smithi145 with /dev/vg_nvme/lv_4... 2024-09-15T23:07:27.307 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T23:07:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:07:28.951 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:28 smithi145 ceph-mon[34901]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:29.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:28 smithi002 ceph-mon[31019]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:29.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:28 smithi112 ceph-mon[34367]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:29.247 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:07:28 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1[38827]: 2024-09-15T23:07:28.854+0000 7f09b057e640 -1 osd.1 0 log_to_monitors true 2024-09-15T23:07:29.890 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:29 smithi112 ceph-mon[34367]: from='osd.1 [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T23:07:29.890 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:29 smithi112 ceph-mon[34367]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T23:07:30.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:29 smithi002 ceph-mon[31019]: from='osd.1 [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T23:07:30.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:29 smithi002 ceph-mon[31019]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T23:07:30.114 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:29 smithi145 ceph-mon[34901]: from='osd.1 [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T23:07:30.114 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:29 smithi145 ceph-mon[34901]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T23:07:30.116 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:07:30.143 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi145:vg_nvme/lv_4 2024-09-15T23:07:30.394 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:07:30.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.800+0000 7f003bd70640 1 -- 172.21.15.145:0/3622978622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0034104fd0 msgr2=0x7f00341073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:30.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.800+0000 7f003bd70640 1 --2- 172.21.15.145:0/3622978622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0034104fd0 0x7f00341073c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0030009900 tx=0x7f003002a410 comp rx=0 tx=0).stop 2024-09-15T23:07:30.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.800+0000 7f003bd70640 1 -- 172.21.15.145:0/3622978622 shutdown_connections 2024-09-15T23:07:30.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.800+0000 7f003bd70640 1 --2- 172.21.15.145:0/3622978622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0034107900 0x7f0034109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:30.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.800+0000 7f003bd70640 1 --2- 172.21.15.145:0/3622978622 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0034104fd0 0x7f00341073c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:30.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.800+0000 7f003bd70640 1 --2- 172.21.15.145:0/3622978622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00341026a0 0x7f0034104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:30.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.800+0000 7f003bd70640 1 -- 172.21.15.145:0/3622978622 >> 172.21.15.145:0/3622978622 conn(0x7f00340fc2a0 msgr2=0x7f00340fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:07:30.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.800+0000 7f003bd70640 1 -- 172.21.15.145:0/3622978622 shutdown_connections 2024-09-15T23:07:30.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.800+0000 7f003bd70640 1 -- 172.21.15.145:0/3622978622 wait complete. 2024-09-15T23:07:30.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f003bd70640 1 Processor -- start 2024-09-15T23:07:30.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f003bd70640 1 -- start start 2024-09-15T23:07:30.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f003bd70640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00341026a0 0x7f0034197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:07:30.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f003bd70640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0034104fd0 0x7f0034198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:07:30.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f003bd70640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0034107900 0x7f003419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:07:30.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f003bd70640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f003410d750 con 0x7f0034104fd0 2024-09-15T23:07:30.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f003bd70640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f003410d5d0 con 0x7f0034107900 2024-09-15T23:07:30.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f003bd70640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f003410d8d0 con 0x7f00341026a0 2024-09-15T23:07:30.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f0039b0c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00341026a0 0x7f0034197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:07:30.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f0039b0c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00341026a0 0x7f0034197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:53638/0 (socket says 172.21.15.145:53638) 2024-09-15T23:07:30.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f0039b0c640 1 -- 172.21.15.145:0/4160072951 learned_addr learned my addr 172.21.15.145:0/4160072951 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-15T23:07:30.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f003a30d640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0034107900 0x7f003419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:07:30.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f003930b640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0034104fd0 0x7f0034198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:07:30.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f0039b0c640 1 -- 172.21.15.145:0/4160072951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0034107900 msgr2=0x7f003419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:30.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f0039b0c640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0034107900 0x7f003419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:30.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f0039b0c640 1 -- 172.21.15.145:0/4160072951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0034104fd0 msgr2=0x7f0034198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:30.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f0039b0c640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0034104fd0 0x7f0034198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:30.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f0039b0c640 1 -- 172.21.15.145:0/4160072951 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003419fb40 con 0x7f00341026a0 2024-09-15T23:07:30.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f003930b640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0034104fd0 0x7f0034198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:07:30.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.801+0000 7f0039b0c640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00341026a0 0x7f0034197f10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f002800d950 tx=0x7f002800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:07:30.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.802+0000 7f0026ffd640 1 -- 172.21.15.145:0/4160072951 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028017070 con 0x7f00341026a0 2024-09-15T23:07:30.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.802+0000 7f003bd70640 1 -- 172.21.15.145:0/4160072951 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003419fe30 con 0x7f00341026a0 2024-09-15T23:07:30.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.802+0000 7f0026ffd640 1 -- 172.21.15.145:0/4160072951 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0028009c30 con 0x7f00341026a0 2024-09-15T23:07:30.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.802+0000 7f0026ffd640 1 -- 172.21.15.145:0/4160072951 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002800f620 con 0x7f00341026a0 2024-09-15T23:07:30.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.802+0000 7f003bd70640 1 -- 172.21.15.145:0/4160072951 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00341a02e0 con 0x7f00341026a0 2024-09-15T23:07:30.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.803+0000 7f003bd70640 1 -- 172.21.15.145:0/4160072951 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00340fdd90 con 0x7f00341026a0 2024-09-15T23:07:30.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.804+0000 7f0026ffd640 1 -- 172.21.15.145:0/4160072951 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f00280109a0 con 0x7f00341026a0 2024-09-15T23:07:30.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.804+0000 7f0026ffd640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f00200a3260 0x7f00200a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:07:30.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.805+0000 7f0026ffd640 1 -- 172.21.15.145:0/4160072951 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f00280cdb20 con 0x7f00341026a0 2024-09-15T23:07:30.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.805+0000 7f003930b640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f00200a3260 0x7f00200a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:07:30.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.805+0000 7f003930b640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f00200a3260 0x7f00200a5720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0030006010 tx=0x7f0030000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:07:30.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.809+0000 7f0026ffd640 1 -- 172.21.15.145:0/4160072951 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f002809c1b0 con 0x7f00341026a0 2024-09-15T23:07:30.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:30.981+0000 7f003bd70640 1 -- 172.21.15.145:0/4160072951 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0034062630 con 0x7f00200a3260 2024-09-15T23:07:30.983 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:30.983 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T23:07:30.983 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: from='osd.1 [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:07:30.983 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T23:07:30.983 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:30.983 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:07:30.983 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: Detected new or changed devices on smithi112 2024-09-15T23:07:30.983 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:30.983 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:30.983 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:07:30.983 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi112 to 17088M 2024-09-15T23:07:30.983 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:30.983 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:30.984 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:30.984 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:31.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:31.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T23:07:31.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: from='osd.1 [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:07:31.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T23:07:31.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:31.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:07:31.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: Detected new or changed devices on smithi112 2024-09-15T23:07:31.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:31.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:31.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:07:31.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi112 to 17088M 2024-09-15T23:07:31.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:31.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:31.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:31.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:31.183 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:31.183 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T23:07:31.183 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: from='osd.1 [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:07:31.183 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T23:07:31.183 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:31.183 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:07:31.183 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: Detected new or changed devices on smithi112 2024-09-15T23:07:31.183 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:31.183 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:31.183 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:07:31.184 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi112 to 17088M 2024-09-15T23:07:31.184 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:31.184 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:31.184 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:31.184 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:31.496 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:07:31 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1[38827]: 2024-09-15T23:07:31.181+0000 7f09acd15640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T23:07:31.496 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:07:31 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1[38827]: 2024-09-15T23:07:31.186+0000 7f09a4321640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:07:31.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:31 smithi145 ceph-mon[34901]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T23:07:31.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:31 smithi145 ceph-mon[34901]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T23:07:31.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:31 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:31.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:31 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:31.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:31 smithi145 ceph-mon[34901]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:07:31.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:31 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:07:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:31 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:07:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:31 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:31.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:31 smithi145 ceph-mon[34901]: from='osd.1 ' entity='osd.1' 2024-09-15T23:07:32.029 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:31 smithi112 ceph-mon[34367]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T23:07:32.029 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:31 smithi112 ceph-mon[34367]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T23:07:32.030 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:31 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:32.030 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:31 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:32.030 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:31 smithi112 ceph-mon[34367]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:07:32.030 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:31 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:07:32.030 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:31 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:07:32.030 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:31 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:32.030 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:31 smithi112 ceph-mon[34367]: from='osd.1 ' entity='osd.1' 2024-09-15T23:07:32.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:31 smithi002 ceph-mon[31019]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T23:07:32.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:31 smithi002 ceph-mon[31019]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T23:07:32.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:31 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:32.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:31 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:32.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:31 smithi002 ceph-mon[31019]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:07:32.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:31 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:07:32.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:31 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:07:32.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:31 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:32.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:31 smithi002 ceph-mon[31019]: from='osd.1 ' entity='osd.1' 2024-09-15T23:07:32.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:32 smithi145 ceph-mon[34901]: purged_snaps scrub starts 2024-09-15T23:07:32.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:32 smithi145 ceph-mon[34901]: purged_snaps scrub ok 2024-09-15T23:07:32.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:32 smithi145 ceph-mon[34901]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:32.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:32 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:32.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:32 smithi145 ceph-mon[34901]: osd.1 [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970] boot 2024-09-15T23:07:32.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:32 smithi145 ceph-mon[34901]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T23:07:32.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:32 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:32.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:32 smithi112 ceph-mon[34367]: purged_snaps scrub starts 2024-09-15T23:07:32.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:32 smithi112 ceph-mon[34367]: purged_snaps scrub ok 2024-09-15T23:07:32.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:32 smithi112 ceph-mon[34367]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:32.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:32 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:32.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:32 smithi112 ceph-mon[34367]: osd.1 [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970] boot 2024-09-15T23:07:32.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:32 smithi112 ceph-mon[34367]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T23:07:32.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:32 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:33.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:32 smithi002 ceph-mon[31019]: purged_snaps scrub starts 2024-09-15T23:07:33.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:32 smithi002 ceph-mon[31019]: purged_snaps scrub ok 2024-09-15T23:07:33.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:32 smithi002 ceph-mon[31019]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:07:33.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:32 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:33.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:32 smithi002 ceph-mon[31019]: osd.1 [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970] boot 2024-09-15T23:07:33.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:32 smithi002 ceph-mon[31019]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T23:07:33.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:32 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:07:34.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:33 smithi002 ceph-mon[31019]: from='client.? 172.21.15.145:0/1020028339' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8df9e644-fc51-4626-a1a7-6ac4448a5b20"}]: dispatch 2024-09-15T23:07:34.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:33 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8df9e644-fc51-4626-a1a7-6ac4448a5b20"}]: dispatch 2024-09-15T23:07:34.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:33 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8df9e644-fc51-4626-a1a7-6ac4448a5b20"}]': finished 2024-09-15T23:07:34.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:33 smithi002 ceph-mon[31019]: osdmap e14: 3 total, 2 up, 3 in 2024-09-15T23:07:34.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:33 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:34.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:33 smithi145 ceph-mon[34901]: from='client.? 172.21.15.145:0/1020028339' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8df9e644-fc51-4626-a1a7-6ac4448a5b20"}]: dispatch 2024-09-15T23:07:34.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:33 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8df9e644-fc51-4626-a1a7-6ac4448a5b20"}]: dispatch 2024-09-15T23:07:34.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:33 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8df9e644-fc51-4626-a1a7-6ac4448a5b20"}]': finished 2024-09-15T23:07:34.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:33 smithi145 ceph-mon[34901]: osdmap e14: 3 total, 2 up, 3 in 2024-09-15T23:07:34.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:33 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:34.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:33 smithi112 ceph-mon[34367]: from='client.? 172.21.15.145:0/1020028339' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8df9e644-fc51-4626-a1a7-6ac4448a5b20"}]: dispatch 2024-09-15T23:07:34.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:33 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8df9e644-fc51-4626-a1a7-6ac4448a5b20"}]: dispatch 2024-09-15T23:07:34.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:33 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8df9e644-fc51-4626-a1a7-6ac4448a5b20"}]': finished 2024-09-15T23:07:34.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:33 smithi112 ceph-mon[34367]: osdmap e14: 3 total, 2 up, 3 in 2024-09-15T23:07:34.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:33 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:35.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:34 smithi002 ceph-mon[31019]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:35.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:34 smithi002 ceph-mon[31019]: from='client.? 172.21.15.145:0/1106557474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:07:35.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:34 smithi145 ceph-mon[34901]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:35.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:34 smithi145 ceph-mon[34901]: from='client.? 172.21.15.145:0/1106557474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:07:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:34 smithi112 ceph-mon[34367]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:34 smithi112 ceph-mon[34367]: from='client.? 172.21.15.145:0/1106557474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:07:37.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:36 smithi002 ceph-mon[31019]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:37.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:36 smithi145 ceph-mon[34901]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:37.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:36 smithi112 ceph-mon[34367]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:39.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:38 smithi002 ceph-mon[31019]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:39.132 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:38 smithi145 ceph-mon[34901]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:39.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:38 smithi112 ceph-mon[34367]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:40.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:40 smithi145 ceph-mon[34901]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:41.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:40 smithi002 ceph-mon[31019]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:41.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:40 smithi112 ceph-mon[34367]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:42.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T23:07:42.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:42.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:41 smithi002 ceph-mon[31019]: Deploying daemon osd.2 on smithi145 2024-09-15T23:07:42.130 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T23:07:42.130 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:42.131 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:41 smithi145 ceph-mon[34901]: Deploying daemon osd.2 on smithi145 2024-09-15T23:07:42.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T23:07:42.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:42.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:41 smithi112 ceph-mon[34367]: Deploying daemon osd.2 on smithi145 2024-09-15T23:07:43.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:42 smithi002 ceph-mon[31019]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:43.061 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:42 smithi145 ceph-mon[34901]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:43.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:42 smithi112 ceph-mon[34367]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:44.886 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:44 smithi145 ceph-mon[34901]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:45.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:44 smithi002 ceph-mon[31019]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:45.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:44 smithi112 ceph-mon[34367]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:46.898 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:46 smithi145 ceph-mon[34901]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:47.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:46 smithi002 ceph-mon[31019]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:47.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:46 smithi112 ceph-mon[34367]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:47.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:47 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:47.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:47 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:47.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:47 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:48.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:47 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:48.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:47 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:48.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:47 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:48.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:47 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:48.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:47 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:48.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:47 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:49.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:48 smithi002 ceph-mon[31019]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:49.061 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:48 smithi145 ceph-mon[34901]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:49.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:48 smithi112 ceph-mon[34367]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:51.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:50 smithi112 ceph-mon[34367]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:51.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:50 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:51.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:50 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:51.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:50 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:51.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:50 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:51.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:50 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:50 smithi002 ceph-mon[31019]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:50 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:50 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:50 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:50 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:51.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:50 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:51.359 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:50 smithi145 ceph-mon[34901]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:51.359 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:50 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:51.359 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:50 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:51.360 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:50 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:51.360 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:50 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:51.360 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:50 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:52.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:52.101+0000 7f0026ffd640 1 -- 172.21.15.145:0/4160072951 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0034062630 con 0x7f00200a3260 2024-09-15T23:07:52.104 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 2 on host 'smithi145' 2024-09-15T23:07:52.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:52.104+0000 7f003bd70640 1 -- 172.21.15.145:0/4160072951 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f00200a3260 msgr2=0x7f00200a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:52.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:52.104+0000 7f003bd70640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f00200a3260 0x7f00200a5720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0030006010 tx=0x7f0030000bc0 comp rx=0 tx=0).stop 2024-09-15T23:07:52.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:52.104+0000 7f003bd70640 1 -- 172.21.15.145:0/4160072951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00341026a0 msgr2=0x7f0034197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:52.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:52.104+0000 7f003bd70640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00341026a0 0x7f0034197f10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f002800d950 tx=0x7f002800de10 comp rx=0 tx=0).stop 2024-09-15T23:07:52.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:52.104+0000 7f003bd70640 1 -- 172.21.15.145:0/4160072951 shutdown_connections 2024-09-15T23:07:52.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:52.104+0000 7f003bd70640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f00200a3260 0x7f00200a5720 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:52.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:52.104+0000 7f003bd70640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0034107900 0x7f003419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:52.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:52.104+0000 7f003bd70640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0034104fd0 0x7f0034198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:52.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:52.104+0000 7f003bd70640 1 --2- 172.21.15.145:0/4160072951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00341026a0 0x7f0034197f10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:52.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:52.104+0000 7f003bd70640 1 -- 172.21.15.145:0/4160072951 >> 172.21.15.145:0/4160072951 conn(0x7f00340fc2a0 msgr2=0x7f00341044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:07:52.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:52.104+0000 7f003bd70640 1 -- 172.21.15.145:0/4160072951 shutdown_connections 2024-09-15T23:07:52.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:07:52.104+0000 7f003bd70640 1 -- 172.21.15.145:0/4160072951 wait complete. 2024-09-15T23:07:52.765 DEBUG:teuthology.orchestra.run.smithi145:osd.2> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.2.service 2024-09-15T23:07:52.767 INFO:tasks.cephadm:Deploying osd.3 on smithi002 with /dev/vg_nvme/lv_3... 2024-09-15T23:07:52.767 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T23:07:53.023 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:07:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:52 smithi002 ceph-mon[31019]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:53.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:52 smithi112 ceph-mon[34367]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:53.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:52 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:53.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:52 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:53.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:52 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:53.293 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:52 smithi145 ceph-mon[34901]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:53.293 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:52 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:07:53.293 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:52 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:53.293 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:52 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:54.091 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:53 smithi145 ceph-mon[34901]: from='osd.2 [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T23:07:54.091 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:53 smithi145 ceph-mon[34901]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T23:07:54.091 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:07:53 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2[39857]: 2024-09-15T23:07:53.827+0000 7f1e3414e640 -1 osd.2 0 log_to_monitors true 2024-09-15T23:07:54.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:53 smithi112 ceph-mon[34367]: from='osd.2 [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T23:07:54.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:53 smithi112 ceph-mon[34367]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T23:07:54.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:53 smithi002 ceph-mon[31019]: from='osd.2 [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T23:07:54.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:53 smithi002 ceph-mon[31019]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T23:07:55.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:54 smithi002 ceph-mon[31019]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:55.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:54 smithi002 ceph-mon[31019]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T23:07:55.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:54 smithi002 ceph-mon[31019]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T23:07:55.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:54 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:55.087 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:54 smithi002 ceph-mon[31019]: from='osd.2 [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:07:55.087 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:54 smithi002 ceph-mon[31019]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:07:55.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:54 smithi112 ceph-mon[34367]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:55.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:54 smithi112 ceph-mon[34367]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T23:07:55.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:54 smithi112 ceph-mon[34367]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T23:07:55.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:54 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:55.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:54 smithi112 ceph-mon[34367]: from='osd.2 [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:07:55.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:54 smithi112 ceph-mon[34367]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:07:55.336 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:07:54 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2[39857]: 2024-09-15T23:07:54.997+0000 7f1e300d1640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T23:07:55.336 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:07:55 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2[39857]: 2024-09-15T23:07:55.000+0000 7f1e2bef9640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:07:55.336 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:54 smithi145 ceph-mon[34901]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:55.336 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:54 smithi145 ceph-mon[34901]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T23:07:55.336 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:54 smithi145 ceph-mon[34901]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T23:07:55.336 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:54 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:55.336 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:54 smithi145 ceph-mon[34901]: from='osd.2 [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:07:55.336 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:54 smithi145 ceph-mon[34901]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:07:55.699 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:07:55.726 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_3 2024-09-15T23:07:56.007 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:07:56.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:56 smithi002 ceph-mon[31019]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-15T23:07:56.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:56 smithi002 ceph-mon[31019]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T23:07:56.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:56.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:56.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:56.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:56.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:07:56.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:56.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:56.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:56.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:56.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:56 smithi145 ceph-mon[34901]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-15T23:07:56.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:56 smithi145 ceph-mon[34901]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T23:07:56.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:56.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:56.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:56.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:56.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:07:56.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:56.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:56.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:56.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:56.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:56 smithi112 ceph-mon[34367]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-15T23:07:56.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:56 smithi112 ceph-mon[34367]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T23:07:56.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:56.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:56.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:56.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:56.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:07:56.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:56.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:56.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:07:56.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:07:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.584+0000 7efe27d7b640 1 -- 172.21.15.2:0/3546500246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe20076220 msgr2=0x7efe20074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.584+0000 7efe27d7b640 1 --2- 172.21.15.2:0/3546500246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe20076220 0x7efe20074680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009900 tx=0x7efe1c02a410 comp rx=0 tx=0).stop 2024-09-15T23:07:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.584+0000 7efe27d7b640 1 -- 172.21.15.2:0/3546500246 shutdown_connections 2024-09-15T23:07:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.584+0000 7efe27d7b640 1 --2- 172.21.15.2:0/3546500246 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe2010e1e0 0x7efe201105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.584+0000 7efe27d7b640 1 --2- 172.21.15.2:0/3546500246 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe20074c50 0x7efe200750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.584+0000 7efe27d7b640 1 --2- 172.21.15.2:0/3546500246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe20076220 0x7efe20074680 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.584+0000 7efe27d7b640 1 -- 172.21.15.2:0/3546500246 >> 172.21.15.2:0/3546500246 conn(0x7efe200fd390 msgr2=0x7efe200ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:07:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.585+0000 7efe27d7b640 1 -- 172.21.15.2:0/3546500246 shutdown_connections 2024-09-15T23:07:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.585+0000 7efe27d7b640 1 -- 172.21.15.2:0/3546500246 wait complete. 2024-09-15T23:07:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.585+0000 7efe27d7b640 1 Processor -- start 2024-09-15T23:07:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.585+0000 7efe27d7b640 1 -- start start 2024-09-15T23:07:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.585+0000 7efe27d7b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe20074c50 0x7efe2019e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:07:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.585+0000 7efe27d7b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe20076220 0x7efe2019e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:07:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.585+0000 7efe27d7b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe2010e1e0 0x7efe201a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:07:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.585+0000 7efe27d7b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efe20113d50 con 0x7efe20074c50 2024-09-15T23:07:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.585+0000 7efe27d7b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efe20113bd0 con 0x7efe2010e1e0 2024-09-15T23:07:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.585+0000 7efe27d7b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efe20113ed0 con 0x7efe20076220 2024-09-15T23:07:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.585+0000 7efe25b17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe20074c50 0x7efe2019e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:07:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.585+0000 7efe25b17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe20074c50 0x7efe2019e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40410/0 (socket says 172.21.15.2:40410) 2024-09-15T23:07:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.585+0000 7efe25b17640 1 -- 172.21.15.2:0/4195988596 learned_addr learned my addr 172.21.15.2:0/4195988596 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:07:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe25316640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe20076220 0x7efe2019e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:07:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe26318640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe2010e1e0 0x7efe201a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:07:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe25b17640 1 -- 172.21.15.2:0/4195988596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe20076220 msgr2=0x7efe2019e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe25b17640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe20076220 0x7efe2019e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe25b17640 1 -- 172.21.15.2:0/4195988596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe2010e1e0 msgr2=0x7efe201a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:07:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe25b17640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe2010e1e0 0x7efe201a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:07:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe25b17640 1 -- 172.21.15.2:0/4195988596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe201a6080 con 0x7efe20074c50 2024-09-15T23:07:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe25316640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe20076220 0x7efe2019e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:07:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe26318640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe2010e1e0 0x7efe201a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:07:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe25b17640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe20074c50 0x7efe2019e450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009230 tx=0x7efe1c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:07:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe16ffd640 1 -- 172.21.15.2:0/4195988596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c03f030 con 0x7efe20074c50 2024-09-15T23:07:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe16ffd640 1 -- 172.21.15.2:0/4195988596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe1c003cb0 con 0x7efe20074c50 2024-09-15T23:07:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe27d7b640 1 -- 172.21.15.2:0/4195988596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe201a6310 con 0x7efe20074c50 2024-09-15T23:07:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe16ffd640 1 -- 172.21.15.2:0/4195988596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c035070 con 0x7efe20074c50 2024-09-15T23:07:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.586+0000 7efe27d7b640 1 -- 172.21.15.2:0/4195988596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe201a6840 con 0x7efe20074c50 2024-09-15T23:07:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.587+0000 7efe27d7b640 1 -- 172.21.15.2:0/4195988596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe20103b80 con 0x7efe20074c50 2024-09-15T23:07:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.588+0000 7efe16ffd640 1 -- 172.21.15.2:0/4195988596 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7efe1c042030 con 0x7efe20074c50 2024-09-15T23:07:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.589+0000 7efe16ffd640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7efe0c0a3260 0x7efe0c0a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:07:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.589+0000 7efe25316640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7efe0c0a3260 0x7efe0c0a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:07:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.589+0000 7efe16ffd640 1 -- 172.21.15.2:0/4195988596 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2851+0+0 (secure 0 0 0) 0x7efe1c0eed30 con 0x7efe20074c50 2024-09-15T23:07:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.590+0000 7efe25316640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7efe0c0a3260 0x7efe0c0a5720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe2019f970 tx=0x7efe10005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:07:56.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.592+0000 7efe16ffd640 1 -- 172.21.15.2:0/4195988596 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe1c0bd080 con 0x7efe20074c50 2024-09-15T23:07:56.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:07:56.777+0000 7efe27d7b640 1 -- 172.21.15.2:0/4195988596 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7efe20062630 con 0x7efe0c0a3260 2024-09-15T23:07:57.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:57 smithi002 ceph-mon[31019]: purged_snaps scrub starts 2024-09-15T23:07:57.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:57 smithi002 ceph-mon[31019]: purged_snaps scrub ok 2024-09-15T23:07:57.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:57 smithi002 ceph-mon[31019]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:57.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:57 smithi002 ceph-mon[31019]: Detected new or changed devices on smithi145 2024-09-15T23:07:57.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:57 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi145 to 17088M 2024-09-15T23:07:57.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:57 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:57.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:57 smithi002 ceph-mon[31019]: osd.2 [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437] boot 2024-09-15T23:07:57.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:57 smithi002 ceph-mon[31019]: osdmap e17: 3 total, 3 up, 3 in 2024-09-15T23:07:57.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:57 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:57.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:57 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:07:57.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:57 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:07:57.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:57 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:57 smithi145 ceph-mon[34901]: purged_snaps scrub starts 2024-09-15T23:07:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:57 smithi145 ceph-mon[34901]: purged_snaps scrub ok 2024-09-15T23:07:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:57 smithi145 ceph-mon[34901]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:57 smithi145 ceph-mon[34901]: Detected new or changed devices on smithi145 2024-09-15T23:07:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:57 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi145 to 17088M 2024-09-15T23:07:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:57 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:57 smithi145 ceph-mon[34901]: osd.2 [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437] boot 2024-09-15T23:07:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:57 smithi145 ceph-mon[34901]: osdmap e17: 3 total, 3 up, 3 in 2024-09-15T23:07:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:57 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:57 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:07:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:57 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:07:57.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:57 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:57.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:57 smithi112 ceph-mon[34367]: purged_snaps scrub starts 2024-09-15T23:07:57.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:57 smithi112 ceph-mon[34367]: purged_snaps scrub ok 2024-09-15T23:07:57.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:57 smithi112 ceph-mon[34367]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:07:57.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:57 smithi112 ceph-mon[34367]: Detected new or changed devices on smithi145 2024-09-15T23:07:57.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:57 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi145 to 17088M 2024-09-15T23:07:57.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:57 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:57.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:57 smithi112 ceph-mon[34367]: osd.2 [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437] boot 2024-09-15T23:07:57.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:57 smithi112 ceph-mon[34367]: osdmap e17: 3 total, 3 up, 3 in 2024-09-15T23:07:57.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:57 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:07:57.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:57 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:07:57.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:57 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:07:57.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:57 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:07:58.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:58 smithi002 ceph-mon[31019]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:07:58.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:58 smithi002 ceph-mon[31019]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T23:07:58.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:07:58.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:58 smithi145 ceph-mon[34901]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:07:58.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:58 smithi145 ceph-mon[34901]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T23:07:58.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:07:58.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:58 smithi112 ceph-mon[34367]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:07:58.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:58 smithi112 ceph-mon[34367]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T23:07:58.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:07:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:59 smithi002 ceph-mon[31019]: pgmap v76: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:07:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:59 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T23:07:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:59 smithi002 ceph-mon[31019]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T23:07:59.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:07:59 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:07:59.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:59 smithi145 ceph-mon[34901]: pgmap v76: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:07:59.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:59 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T23:07:59.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:59 smithi145 ceph-mon[34901]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T23:07:59.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:07:59 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:07:59.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:59 smithi112 ceph-mon[34367]: pgmap v76: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:07:59.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:59 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T23:07:59.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:59 smithi112 ceph-mon[34367]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T23:07:59.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:07:59 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:07:59.960 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:07:59 smithi002 sudo[47256]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T23:07:59.960 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:07:59 smithi002 sudo[47256]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:07:59.961 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:07:59 smithi002 sudo[47256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:07:59.961 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:07:59 smithi002 sudo[47256]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:08:00.295 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:00 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:08:00.295 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:00 smithi112 ceph-mon[34367]: osdmap e20: 3 total, 3 up, 3 in 2024-09-15T23:08:00.295 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:00 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3575476512' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbab372a-8fdd-4b0c-bee3-16cd75b35ee3"}]: dispatch 2024-09-15T23:08:00.295 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:00 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3575476512' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbab372a-8fdd-4b0c-bee3-16cd75b35ee3"}]': finished 2024-09-15T23:08:00.295 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:00 smithi112 ceph-mon[34367]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T23:08:00.295 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:00 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:00.295 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:00 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/717286794' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:08:00.308 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:08:00 smithi002 sudo[47292]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T23:08:00.308 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:08:00 smithi002 sudo[47292]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:08:00.308 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:08:00 smithi002 sudo[47292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:08:00.308 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:08:00 smithi002 sudo[47292]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:08:00.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:00 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:08:00.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:00 smithi002 ceph-mon[31019]: osdmap e20: 3 total, 3 up, 3 in 2024-09-15T23:08:00.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:00 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3575476512' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbab372a-8fdd-4b0c-bee3-16cd75b35ee3"}]: dispatch 2024-09-15T23:08:00.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:00 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3575476512' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbab372a-8fdd-4b0c-bee3-16cd75b35ee3"}]': finished 2024-09-15T23:08:00.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:00 smithi002 ceph-mon[31019]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T23:08:00.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:00 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:00.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:00 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/717286794' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:08:00.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:00.380+0000 7efe16ffd640 1 -- 172.21.15.2:0/4195988596 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7efe1c0b8ff0 con 0x7efe20074c50 2024-09-15T23:08:00.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:00 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:08:00.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:00 smithi145 ceph-mon[34901]: osdmap e20: 3 total, 3 up, 3 in 2024-09-15T23:08:00.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:00 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3575476512' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbab372a-8fdd-4b0c-bee3-16cd75b35ee3"}]: dispatch 2024-09-15T23:08:00.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:00 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3575476512' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbab372a-8fdd-4b0c-bee3-16cd75b35ee3"}]': finished 2024-09-15T23:08:00.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:00 smithi145 ceph-mon[34901]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T23:08:00.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:00 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:00.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:00 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/717286794' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:08:00.552 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:08:00 smithi112 sudo[42944]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T23:08:00.552 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:08:00 smithi112 sudo[42944]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:08:00.552 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:08:00 smithi112 sudo[42944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:08:00.552 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:08:00 smithi112 sudo[42944]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:08:00.996 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:08:00 smithi112 sudo[42947]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T23:08:00.996 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:08:00 smithi112 sudo[42947]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:08:00.996 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:08:00 smithi112 sudo[42947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:08:00.997 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:08:00 smithi112 sudo[42947]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:08:01.078 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:08:00 smithi145 sudo[43736]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T23:08:01.078 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:08:00 smithi145 sudo[43736]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:08:01.078 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:08:00 smithi145 sudo[43736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:08:01.078 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:08:00 smithi145 sudo[43736]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:08:01.078 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:01 smithi145 ceph-mon[34901]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:01.079 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:01.079 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:01 smithi145 ceph-mon[34901]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T23:08:01.079 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:01.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:01 smithi002 ceph-mon[31019]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:01.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:01.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:01 smithi002 ceph-mon[31019]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T23:08:01.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:01.457 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:08:01 smithi145 sudo[43739]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T23:08:01.457 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:08:01 smithi145 sudo[43739]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:08:01.457 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:08:01 smithi145 sudo[43739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:08:01.457 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:08:01 smithi145 sudo[43739]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:08:01.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:01 smithi112 ceph-mon[34367]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:01.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:01.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:01 smithi112 ceph-mon[34367]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T23:08:01.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:01.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:01 smithi002 sudo[47702]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T23:08:01.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:01 smithi002 sudo[47702]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:08:01.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:01 smithi002 sudo[47702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:08:01.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:01 smithi002 sudo[47702]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:08:02.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:01 smithi002 sudo[47708]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T23:08:02.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:02 smithi002 sudo[47708]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:08:02.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:02 smithi002 sudo[47708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:08:02.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:02 smithi002 sudo[47708]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:08:02.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 sudo[43742]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T23:08:02.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 sudo[43742]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:08:02.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 sudo[43742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:08:02.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 sudo[43742]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:08:02.777 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 sudo[43745]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T23:08:02.778 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 sudo[43745]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:08:02.778 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 sudo[43745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:08:02.778 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 sudo[43745]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:08:02.778 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:02.778 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 ceph-mon[34901]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:08:02.778 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 ceph-mon[34901]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:08:02.778 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:08:02.778 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:08:02.778 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:08:02.778 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:08:02.778 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:08:02.778 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:02 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:08:02.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:02 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:02.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:02 smithi002 ceph-mon[31019]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:08:02.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:02 smithi002 ceph-mon[31019]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:08:02.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:02 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:08:02.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:02 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:08:02.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:02 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:08:02.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:02 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:08:02.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:02 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:08:02.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:02 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:08:02.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:02 smithi112 sudo[42950]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T23:08:02.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:02 smithi112 sudo[42950]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:08:02.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:02 smithi112 sudo[42950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:08:02.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:02 smithi112 sudo[42950]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:08:03.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:02 smithi112 sudo[42953]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T23:08:03.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:02 smithi112 sudo[42953]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:08:03.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:02 smithi112 sudo[42953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:08:03.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 sudo[42953]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:08:03.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:03.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:08:03.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:08:03.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:08:03.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:08:03.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:08:03.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:08:03.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:08:03.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:08:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:03 smithi002 ceph-mon[31019]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:03 smithi002 ceph-mon[31019]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:08:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:03 smithi002 ceph-mon[31019]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:08:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:08:03.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:03 smithi002 ceph-mon[31019]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:08:03.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:08:03.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:08:03.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:03 smithi002 ceph-mon[31019]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:08:03.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:03 smithi145 ceph-mon[34901]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:03.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:03 smithi145 ceph-mon[34901]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:08:03.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:03 smithi145 ceph-mon[34901]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:08:03.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:03 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:08:03.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:03 smithi145 ceph-mon[34901]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:08:03.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:03 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:08:03.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:03 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:08:03.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:03 smithi145 ceph-mon[34901]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:08:03.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:03.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:08:03.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:08:03.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:08:03.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:08:03.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:08:03.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:08:03.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:03 smithi112 ceph-mon[34367]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:08:04.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:04 smithi002 ceph-mon[31019]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:04.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:04 smithi145 ceph-mon[34901]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:04.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:04 smithi112 ceph-mon[34367]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:06.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:06 smithi002 ceph-mon[31019]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:06.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:06 smithi145 ceph-mon[34901]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:06.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:06 smithi112 ceph-mon[34367]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:08.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:08 smithi002 ceph-mon[31019]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:08.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:08 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T23:08:08.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:08 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:08.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:08 smithi002 ceph-mon[31019]: Deploying daemon osd.3 on smithi002 2024-09-15T23:08:08.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:08 smithi145 ceph-mon[34901]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:08.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:08 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T23:08:08.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:08 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:08.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:08 smithi145 ceph-mon[34901]: Deploying daemon osd.3 on smithi002 2024-09-15T23:08:08.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:08 smithi112 ceph-mon[34367]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:08.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:08 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T23:08:08.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:08 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:08.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:08 smithi112 ceph-mon[34367]: Deploying daemon osd.3 on smithi002 2024-09-15T23:08:10.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:10 smithi002 ceph-mon[31019]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-15T23:08:10.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:10 smithi145 ceph-mon[34901]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-15T23:08:10.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:10 smithi112 ceph-mon[34367]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-15T23:08:12.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:12 smithi002 ceph-mon[31019]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-15T23:08:12.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:12 smithi145 ceph-mon[34901]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-15T23:08:12.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:12 smithi112 ceph-mon[34367]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-15T23:08:14.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:14 smithi002 ceph-mon[31019]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T23:08:14.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:14 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:08:14.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:14 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:14.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:14 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:14.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:14 smithi145 ceph-mon[34901]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T23:08:14.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:08:14.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:14.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:14.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:14 smithi112 ceph-mon[34367]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T23:08:14.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:14 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:08:14.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:14 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:14.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:14 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:16.800 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:16 smithi002 ceph-mon[31019]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T23:08:16.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:16 smithi145 ceph-mon[34901]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T23:08:16.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:16 smithi112 ceph-mon[34367]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T23:08:18.195 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:17 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:18.196 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:17 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:18.196 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:17 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:18.196 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:17 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:08:18.196 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:17 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:18.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:17 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:18.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:17 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:18.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:17 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:18.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:17 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:08:18.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:17 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:18.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:18.238+0000 7efe16ffd640 1 -- 172.21.15.2:0/4195988596 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7efe20062630 con 0x7efe0c0a3260 2024-09-15T23:08:18.241 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 3 on host 'smithi002' 2024-09-15T23:08:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:18.241+0000 7efe27d7b640 1 -- 172.21.15.2:0/4195988596 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7efe0c0a3260 msgr2=0x7efe0c0a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:08:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:18.241+0000 7efe27d7b640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7efe0c0a3260 0x7efe0c0a5720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe2019f970 tx=0x7efe10005d30 comp rx=0 tx=0).stop 2024-09-15T23:08:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:18.241+0000 7efe27d7b640 1 -- 172.21.15.2:0/4195988596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe20074c50 msgr2=0x7efe2019e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:08:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:18.241+0000 7efe27d7b640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe20074c50 0x7efe2019e450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009230 tx=0x7efe1c004340 comp rx=0 tx=0).stop 2024-09-15T23:08:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:18.241+0000 7efe27d7b640 1 -- 172.21.15.2:0/4195988596 shutdown_connections 2024-09-15T23:08:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:18.241+0000 7efe27d7b640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7efe0c0a3260 0x7efe0c0a5720 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:18.241+0000 7efe27d7b640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe2010e1e0 0x7efe201a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:18.241+0000 7efe27d7b640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe20076220 0x7efe2019e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:18.241+0000 7efe27d7b640 1 --2- 172.21.15.2:0/4195988596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe20074c50 0x7efe2019e450 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:18.241+0000 7efe27d7b640 1 -- 172.21.15.2:0/4195988596 >> 172.21.15.2:0/4195988596 conn(0x7efe200fd390 msgr2=0x7efe200ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:08:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:18.241+0000 7efe27d7b640 1 -- 172.21.15.2:0/4195988596 shutdown_connections 2024-09-15T23:08:18.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:08:18.241+0000 7efe27d7b640 1 -- 172.21.15.2:0/4195988596 wait complete. 2024-09-15T23:08:18.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:17 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:18.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:17 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:18.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:17 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:18.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:17 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:08:18.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:17 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:18.928 DEBUG:teuthology.orchestra.run.smithi002:osd.3> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.3.service 2024-09-15T23:08:18.930 INFO:tasks.cephadm:Deploying osd.4 on smithi112 with /dev/vg_nvme/lv_3... 2024-09-15T23:08:18.931 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T23:08:19.150 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:18 smithi002 ceph-mon[31019]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T23:08:19.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:18 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:08:19.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:18 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:19.151 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:18 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:19.182 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:08:19.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:18 smithi145 ceph-mon[34901]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T23:08:19.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:18 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:08:19.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:18 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:19.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:18 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:19.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:18 smithi112 ceph-mon[34367]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T23:08:19.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:18 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:08:19.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:18 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:19.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:18 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:20.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:19 smithi002 ceph-mon[31019]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T23:08:20.059 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:08:19 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3[49300]: 2024-09-15T23:08:19.752+0000 7f7117ea0640 -1 osd.3 0 log_to_monitors true 2024-09-15T23:08:20.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:19 smithi145 ceph-mon[34901]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T23:08:20.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:19 smithi112 ceph-mon[34367]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T23:08:21.192 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:20 smithi002 ceph-mon[31019]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T23:08:21.192 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:20 smithi002 ceph-mon[31019]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T23:08:21.192 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:20 smithi002 ceph-mon[31019]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T23:08:21.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:20 smithi002 ceph-mon[31019]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-15T23:08:21.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:20 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:21.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:20 smithi145 ceph-mon[34901]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T23:08:21.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:20 smithi145 ceph-mon[34901]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T23:08:21.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:20 smithi145 ceph-mon[34901]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T23:08:21.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:20 smithi145 ceph-mon[34901]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-15T23:08:21.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:20 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:21.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:20 smithi112 ceph-mon[34367]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T23:08:21.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:20 smithi112 ceph-mon[34367]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T23:08:21.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:20 smithi112 ceph-mon[34367]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T23:08:21.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:20 smithi112 ceph-mon[34367]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-15T23:08:21.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:20 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:21.558 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:08:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3[49300]: 2024-09-15T23:08:21.365+0000 7f7113e23640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T23:08:21.558 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:08:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3[49300]: 2024-09-15T23:08:21.370+0000 7f710bc43640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:08:21.751 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:08:21.777 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_3 2024-09-15T23:08:22.033 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:08:22.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:21 smithi145 ceph-mon[34901]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-15T23:08:22.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:21 smithi145 ceph-mon[34901]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T23:08:22.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:21 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:22.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:21 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:22.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:21 smithi145 ceph-mon[34901]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' 2024-09-15T23:08:22.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:21 smithi112 ceph-mon[34367]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-15T23:08:22.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:21 smithi112 ceph-mon[34367]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T23:08:22.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:21 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:22.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:21 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:22.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:21 smithi112 ceph-mon[34367]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' 2024-09-15T23:08:22.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:21 smithi002 ceph-mon[31019]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-15T23:08:22.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:21 smithi002 ceph-mon[31019]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T23:08:22.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:21 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:22.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:21 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:22.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:21 smithi002 ceph-mon[31019]: from='osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968]' entity='osd.3' 2024-09-15T23:08:22.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.550+0000 7f02b060a640 1 -- 172.21.15.112:0/2714744405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02a8100290 msgr2=0x7f02a8100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:08:22.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.550+0000 7f02b060a640 1 --2- 172.21.15.112:0/2714744405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02a8100290 0x7f02a8100690 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009900 tx=0x7f02a402a410 comp rx=0 tx=0).stop 2024-09-15T23:08:22.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.550+0000 7f02b060a640 1 -- 172.21.15.112:0/2714744405 shutdown_connections 2024-09-15T23:08:22.584 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.550+0000 7f02b060a640 1 --2- 172.21.15.112:0/2714744405 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02a8101e50 0x7f02a81086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.550+0000 7f02b060a640 1 --2- 172.21.15.112:0/2714744405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a8101490 0x7f02a8101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.550+0000 7f02b060a640 1 --2- 172.21.15.112:0/2714744405 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02a8100290 0x7f02a8100690 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.550+0000 7f02b060a640 1 -- 172.21.15.112:0/2714744405 >> 172.21.15.112:0/2714744405 conn(0x7f02a80fba40 msgr2=0x7f02a80fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:08:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.550+0000 7f02b060a640 1 -- 172.21.15.112:0/2714744405 shutdown_connections 2024-09-15T23:08:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.550+0000 7f02b060a640 1 -- 172.21.15.112:0/2714744405 wait complete. 2024-09-15T23:08:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.551+0000 7f02b060a640 1 Processor -- start 2024-09-15T23:08:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.551+0000 7f02b060a640 1 -- start start 2024-09-15T23:08:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.551+0000 7f02b060a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a8100290 0x7f02a8104220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:08:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.551+0000 7f02b060a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02a8101490 0x7f02a8102870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:08:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.551+0000 7f02b060a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02a8101e50 0x7f02a8102db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:08:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.551+0000 7f02b060a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f02a810b5c0 con 0x7f02a8100290 2024-09-15T23:08:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.551+0000 7f02b060a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f02a810b440 con 0x7f02a8101e50 2024-09-15T23:08:22.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.551+0000 7f02b060a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f02a810b740 con 0x7f02a8101490 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.551+0000 7f02aeba7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02a8101e50 0x7f02a8102db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.551+0000 7f02aeba7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02a8101e50 0x7f02a8102db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:37878/0 (socket says 172.21.15.112:37878) 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.551+0000 7f02aeba7640 1 -- 172.21.15.112:0/2804566680 learned_addr learned my addr 172.21.15.112:0/2804566680 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.551+0000 7f02ae3a6640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a8100290 0x7f02a8104220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.552+0000 7f02adba5640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02a8101490 0x7f02a8102870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.552+0000 7f02aeba7640 1 -- 172.21.15.112:0/2804566680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02a8101490 msgr2=0x7f02a8102870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.552+0000 7f02aeba7640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02a8101490 0x7f02a8102870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.552+0000 7f02aeba7640 1 -- 172.21.15.112:0/2804566680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a8100290 msgr2=0x7f02a8104220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.552+0000 7f02aeba7640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a8100290 0x7f02a8104220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.552+0000 7f02aeba7640 1 -- 172.21.15.112:0/2804566680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a8103670 con 0x7f02a8101e50 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.552+0000 7f02aeba7640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02a8101e50 0x7f02a8102db0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f02a000ec60 tx=0x7f02a000c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.552+0000 7f029f7fe640 1 -- 172.21.15.112:0/2804566680 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a0004d20 con 0x7f02a8101e50 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.552+0000 7f029f7fe640 1 -- 172.21.15.112:0/2804566680 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f02a000ba20 con 0x7f02a8101e50 2024-09-15T23:08:22.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.552+0000 7f02b060a640 1 -- 172.21.15.112:0/2804566680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a81a20e0 con 0x7f02a8101e50 2024-09-15T23:08:22.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.552+0000 7f029f7fe640 1 -- 172.21.15.112:0/2804566680 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a00056c0 con 0x7f02a8101e50 2024-09-15T23:08:22.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.552+0000 7f02b060a640 1 -- 172.21.15.112:0/2804566680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a81a2670 con 0x7f02a8101e50 2024-09-15T23:08:22.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.553+0000 7f02b060a640 1 -- 172.21.15.112:0/2804566680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a81a2900 con 0x7f02a8101e50 2024-09-15T23:08:22.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.554+0000 7f029f7fe640 1 -- 172.21.15.112:0/2804566680 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f02a000bbd0 con 0x7f02a8101e50 2024-09-15T23:08:22.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.555+0000 7f029f7fe640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f02940a3240 0x7f02940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:08:22.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.555+0000 7f029f7fe640 1 -- 172.21.15.112:0/2804566680 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3702+0+0 (secure 0 0 0) 0x7f02a00ced60 con 0x7f02a8101e50 2024-09-15T23:08:22.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.555+0000 7f02ae3a6640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f02940a3240 0x7f02940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:08:22.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.555+0000 7f02ae3a6640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f02940a3240 0x7f02940a5700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02a4000c00 tx=0x7f02a40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:08:22.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.559+0000 7f029f7fe640 1 -- 172.21.15.112:0/2804566680 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f02a009cc80 con 0x7f02a8101e50 2024-09-15T23:08:22.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:22.734+0000 7f02b060a640 1 -- 172.21.15.112:0/2804566680 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f02a81a2ad0 con 0x7f02940a3240 2024-09-15T23:08:23.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: purged_snaps scrub starts 2024-09-15T23:08:23.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: purged_snaps scrub ok 2024-09-15T23:08:23.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:23.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:23.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968] boot 2024-09-15T23:08:23.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T23:08:23.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:23.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: Detected new or changed devices on smithi002 2024-09-15T23:08:23.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:23.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:23.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:08:23.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:08:23.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-15T23:08:23.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:23.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:23.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:08:23.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:23.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:08:23.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:08:23.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:23.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: purged_snaps scrub starts 2024-09-15T23:08:23.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: purged_snaps scrub ok 2024-09-15T23:08:23.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:23.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:23.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968] boot 2024-09-15T23:08:23.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T23:08:23.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:23.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: Detected new or changed devices on smithi002 2024-09-15T23:08:23.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:23.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:23.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:08:23.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:08:23.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-15T23:08:23.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:23.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:23.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:08:23.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:23.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:08:23.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:08:23.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: purged_snaps scrub starts 2024-09-15T23:08:23.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: purged_snaps scrub ok 2024-09-15T23:08:23.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:08:23.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:23.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: osd.3 [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968] boot 2024-09-15T23:08:23.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T23:08:23.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:08:23.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: Detected new or changed devices on smithi002 2024-09-15T23:08:23.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:23.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:23.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:08:23.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:08:23.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi002 to 8546M 2024-09-15T23:08:23.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:23.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:23.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:08:23.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:23.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:08:23.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:08:23.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:24.141 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:23 smithi112 ceph-mon[34367]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:08:24.141 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:23 smithi112 ceph-mon[34367]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T23:08:24.141 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:23 smithi112 ceph-mon[34367]: osdmap e26: 4 total, 4 up, 4 in 2024-09-15T23:08:24.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:23 smithi145 ceph-mon[34901]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:08:24.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:23 smithi145 ceph-mon[34901]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T23:08:24.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:23 smithi145 ceph-mon[34901]: osdmap e26: 4 total, 4 up, 4 in 2024-09-15T23:08:24.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:23 smithi002 ceph-mon[31019]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:08:24.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:23 smithi002 ceph-mon[31019]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T23:08:24.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:23 smithi002 ceph-mon[31019]: osdmap e26: 4 total, 4 up, 4 in 2024-09-15T23:08:25.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:24 smithi145 ceph-mon[34901]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:25.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:24 smithi145 ceph-mon[34901]: osdmap e27: 4 total, 4 up, 4 in 2024-09-15T23:08:25.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:24 smithi112 ceph-mon[34367]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:25.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:24 smithi112 ceph-mon[34367]: osdmap e27: 4 total, 4 up, 4 in 2024-09-15T23:08:25.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:24 smithi002 ceph-mon[31019]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:25.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:24 smithi002 ceph-mon[31019]: osdmap e27: 4 total, 4 up, 4 in 2024-09-15T23:08:26.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:25 smithi145 ceph-mon[34901]: from='client.? 172.21.15.112:0/962020253' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73bab8af-3973-4beb-a034-d00bcf0c572f"}]: dispatch 2024-09-15T23:08:26.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:25 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73bab8af-3973-4beb-a034-d00bcf0c572f"}]: dispatch 2024-09-15T23:08:26.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:25 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73bab8af-3973-4beb-a034-d00bcf0c572f"}]': finished 2024-09-15T23:08:26.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:25 smithi145 ceph-mon[34901]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T23:08:26.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:25 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:26.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:25 smithi145 ceph-mon[34901]: from='client.? 172.21.15.112:0/3379484255' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:08:26.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:25 smithi112 ceph-mon[34367]: from='client.? 172.21.15.112:0/962020253' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73bab8af-3973-4beb-a034-d00bcf0c572f"}]: dispatch 2024-09-15T23:08:26.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:25 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73bab8af-3973-4beb-a034-d00bcf0c572f"}]: dispatch 2024-09-15T23:08:26.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:25 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73bab8af-3973-4beb-a034-d00bcf0c572f"}]': finished 2024-09-15T23:08:26.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:25 smithi112 ceph-mon[34367]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T23:08:26.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:25 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:26.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:25 smithi112 ceph-mon[34367]: from='client.? 172.21.15.112:0/3379484255' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:08:26.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:25 smithi002 ceph-mon[31019]: from='client.? 172.21.15.112:0/962020253' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73bab8af-3973-4beb-a034-d00bcf0c572f"}]: dispatch 2024-09-15T23:08:26.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:25 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73bab8af-3973-4beb-a034-d00bcf0c572f"}]: dispatch 2024-09-15T23:08:26.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:25 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73bab8af-3973-4beb-a034-d00bcf0c572f"}]': finished 2024-09-15T23:08:26.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:25 smithi002 ceph-mon[31019]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T23:08:26.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:25 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:26.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:25 smithi002 ceph-mon[31019]: from='client.? 172.21.15.112:0/3379484255' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:08:27.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:27 smithi145 ceph-mon[34901]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:27.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:27 smithi112 ceph-mon[34367]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:27 smithi002 ceph-mon[31019]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:29.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:29 smithi145 ceph-mon[34901]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:29.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:29 smithi112 ceph-mon[34367]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:29 smithi002 ceph-mon[31019]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:31.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:31 smithi145 ceph-mon[34901]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T23:08:31.461 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:31 smithi112 ceph-mon[34367]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T23:08:31.563 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:31 smithi002 ceph-mon[31019]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T23:08:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:33 smithi145 ceph-mon[34901]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-15T23:08:33.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:33 smithi112 ceph-mon[34367]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-15T23:08:33.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:33 smithi002 ceph-mon[31019]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-15T23:08:34.224 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:34 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T23:08:34.224 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:34 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:34.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:34 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T23:08:34.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:34 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:34.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:34 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T23:08:34.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:34 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:35 smithi112 ceph-mon[34367]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-15T23:08:35.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:35 smithi112 ceph-mon[34367]: Deploying daemon osd.4 on smithi112 2024-09-15T23:08:35.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:35 smithi145 ceph-mon[34901]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-15T23:08:35.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:35 smithi145 ceph-mon[34901]: Deploying daemon osd.4 on smithi112 2024-09-15T23:08:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:35 smithi002 ceph-mon[31019]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-15T23:08:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:35 smithi002 ceph-mon[31019]: Deploying daemon osd.4 on smithi112 2024-09-15T23:08:37.214 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:37 smithi112 ceph-mon[34367]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-15T23:08:37.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:37 smithi145 ceph-mon[34901]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-15T23:08:37.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:37 smithi002 ceph-mon[31019]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-15T23:08:39.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:39 smithi112 ceph-mon[34367]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:08:39.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:39 smithi145 ceph-mon[34901]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:08:39.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:39 smithi002 ceph-mon[31019]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:08:40.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:08:40.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:40.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:40.465 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:08:40.465 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:40.465 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:40.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:08:40.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:40.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:41.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:41 smithi145 ceph-mon[34901]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:08:41.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:41 smithi112 ceph-mon[34367]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:08:41.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:41 smithi002 ceph-mon[31019]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:08:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:43 smithi145 ceph-mon[34901]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:43 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:43 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:43 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:43.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:43 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:08:43.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:43 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:43.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:43 smithi112 ceph-mon[34367]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:43.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:43 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:43.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:43 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:43.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:43 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:43.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:43 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:08:43.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:43 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:43 smithi002 ceph-mon[31019]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:43 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:43 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:43 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:43 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:08:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:43 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:43.898 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:43.896+0000 7f029f7fe640 1 -- 172.21.15.112:0/2804566680 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f02a81a2ad0 con 0x7f02940a3240 2024-09-15T23:08:43.898 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 4 on host 'smithi112' 2024-09-15T23:08:43.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:43.898+0000 7f02b060a640 1 -- 172.21.15.112:0/2804566680 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f02940a3240 msgr2=0x7f02940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:08:43.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:43.898+0000 7f02b060a640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f02940a3240 0x7f02940a5700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02a4000c00 tx=0x7f02a40314a0 comp rx=0 tx=0).stop 2024-09-15T23:08:43.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:43.899+0000 7f02b060a640 1 -- 172.21.15.112:0/2804566680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02a8101e50 msgr2=0x7f02a8102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:08:43.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:43.899+0000 7f02b060a640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02a8101e50 0x7f02a8102db0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f02a000ec60 tx=0x7f02a000c7a0 comp rx=0 tx=0).stop 2024-09-15T23:08:43.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:43.899+0000 7f02b060a640 1 -- 172.21.15.112:0/2804566680 shutdown_connections 2024-09-15T23:08:43.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:43.899+0000 7f02b060a640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f02940a3240 0x7f02940a5700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:43.900 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:43.899+0000 7f02b060a640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f02a8101e50 0x7f02a8102db0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:43.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:43.899+0000 7f02b060a640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02a8101490 0x7f02a8102870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:43.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:43.899+0000 7f02b060a640 1 --2- 172.21.15.112:0/2804566680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a8100290 0x7f02a8104220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:43.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:43.899+0000 7f02b060a640 1 -- 172.21.15.112:0/2804566680 >> 172.21.15.112:0/2804566680 conn(0x7f02a80fba40 msgr2=0x7f02a8106b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:08:43.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:43.899+0000 7f02b060a640 1 -- 172.21.15.112:0/2804566680 shutdown_connections 2024-09-15T23:08:43.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:08:43.899+0000 7f02b060a640 1 -- 172.21.15.112:0/2804566680 wait complete. 2024-09-15T23:08:44.475 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:44 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:08:44.476 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:44 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:44.476 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:44 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:44.502 DEBUG:teuthology.orchestra.run.smithi112:osd.4> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.4.service 2024-09-15T23:08:44.504 INFO:tasks.cephadm:Deploying osd.5 on smithi145 with /dev/vg_nvme/lv_3... 2024-09-15T23:08:44.504 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T23:08:44.508 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:44 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:08:44.508 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:44 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:44.508 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:44 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:44.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:44 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:08:44.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:44 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:44.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:44 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:44.758 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:08:45.424 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:45 smithi112 ceph-mon[34367]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:45.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:45 smithi002 ceph-mon[31019]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:45.655 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:45 smithi145 ceph-mon[34901]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:46.036 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:08:45 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:08:45.982+0000 7f097d4b2640 -1 osd.4 0 log_to_monitors true 2024-09-15T23:08:46.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:46 smithi112 ceph-mon[34367]: from='osd.4 [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T23:08:46.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:46 smithi112 ceph-mon[34367]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T23:08:46.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:46 smithi002 ceph-mon[31019]: from='osd.4 [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T23:08:46.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:46 smithi002 ceph-mon[31019]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T23:08:46.622 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:46 smithi145 ceph-mon[34901]: from='osd.4 [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T23:08:46.623 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:46 smithi145 ceph-mon[34901]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T23:08:47.348 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:08:47 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:08:47.230+0000 7f0979435640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T23:08:47.349 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:08:47 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:08:47.235+0000 7f097525d640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:08:47.349 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:47 smithi112 ceph-mon[34367]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:47.349 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:47 smithi112 ceph-mon[34367]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T23:08:47.349 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:47 smithi112 ceph-mon[34367]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T23:08:47.349 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:47 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:47.349 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:47 smithi112 ceph-mon[34367]: from='osd.4 [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:08:47.349 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:47 smithi112 ceph-mon[34367]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:08:47.379 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:47 smithi145 ceph-mon[34901]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:47.379 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:47 smithi145 ceph-mon[34901]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T23:08:47.379 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:47 smithi145 ceph-mon[34901]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T23:08:47.379 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:47 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:47.379 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:47 smithi145 ceph-mon[34901]: from='osd.4 [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:08:47.380 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:47 smithi145 ceph-mon[34901]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:08:47.417 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:08:47.445 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi145:vg_nvme/lv_3 2024-09-15T23:08:47.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:47 smithi002 ceph-mon[31019]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:47.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:47 smithi002 ceph-mon[31019]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T23:08:47.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:47 smithi002 ceph-mon[31019]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T23:08:47.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:47 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:47.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:47 smithi002 ceph-mon[31019]: from='osd.4 [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:08:47.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:47 smithi002 ceph-mon[31019]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:08:47.693 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:08:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 -- 172.21.15.145:0/3634482027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e2c101c00 msgr2=0x7f3e2c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:08:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 --2- 172.21.15.145:0/3634482027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e2c101c00 0x7f3e2c102000 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009900 tx=0x7f3e2802a410 comp rx=0 tx=0).stop 2024-09-15T23:08:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 -- 172.21.15.145:0/3634482027 shutdown_connections 2024-09-15T23:08:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 --2- 172.21.15.145:0/3634482027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e2c1037c0 0x7f3e2c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 --2- 172.21.15.145:0/3634482027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e2c102e00 0x7f3e2c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 --2- 172.21.15.145:0/3634482027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e2c101c00 0x7f3e2c102000 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 -- 172.21.15.145:0/3634482027 >> 172.21.15.145:0/3634482027 conn(0x7f3e2c0fd390 msgr2=0x7f3e2c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:08:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 -- 172.21.15.145:0/3634482027 shutdown_connections 2024-09-15T23:08:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 -- 172.21.15.145:0/3634482027 wait complete. 2024-09-15T23:08:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 Processor -- start 2024-09-15T23:08:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 -- start start 2024-09-15T23:08:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e2c101c00 0x7f3e2c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:08:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e2c102e00 0x7f3e2c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:08:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e2c1037c0 0x7f3e2c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:08:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c10d790 con 0x7f3e2c102e00 2024-09-15T23:08:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c10d610 con 0x7f3e2c101c00 2024-09-15T23:08:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.191+0000 7f3e34528640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c10d910 con 0x7f3e2c1037c0 2024-09-15T23:08:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e32ac5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e2c1037c0 0x7f3e2c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:08:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e32ac5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e2c1037c0 0x7f3e2c074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:40140/0 (socket says 172.21.15.145:40140) 2024-09-15T23:08:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e32ac5640 1 -- 172.21.15.145:0/4200754155 learned_addr learned my addr 172.21.15.145:0/4200754155 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-15T23:08:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e31ac3640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e2c102e00 0x7f3e2c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:08:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e322c4640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e2c101c00 0x7f3e2c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:08:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e32ac5640 1 -- 172.21.15.145:0/4200754155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e2c101c00 msgr2=0x7f3e2c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:08:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e32ac5640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e2c101c00 0x7f3e2c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e32ac5640 1 -- 172.21.15.145:0/4200754155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e2c102e00 msgr2=0x7f3e2c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:08:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e32ac5640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e2c102e00 0x7f3e2c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:08:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e32ac5640 1 -- 172.21.15.145:0/4200754155 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2c0753e0 con 0x7f3e2c1037c0 2024-09-15T23:08:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e31ac3640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e2c102e00 0x7f3e2c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:08:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e322c4640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e2c101c00 0x7f3e2c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:08:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e32ac5640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e2c1037c0 0x7f3e2c074b20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400cad0 tx=0x7f3e2400cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:08:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e237fe640 1 -- 172.21.15.145:0/4200754155 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2400ae20 con 0x7f3e2c1037c0 2024-09-15T23:08:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e237fe640 1 -- 172.21.15.145:0/4200754155 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e24005020 con 0x7f3e2c1037c0 2024-09-15T23:08:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e34528640 1 -- 172.21.15.145:0/4200754155 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e2c1a2080 con 0x7f3e2c1037c0 2024-09-15T23:08:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e237fe640 1 -- 172.21.15.145:0/4200754155 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2400f6b0 con 0x7f3e2c1037c0 2024-09-15T23:08:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.192+0000 7f3e34528640 1 -- 172.21.15.145:0/4200754155 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2c1a25c0 con 0x7f3e2c1037c0 2024-09-15T23:08:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.194+0000 7f3e34528640 1 -- 172.21.15.145:0/4200754155 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e2c1090f0 con 0x7f3e2c1037c0 2024-09-15T23:08:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.194+0000 7f3e237fe640 1 -- 172.21.15.145:0/4200754155 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f3e240051d0 con 0x7f3e2c1037c0 2024-09-15T23:08:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.195+0000 7f3e237fe640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3e180a3240 0x7f3e180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:08:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.195+0000 7f3e237fe640 1 -- 172.21.15.145:0/4200754155 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7f3e240ce890 con 0x7f3e2c1037c0 2024-09-15T23:08:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.195+0000 7f3e322c4640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3e180a3240 0x7f3e180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:08:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.196+0000 7f3e322c4640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3e180a3240 0x7f3e180a5700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3e28000c00 tx=0x7f3e28031d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:08:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.199+0000 7f3e237fe640 1 -- 172.21.15.145:0/4200754155 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e24014030 con 0x7f3e2c1037c0 2024-09-15T23:08:48.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:08:48.433+0000 7f3e34528640 1 -- 172.21.15.145:0/4200754155 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3e2c062630 con 0x7f3e180a3240 2024-09-15T23:08:48.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T23:08:48.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T23:08:48.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:48.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:48.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: Detected new or changed devices on smithi112 2024-09-15T23:08:48.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:48.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:48.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:08:48.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:08:48.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi112 to 8544M 2024-09-15T23:08:48.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:48.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:48.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:08:48.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:48 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:48.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T23:08:48.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T23:08:48.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:48.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:48.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: Detected new or changed devices on smithi112 2024-09-15T23:08:48.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:48.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:48.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:08:48.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:08:48.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi112 to 8544M 2024-09-15T23:08:48.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:48.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:48.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:08:48.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:48 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:48.663 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T23:08:48.664 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T23:08:48.664 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:48.664 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:48.664 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: Detected new or changed devices on smithi112 2024-09-15T23:08:48.664 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:48.664 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:48.664 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:08:48.664 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:08:48.664 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi112 to 8544M 2024-09-15T23:08:48.664 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:48.664 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:48.664 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:08:48.665 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:48 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:08:49.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:49 smithi112 ceph-mon[34367]: purged_snaps scrub starts 2024-09-15T23:08:49.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:49 smithi112 ceph-mon[34367]: purged_snaps scrub ok 2024-09-15T23:08:49.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:49 smithi112 ceph-mon[34367]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:49.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:49 smithi112 ceph-mon[34367]: osd.4 [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767] boot 2024-09-15T23:08:49.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:49 smithi112 ceph-mon[34367]: osdmap e31: 5 total, 5 up, 5 in 2024-09-15T23:08:49.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:49.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:08:49.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:08:49.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:49.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:49 smithi002 ceph-mon[31019]: purged_snaps scrub starts 2024-09-15T23:08:49.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:49 smithi002 ceph-mon[31019]: purged_snaps scrub ok 2024-09-15T23:08:49.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:49 smithi002 ceph-mon[31019]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:49.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:49 smithi002 ceph-mon[31019]: osd.4 [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767] boot 2024-09-15T23:08:49.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:49 smithi002 ceph-mon[31019]: osdmap e31: 5 total, 5 up, 5 in 2024-09-15T23:08:49.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:49.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:08:49.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:08:49.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:49.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:49 smithi145 ceph-mon[34901]: purged_snaps scrub starts 2024-09-15T23:08:49.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:49 smithi145 ceph-mon[34901]: purged_snaps scrub ok 2024-09-15T23:08:49.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:49 smithi145 ceph-mon[34901]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 127 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:08:49.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:49 smithi145 ceph-mon[34901]: osd.4 [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767] boot 2024-09-15T23:08:49.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:49 smithi145 ceph-mon[34901]: osdmap e31: 5 total, 5 up, 5 in 2024-09-15T23:08:49.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:08:49.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:08:49.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:08:49.573 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:08:50.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:50 smithi145 ceph-mon[34901]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:08:50.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:50 smithi145 ceph-mon[34901]: osdmap e32: 5 total, 5 up, 5 in 2024-09-15T23:08:50.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:50 smithi112 ceph-mon[34367]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:08:50.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:50 smithi112 ceph-mon[34367]: osdmap e32: 5 total, 5 up, 5 in 2024-09-15T23:08:50.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:50 smithi002 ceph-mon[31019]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:08:50.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:50 smithi002 ceph-mon[31019]: osdmap e32: 5 total, 5 up, 5 in 2024-09-15T23:08:51.662 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:51 smithi112 ceph-mon[34367]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:51.662 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:51 smithi112 ceph-mon[34367]: from='client.? 172.21.15.145:0/2464082581' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d163e61-5891-46c1-b1c2-39d50a3b6f98"}]: dispatch 2024-09-15T23:08:51.662 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:51 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d163e61-5891-46c1-b1c2-39d50a3b6f98"}]: dispatch 2024-09-15T23:08:51.663 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:51 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d163e61-5891-46c1-b1c2-39d50a3b6f98"}]': finished 2024-09-15T23:08:51.663 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:51 smithi112 ceph-mon[34367]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T23:08:51.663 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:51 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:08:51.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:51 smithi145 ceph-mon[34901]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:51.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:51 smithi145 ceph-mon[34901]: from='client.? 172.21.15.145:0/2464082581' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d163e61-5891-46c1-b1c2-39d50a3b6f98"}]: dispatch 2024-09-15T23:08:51.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:51 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d163e61-5891-46c1-b1c2-39d50a3b6f98"}]: dispatch 2024-09-15T23:08:51.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:51 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d163e61-5891-46c1-b1c2-39d50a3b6f98"}]': finished 2024-09-15T23:08:51.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:51 smithi145 ceph-mon[34901]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T23:08:51.709 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:51 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:08:51.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:51 smithi002 ceph-mon[31019]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:51.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:51 smithi002 ceph-mon[31019]: from='client.? 172.21.15.145:0/2464082581' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d163e61-5891-46c1-b1c2-39d50a3b6f98"}]: dispatch 2024-09-15T23:08:51.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:51 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d163e61-5891-46c1-b1c2-39d50a3b6f98"}]: dispatch 2024-09-15T23:08:51.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:51 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d163e61-5891-46c1-b1c2-39d50a3b6f98"}]': finished 2024-09-15T23:08:51.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:51 smithi002 ceph-mon[31019]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T23:08:51.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:51 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:08:52.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:52 smithi145 ceph-mon[34901]: from='client.? 172.21.15.145:0/4291986549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:08:52.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:52 smithi112 ceph-mon[34367]: from='client.? 172.21.15.145:0/4291986549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:08:52.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:52 smithi002 ceph-mon[31019]: from='client.? 172.21.15.145:0/4291986549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:08:53.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:53 smithi145 ceph-mon[34901]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:53.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:53 smithi112 ceph-mon[34367]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:53.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:53 smithi002 ceph-mon[31019]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:55.673 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:55 smithi145 ceph-mon[34901]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:55.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:55 smithi112 ceph-mon[34367]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:55.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:55 smithi002 ceph-mon[31019]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:57.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:57 smithi145 ceph-mon[34901]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:57.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:57 smithi112 ceph-mon[34367]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:57.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:57 smithi002 ceph-mon[31019]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:59.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:08:59 smithi145 ceph-mon[34901]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:59.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:08:59 smithi112 ceph-mon[34367]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:08:59.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:08:59 smithi002 ceph-mon[31019]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:00.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:00 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T23:09:00.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:00 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:00.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:00 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T23:09:00.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:00 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:00.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:00 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T23:09:00.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:00 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:01.638 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:01 smithi145 ceph-mon[34901]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:01.638 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:01 smithi145 ceph-mon[34901]: Deploying daemon osd.5 on smithi145 2024-09-15T23:09:01.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:01 smithi112 ceph-mon[34367]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:01.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:01 smithi112 ceph-mon[34367]: Deploying daemon osd.5 on smithi145 2024-09-15T23:09:01.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:01 smithi002 ceph-mon[31019]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:01.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:01 smithi002 ceph-mon[31019]: Deploying daemon osd.5 on smithi145 2024-09-15T23:09:02.687 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:02 smithi145 ceph-mon[34901]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:02.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:02 smithi112 ceph-mon[34367]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:02.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:02 smithi002 ceph-mon[31019]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:04.775 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:04 smithi145 ceph-mon[34901]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:04.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:04 smithi002 ceph-mon[31019]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:04.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:04 smithi112 ceph-mon[34367]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:06.806 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:06 smithi145 ceph-mon[34901]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:06.806 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:06.806 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:06.807 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:06.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:06 smithi002 ceph-mon[31019]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:06.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:06.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:06.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:06.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:06 smithi112 ceph-mon[34367]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:06.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:06.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:06.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:08.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:08 smithi002 ceph-mon[31019]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:08.892 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:08 smithi145 ceph-mon[34901]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:08.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:08 smithi112 ceph-mon[34367]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:09.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:09:09.559+0000 7f3e237fe640 1 -- 172.21.15.145:0/4200754155 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3e2c062630 con 0x7f3e180a3240 2024-09-15T23:09:09.561 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 5 on host 'smithi145' 2024-09-15T23:09:09.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:09:09.562+0000 7f3e34528640 1 -- 172.21.15.145:0/4200754155 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3e180a3240 msgr2=0x7f3e180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:09:09.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:09:09.562+0000 7f3e34528640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3e180a3240 0x7f3e180a5700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3e28000c00 tx=0x7f3e28031d10 comp rx=0 tx=0).stop 2024-09-15T23:09:09.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:09:09.562+0000 7f3e34528640 1 -- 172.21.15.145:0/4200754155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e2c1037c0 msgr2=0x7f3e2c074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:09:09.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:09:09.562+0000 7f3e34528640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e2c1037c0 0x7f3e2c074b20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400cad0 tx=0x7f3e2400cf90 comp rx=0 tx=0).stop 2024-09-15T23:09:09.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:09:09.562+0000 7f3e34528640 1 -- 172.21.15.145:0/4200754155 shutdown_connections 2024-09-15T23:09:09.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:09:09.562+0000 7f3e34528640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3e180a3240 0x7f3e180a5700 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:09.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:09:09.562+0000 7f3e34528640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e2c1037c0 0x7f3e2c074b20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:09.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:09:09.562+0000 7f3e34528640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e2c102e00 0x7f3e2c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:09.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:09:09.562+0000 7f3e34528640 1 --2- 172.21.15.145:0/4200754155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3e2c101c00 0x7f3e2c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:09.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:09:09.562+0000 7f3e34528640 1 -- 172.21.15.145:0/4200754155 >> 172.21.15.145:0/4200754155 conn(0x7f3e2c0fd390 msgr2=0x7f3e2c1062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:09:09.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:09:09.562+0000 7f3e34528640 1 -- 172.21.15.145:0/4200754155 shutdown_connections 2024-09-15T23:09:09.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:09:09.562+0000 7f3e34528640 1 -- 172.21.15.145:0/4200754155 wait complete. 2024-09-15T23:09:10.187 DEBUG:teuthology.orchestra.run.smithi145:osd.5> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.5.service 2024-09-15T23:09:10.189 INFO:tasks.cephadm:Deploying osd.6 on smithi002 with /dev/vg_nvme/lv_2... 2024-09-15T23:09:10.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T23:09:10.408 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:10 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.408 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:10 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.409 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:10 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:10.409 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:10 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:09:10.409 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:10 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.409 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:10 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:10.409 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:10 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.409 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:10 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.453 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:09:10.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:10 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:10 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:10 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:10.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:10 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:09:10.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:10 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:10 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:10.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:10 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:10 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:10.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:09:10.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:10.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:10.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:11.422 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:11 smithi145 ceph-mon[34901]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:11.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:11 smithi112 ceph-mon[34367]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:11.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:11 smithi002 ceph-mon[31019]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:12.458 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:09:12 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:09:12.174+0000 7fe5cf7e2640 -1 osd.5 0 log_to_monitors true 2024-09-15T23:09:13.417 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:13 smithi002 ceph-mon[31019]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:13.417 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:13 smithi002 ceph-mon[31019]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T23:09:13.417 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:13.418 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:13.418 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:13.418 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:13.418 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:13.418 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:13.418 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:09:13.418 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:13.421 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:09:13.448 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_2 2024-09-15T23:09:13.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:13 smithi145 ceph-mon[34901]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:13.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:13 smithi145 ceph-mon[34901]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T23:09:13.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:13.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:13.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:13.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:13.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:13.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:13.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:09:13.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:13 smithi112 ceph-mon[34367]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:13 smithi112 ceph-mon[34367]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T23:09:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:09:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:13.716 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:09:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.205+0000 7f53e3a22640 1 -- 172.21.15.2:0/3072906763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc107900 msgr2=0x7f53dc109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:09:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.205+0000 7f53e3a22640 1 --2- 172.21.15.2:0/3072906763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc107900 0x7f53dc109d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009ca0 tx=0x7f53d402a8c0 comp rx=0 tx=0).stop 2024-09-15T23:09:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 -- 172.21.15.2:0/3072906763 shutdown_connections 2024-09-15T23:09:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 --2- 172.21.15.2:0/3072906763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc107900 0x7f53dc109d50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 --2- 172.21.15.2:0/3072906763 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53dc104fd0 0x7f53dc1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 --2- 172.21.15.2:0/3072906763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53dc1026a0 0x7f53dc104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 -- 172.21.15.2:0/3072906763 >> 172.21.15.2:0/3072906763 conn(0x7f53dc0fc2a0 msgr2=0x7f53dc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:09:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 -- 172.21.15.2:0/3072906763 shutdown_connections 2024-09-15T23:09:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 -- 172.21.15.2:0/3072906763 wait complete. 2024-09-15T23:09:14.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 Processor -- start 2024-09-15T23:09:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 -- start start 2024-09-15T23:09:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc1026a0 0x7f53dc197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:09:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53dc104fd0 0x7f53dc198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:09:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53dc107900 0x7f53dc19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:09:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc10d750 con 0x7f53dc1026a0 2024-09-15T23:09:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc10d5d0 con 0x7f53dc107900 2024-09-15T23:09:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.206+0000 7f53e3a22640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc10d8d0 con 0x7f53dc104fd0 2024-09-15T23:09:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53e17be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc1026a0 0x7f53dc197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:09:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53e17be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc1026a0 0x7f53dc197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53418/0 (socket says 172.21.15.2:53418) 2024-09-15T23:09:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53e17be640 1 -- 172.21.15.2:0/2055513064 learned_addr learned my addr 172.21.15.2:0/2055513064 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:09:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53e0fbd640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53dc104fd0 0x7f53dc198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:09:14.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53e1fbf640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53dc107900 0x7f53dc19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:09:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53e17be640 1 -- 172.21.15.2:0/2055513064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53dc104fd0 msgr2=0x7f53dc198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:09:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53e17be640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53dc104fd0 0x7f53dc198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53e17be640 1 -- 172.21.15.2:0/2055513064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53dc107900 msgr2=0x7f53dc19f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:09:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53e17be640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53dc107900 0x7f53dc19f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53e17be640 1 -- 172.21.15.2:0/2055513064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc19fa40 con 0x7f53dc1026a0 2024-09-15T23:09:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53e17be640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc1026a0 0x7f53dc197e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f53d800d950 tx=0x7f53d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:09:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53d27fc640 1 -- 172.21.15.2:0/2055513064 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d8017070 con 0x7f53dc1026a0 2024-09-15T23:09:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53e3a22640 1 -- 172.21.15.2:0/2055513064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53dc19fd30 con 0x7f53dc1026a0 2024-09-15T23:09:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53d27fc640 1 -- 172.21.15.2:0/2055513064 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f53d8009c30 con 0x7f53dc1026a0 2024-09-15T23:09:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53d27fc640 1 -- 172.21.15.2:0/2055513064 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d800f620 con 0x7f53dc1026a0 2024-09-15T23:09:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.207+0000 7f53e3a22640 1 -- 172.21.15.2:0/2055513064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53dc1a01b0 con 0x7f53dc1026a0 2024-09-15T23:09:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.208+0000 7f53e3a22640 1 -- 172.21.15.2:0/2055513064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53dc0fdd90 con 0x7f53dc1026a0 2024-09-15T23:09:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.210+0000 7f53d27fc640 1 -- 172.21.15.2:0/2055513064 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f53d80109a0 con 0x7f53dc1026a0 2024-09-15T23:09:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.211+0000 7f53d27fc640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f53c80a3270 0x7f53c80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:09:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.211+0000 7f53e0fbd640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f53c80a3270 0x7f53c80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:09:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.211+0000 7f53d27fc640 1 -- 172.21.15.2:0/2055513064 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4253+0+0 (secure 0 0 0) 0x7f53d80ce400 con 0x7f53dc1026a0 2024-09-15T23:09:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.212+0000 7f53e0fbd640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f53c80a3270 0x7f53c80a5730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f53dc199330 tx=0x7f53cc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:09:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.215+0000 7f53d27fc640 1 -- 172.21.15.2:0/2055513064 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f53d809bab0 con 0x7f53dc1026a0 2024-09-15T23:09:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:14.398+0000 7f53e3a22640 1 -- 172.21.15.2:0/2055513064 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f53dc062630 con 0x7f53c80a3270 2024-09-15T23:09:14.399 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:14 smithi002 ceph-mon[31019]: Detected new or changed devices on smithi145 2024-09-15T23:09:14.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:14 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi145 to 8544M 2024-09-15T23:09:14.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:14 smithi002 ceph-mon[31019]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T23:09:14.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:14 smithi002 ceph-mon[31019]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T23:09:14.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:14 smithi002 ceph-mon[31019]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:09:14.400 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:14 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:09:14.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:14 smithi145 ceph-mon[34901]: Detected new or changed devices on smithi145 2024-09-15T23:09:14.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:14 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi145 to 8544M 2024-09-15T23:09:14.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:14 smithi145 ceph-mon[34901]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T23:09:14.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:14 smithi145 ceph-mon[34901]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T23:09:14.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:14 smithi145 ceph-mon[34901]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:09:14.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:09:14.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:14 smithi112 ceph-mon[34367]: Detected new or changed devices on smithi145 2024-09-15T23:09:14.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:14 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi145 to 8544M 2024-09-15T23:09:14.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:14 smithi112 ceph-mon[34367]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T23:09:14.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:14 smithi112 ceph-mon[34367]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T23:09:14.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:14 smithi112 ceph-mon[34367]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:09:14.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:14 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:09:14.957 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:09:14 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:09:14.573+0000 7fe5cb765640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T23:09:14.957 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:09:14 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:09:14.581+0000 7fe5c3585640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:09:15.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: purged_snaps scrub starts 2024-09-15T23:09:15.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: purged_snaps scrub ok 2024-09-15T23:09:15.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:15.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-15T23:09:15.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: osdmap e35: 6 total, 5 up, 6 in 2024-09-15T23:09:15.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:09:15.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:09:15.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:09:15.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:09:15.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:09:15.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:15.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' 2024-09-15T23:09:15.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242] boot 2024-09-15T23:09:15.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T23:09:15.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:15 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:09:15.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: purged_snaps scrub starts 2024-09-15T23:09:15.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: purged_snaps scrub ok 2024-09-15T23:09:15.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:15.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-15T23:09:15.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: osdmap e35: 6 total, 5 up, 6 in 2024-09-15T23:09:15.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:09:15.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:09:15.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:09:15.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:09:15.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:09:15.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:15.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' 2024-09-15T23:09:15.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242] boot 2024-09-15T23:09:15.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T23:09:15.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:15 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:09:15.511 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: purged_snaps scrub starts 2024-09-15T23:09:15.511 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: purged_snaps scrub ok 2024-09-15T23:09:15.511 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:09:15.511 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-15T23:09:15.511 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: osdmap e35: 6 total, 5 up, 6 in 2024-09-15T23:09:15.511 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:09:15.511 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:09:15.511 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:09:15.512 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:09:15.512 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:09:15.512 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:15.512 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: from='osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242]' entity='osd.5' 2024-09-15T23:09:15.512 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: osd.5 [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242] boot 2024-09-15T23:09:15.512 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T23:09:15.512 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:15 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:09:17.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:16 smithi112 ceph-mon[34367]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:17.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:16 smithi112 ceph-mon[34367]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T23:09:17.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:16 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/4154601721' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bca02c96-10de-4953-96e9-42fc9ddf7c1f"}]: dispatch 2024-09-15T23:09:17.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:16 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/4154601721' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bca02c96-10de-4953-96e9-42fc9ddf7c1f"}]': finished 2024-09-15T23:09:17.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:16 smithi112 ceph-mon[34367]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T23:09:17.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:16 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:17.267 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:16 smithi002 ceph-mon[31019]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:17.267 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:16 smithi002 ceph-mon[31019]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T23:09:17.267 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:16 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/4154601721' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bca02c96-10de-4953-96e9-42fc9ddf7c1f"}]: dispatch 2024-09-15T23:09:17.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:16 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/4154601721' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bca02c96-10de-4953-96e9-42fc9ddf7c1f"}]': finished 2024-09-15T23:09:17.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:16 smithi002 ceph-mon[31019]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T23:09:17.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:16 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:17.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:16 smithi145 ceph-mon[34901]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:17.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:16 smithi145 ceph-mon[34901]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T23:09:17.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:16 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/4154601721' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bca02c96-10de-4953-96e9-42fc9ddf7c1f"}]: dispatch 2024-09-15T23:09:17.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:16 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/4154601721' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bca02c96-10de-4953-96e9-42fc9ddf7c1f"}]': finished 2024-09-15T23:09:17.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:16 smithi145 ceph-mon[34901]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T23:09:17.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:16 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:18.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:17 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/934904473' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:09:18.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:17 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/934904473' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:09:18.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:17 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/934904473' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:09:19.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:18 smithi112 ceph-mon[34367]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:19.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:18 smithi112 ceph-mon[34367]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T23:09:19.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:18 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:19.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:18 smithi002 ceph-mon[31019]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:19.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:18 smithi002 ceph-mon[31019]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T23:09:19.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:18 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:19.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:18 smithi145 ceph-mon[34901]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:19.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:18 smithi145 ceph-mon[34901]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T23:09:19.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:18 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:20.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:19 smithi112 ceph-mon[34367]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T23:09:20.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:19 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:20.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:19 smithi002 ceph-mon[31019]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T23:09:20.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:20.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:19 smithi145 ceph-mon[34901]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T23:09:20.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:21.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:20 smithi112 ceph-mon[34367]: pgmap v139: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T23:09:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:20 smithi002 ceph-mon[31019]: pgmap v139: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T23:09:21.359 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:20 smithi145 ceph-mon[34901]: pgmap v139: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T23:09:23.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:22 smithi112 ceph-mon[34367]: pgmap v140: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-15T23:09:23.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:22 smithi002 ceph-mon[31019]: pgmap v140: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-15T23:09:23.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:22 smithi145 ceph-mon[34901]: pgmap v140: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-15T23:09:25.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:24 smithi112 ceph-mon[34367]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-15T23:09:25.281 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:24 smithi002 ceph-mon[31019]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-15T23:09:25.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:24 smithi145 ceph-mon[34901]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-15T23:09:26.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:25 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T23:09:26.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:25 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:26.293 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:25 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T23:09:26.293 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:25 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:26.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:25 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T23:09:26.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:25 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:27.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:26 smithi112 ceph-mon[34367]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T23:09:27.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:26 smithi112 ceph-mon[34367]: Deploying daemon osd.6 on smithi002 2024-09-15T23:09:27.266 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:26 smithi002 ceph-mon[31019]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T23:09:27.266 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:26 smithi002 ceph-mon[31019]: Deploying daemon osd.6 on smithi002 2024-09-15T23:09:27.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:26 smithi145 ceph-mon[34901]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T23:09:27.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:26 smithi145 ceph-mon[34901]: Deploying daemon osd.6 on smithi002 2024-09-15T23:09:29.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:28 smithi112 ceph-mon[34367]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:29.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:28 smithi002 ceph-mon[31019]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:29.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:28 smithi145 ceph-mon[34901]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:31.213 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:30 smithi002 ceph-mon[31019]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:31.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:30 smithi112 ceph-mon[34367]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:31.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:30 smithi145 ceph-mon[34901]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:32.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:31 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:32.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:31 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:32.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:31 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:32.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:31 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:32.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:31 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:32.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:31 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:32.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:31 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:32.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:31 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:32.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:31 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:33.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:33 smithi002 ceph-mon[31019]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:33 smithi145 ceph-mon[34901]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:33.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:33 smithi112 ceph-mon[34367]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:35 smithi002 ceph-mon[31019]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:09:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:35.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:35 smithi145 ceph-mon[34901]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:09:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:35.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:35 smithi112 ceph-mon[34367]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:35.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:35.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:35.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:35.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:09:35.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:35.793+0000 7f53d27fc640 1 -- 172.21.15.2:0/2055513064 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f53dc062630 con 0x7f53c80a3270 2024-09-15T23:09:35.795 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 6 on host 'smithi002' 2024-09-15T23:09:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:35.796+0000 7f53e3a22640 1 -- 172.21.15.2:0/2055513064 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f53c80a3270 msgr2=0x7f53c80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:09:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:35.796+0000 7f53e3a22640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f53c80a3270 0x7f53c80a5730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f53dc199330 tx=0x7f53cc00a2d0 comp rx=0 tx=0).stop 2024-09-15T23:09:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:35.796+0000 7f53e3a22640 1 -- 172.21.15.2:0/2055513064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc1026a0 msgr2=0x7f53dc197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:09:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:35.796+0000 7f53e3a22640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc1026a0 0x7f53dc197e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f53d800d950 tx=0x7f53d800de10 comp rx=0 tx=0).stop 2024-09-15T23:09:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:35.796+0000 7f53e3a22640 1 -- 172.21.15.2:0/2055513064 shutdown_connections 2024-09-15T23:09:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:35.796+0000 7f53e3a22640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f53c80a3270 0x7f53c80a5730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:35.796+0000 7f53e3a22640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53dc107900 0x7f53dc19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:35.796+0000 7f53e3a22640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53dc104fd0 0x7f53dc198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:35.796+0000 7f53e3a22640 1 --2- 172.21.15.2:0/2055513064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53dc1026a0 0x7f53dc197e10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:35.796+0000 7f53e3a22640 1 -- 172.21.15.2:0/2055513064 >> 172.21.15.2:0/2055513064 conn(0x7f53dc0fc2a0 msgr2=0x7f53dc103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:09:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:35.796+0000 7f53e3a22640 1 -- 172.21.15.2:0/2055513064 shutdown_connections 2024-09-15T23:09:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:09:35.796+0000 7f53e3a22640 1 -- 172.21.15.2:0/2055513064 wait complete. 2024-09-15T23:09:36.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:36.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:36.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:36.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:36.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:36.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:36.459 DEBUG:teuthology.orchestra.run.smithi002:osd.6> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.6.service 2024-09-15T23:09:36.462 INFO:tasks.cephadm:Deploying osd.7 on smithi112 with /dev/vg_nvme/lv_2... 2024-09-15T23:09:36.462 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T23:09:36.489 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:36.489 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:36.489 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:36.713 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:09:37.108 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:37 smithi112 ceph-mon[34367]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:37.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:37 smithi002 ceph-mon[31019]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:37.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:37 smithi145 ceph-mon[34901]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:38.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:38 smithi112 ceph-mon[34367]: from='osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T23:09:38.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:38 smithi002 ceph-mon[31019]: from='osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T23:09:38.258 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:09:37 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:09:37.981+0000 7f2dc642d640 -1 osd.6 0 log_to_monitors true 2024-09-15T23:09:38.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:38 smithi145 ceph-mon[34901]: from='osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T23:09:39.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:39 smithi002 ceph-mon[31019]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:39.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:39 smithi002 ceph-mon[31019]: from='osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T23:09:39.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:39 smithi002 ceph-mon[31019]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T23:09:39.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:39 smithi002 ceph-mon[31019]: from='osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-15T23:09:39.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:39 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:39.183 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:09:39 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:09:39.024+0000 7f2dc23b0640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T23:09:39.183 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:09:39 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:09:39.032+0000 7f2dbe1d8640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:09:39.395 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:39 smithi112 ceph-mon[34367]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:39.395 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:39 smithi112 ceph-mon[34367]: from='osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T23:09:39.395 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:39 smithi112 ceph-mon[34367]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T23:09:39.396 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:39 smithi112 ceph-mon[34367]: from='osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-15T23:09:39.396 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:39 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:39.398 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:09:39.425 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_2 2024-09-15T23:09:39.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:39 smithi145 ceph-mon[34901]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:39.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:39 smithi145 ceph-mon[34901]: from='osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T23:09:39.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:39 smithi145 ceph-mon[34901]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T23:09:39.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:39 smithi145 ceph-mon[34901]: from='osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-15T23:09:39.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:39 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:39.720 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:09:40.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:40 smithi112 ceph-mon[34367]: from='osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-15T23:09:40.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:40 smithi112 ceph-mon[34367]: osdmap e42: 7 total, 6 up, 7 in 2024-09-15T23:09:40.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:40.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:40.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:40.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:40.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:40.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:40.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:40.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:40.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:40.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:09:40.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:40.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.216+0000 7f39cfd56640 1 -- 172.21.15.112:0/1135509814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102690 msgr2=0x7f39c8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:09:40.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.216+0000 7f39cfd56640 1 --2- 172.21.15.112:0/1135509814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102690 0x7f39c8108f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009ca0 tx=0x7f39c002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:09:40.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.216+0000 7f39cfd56640 1 -- 172.21.15.112:0/1135509814 shutdown_connections 2024-09-15T23:09:40.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.216+0000 7f39cfd56640 1 --2- 172.21.15.112:0/1135509814 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102690 0x7f39c8108f20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:40.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.216+0000 7f39cfd56640 1 --2- 172.21.15.112:0/1135509814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c8101cd0 0x7f39c8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:40.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.216+0000 7f39cfd56640 1 --2- 172.21.15.112:0/1135509814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39c8100ad0 0x7f39c8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:40.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.216+0000 7f39cfd56640 1 -- 172.21.15.112:0/1135509814 >> 172.21.15.112:0/1135509814 conn(0x7f39c80fc280 msgr2=0x7f39c80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:09:40.249 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.216+0000 7f39cfd56640 1 -- 172.21.15.112:0/1135509814 shutdown_connections 2024-09-15T23:09:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.216+0000 7f39cfd56640 1 -- 172.21.15.112:0/1135509814 wait complete. 2024-09-15T23:09:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39cfd56640 1 Processor -- start 2024-09-15T23:09:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39cfd56640 1 -- start start 2024-09-15T23:09:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39cfd56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c8100ad0 0x7f39c8199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:09:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39cfd56640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39c8101cd0 0x7f39c819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:09:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39cfd56640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102690 0x7f39c81a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:09:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39cfd56640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39c810c5e0 con 0x7f39c8100ad0 2024-09-15T23:09:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39cfd56640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f39c810c460 con 0x7f39c8102690 2024-09-15T23:09:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39cfd56640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f39c810c760 con 0x7f39c8101cd0 2024-09-15T23:09:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39ce2f3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102690 0x7f39c81a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:09:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39ce2f3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102690 0x7f39c81a14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39060/0 (socket says 172.21.15.112:39060) 2024-09-15T23:09:40.250 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39ce2f3640 1 -- 172.21.15.112:0/707510651 learned_addr learned my addr 172.21.15.112:0/707510651 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:09:40.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39cdaf2640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c8100ad0 0x7f39c8199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:09:40.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39cd2f1640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39c8101cd0 0x7f39c819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:09:40.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39ce2f3640 1 -- 172.21.15.112:0/707510651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39c8101cd0 msgr2=0x7f39c819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:09:40.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39ce2f3640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39c8101cd0 0x7f39c819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:40.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39ce2f3640 1 -- 172.21.15.112:0/707510651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c8100ad0 msgr2=0x7f39c8199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:09:40.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39ce2f3640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c8100ad0 0x7f39c8199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:09:40.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39ce2f3640 1 -- 172.21.15.112:0/707510651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c81a1b30 con 0x7f39c8102690 2024-09-15T23:09:40.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.217+0000 7f39cdaf2640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c8100ad0 0x7f39c8199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:09:40.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.218+0000 7f39ce2f3640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102690 0x7f39c81a14c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009dc0 tx=0x7f39c0003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:09:40.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.218+0000 7f39beffd640 1 -- 172.21.15.112:0/707510651 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c0032ec0 con 0x7f39c8102690 2024-09-15T23:09:40.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.218+0000 7f39cfd56640 1 -- 172.21.15.112:0/707510651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c81a1dc0 con 0x7f39c8102690 2024-09-15T23:09:40.251 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.218+0000 7f39beffd640 1 -- 172.21.15.112:0/707510651 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39c00044f0 con 0x7f39c8102690 2024-09-15T23:09:40.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.218+0000 7f39beffd640 1 -- 172.21.15.112:0/707510651 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c0030d40 con 0x7f39c8102690 2024-09-15T23:09:40.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.218+0000 7f39cfd56640 1 -- 172.21.15.112:0/707510651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c81a22d0 con 0x7f39c8102690 2024-09-15T23:09:40.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.219+0000 7f39cfd56640 1 -- 172.21.15.112:0/707510651 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c8100ed0 con 0x7f39c8102690 2024-09-15T23:09:40.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.220+0000 7f39beffd640 1 -- 172.21.15.112:0/707510651 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f39c0004040 con 0x7f39c8102690 2024-09-15T23:09:40.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.221+0000 7f39beffd640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f39b40a3410 0x7f39b40a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:09:40.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.221+0000 7f39beffd640 1 -- 172.21.15.112:0/707510651 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4965+0+0 (secure 0 0 0) 0x7f39c00f04b0 con 0x7f39c8102690 2024-09-15T23:09:40.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.221+0000 7f39cdaf2640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f39b40a3410 0x7f39b40a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:09:40.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.222+0000 7f39cdaf2640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f39b40a3410 0x7f39b40a58d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f39c40058c0 tx=0x7f39c4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:09:40.252 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.225+0000 7f39beffd640 1 -- 172.21.15.112:0/707510651 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39c00bde40 con 0x7f39c8102690 2024-09-15T23:09:40.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:40 smithi002 ceph-mon[31019]: from='osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-15T23:09:40.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:40 smithi002 ceph-mon[31019]: osdmap e42: 7 total, 6 up, 7 in 2024-09-15T23:09:40.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:40.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:40.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:40.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:40.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:40.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:40.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:40.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:40.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:40.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:09:40.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:40.407 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:09:40.405+0000 7f39cfd56640 1 -- 172.21.15.112:0/707510651 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f39c80fe4b0 con 0x7f39b40a3410 2024-09-15T23:09:40.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:40 smithi145 ceph-mon[34901]: from='osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-15T23:09:40.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:40 smithi145 ceph-mon[34901]: osdmap e42: 7 total, 6 up, 7 in 2024-09-15T23:09:40.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:40.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:40.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:40.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:40.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:40.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:40.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:09:40.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:40.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:40.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:09:40.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:41.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:41 smithi112 ceph-mon[34367]: purged_snaps scrub starts 2024-09-15T23:09:41.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:41 smithi112 ceph-mon[34367]: purged_snaps scrub ok 2024-09-15T23:09:41.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:41 smithi112 ceph-mon[34367]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:41.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:41 smithi112 ceph-mon[34367]: Detected new or changed devices on smithi002 2024-09-15T23:09:41.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:41 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-15T23:09:41.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:41.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:41 smithi112 ceph-mon[34367]: osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197] boot 2024-09-15T23:09:41.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:41 smithi112 ceph-mon[34367]: osdmap e43: 7 total, 7 up, 7 in 2024-09-15T23:09:41.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:41.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:41 smithi112 ceph-mon[34367]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:09:41.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:09:41.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:09:41.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:41.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:41 smithi002 ceph-mon[31019]: purged_snaps scrub starts 2024-09-15T23:09:41.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:41 smithi002 ceph-mon[31019]: purged_snaps scrub ok 2024-09-15T23:09:41.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:41 smithi002 ceph-mon[31019]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:41.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:41 smithi002 ceph-mon[31019]: Detected new or changed devices on smithi002 2024-09-15T23:09:41.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:41 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-15T23:09:41.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:41.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:41 smithi002 ceph-mon[31019]: osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197] boot 2024-09-15T23:09:41.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:41 smithi002 ceph-mon[31019]: osdmap e43: 7 total, 7 up, 7 in 2024-09-15T23:09:41.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:41.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:41 smithi002 ceph-mon[31019]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:09:41.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:09:41.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:09:41.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:41.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:41 smithi145 ceph-mon[34901]: purged_snaps scrub starts 2024-09-15T23:09:41.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:41 smithi145 ceph-mon[34901]: purged_snaps scrub ok 2024-09-15T23:09:41.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:41 smithi145 ceph-mon[34901]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:09:41.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:41 smithi145 ceph-mon[34901]: Detected new or changed devices on smithi002 2024-09-15T23:09:41.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:41 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi002 to 5697M 2024-09-15T23:09:41.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:41.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:41 smithi145 ceph-mon[34901]: osd.6 [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197] boot 2024-09-15T23:09:41.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:41 smithi145 ceph-mon[34901]: osdmap e43: 7 total, 7 up, 7 in 2024-09-15T23:09:41.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:09:41.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:41 smithi145 ceph-mon[34901]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:09:41.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:09:41.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:09:41.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:42.166 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:42 smithi112 ceph-mon[34367]: osdmap e44: 7 total, 7 up, 7 in 2024-09-15T23:09:42.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:42 smithi145 ceph-mon[34901]: osdmap e44: 7 total, 7 up, 7 in 2024-09-15T23:09:42.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:42 smithi002 ceph-mon[31019]: osdmap e44: 7 total, 7 up, 7 in 2024-09-15T23:09:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:43 smithi145 ceph-mon[34901]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:43 smithi145 ceph-mon[34901]: from='client.? 172.21.15.112:0/2363725118' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d"}]: dispatch 2024-09-15T23:09:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:43 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d"}]: dispatch 2024-09-15T23:09:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:43 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d"}]': finished 2024-09-15T23:09:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:43 smithi145 ceph-mon[34901]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T23:09:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:43 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:09:43.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:43 smithi112 ceph-mon[34367]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:43.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:43 smithi112 ceph-mon[34367]: from='client.? 172.21.15.112:0/2363725118' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d"}]: dispatch 2024-09-15T23:09:43.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:43 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d"}]: dispatch 2024-09-15T23:09:43.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:43 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d"}]': finished 2024-09-15T23:09:43.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:43 smithi112 ceph-mon[34367]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T23:09:43.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:43 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:09:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:43 smithi002 ceph-mon[31019]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:43 smithi002 ceph-mon[31019]: from='client.? 172.21.15.112:0/2363725118' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d"}]: dispatch 2024-09-15T23:09:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:43 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d"}]: dispatch 2024-09-15T23:09:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:43 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d"}]': finished 2024-09-15T23:09:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:43 smithi002 ceph-mon[31019]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T23:09:43.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:43 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:09:44.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:44 smithi145 ceph-mon[34901]: from='client.? 172.21.15.112:0/1996512054' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:09:44.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:44 smithi112 ceph-mon[34367]: from='client.? 172.21.15.112:0/1996512054' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:09:44.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:44 smithi002 ceph-mon[31019]: from='client.? 172.21.15.112:0/1996512054' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:09:45.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:45 smithi145 ceph-mon[34901]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:45.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:45 smithi112 ceph-mon[34367]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:45.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:45 smithi002 ceph-mon[31019]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:47.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:47 smithi145 ceph-mon[34901]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:47.491 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:47 smithi112 ceph-mon[34367]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:47.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:47 smithi002 ceph-mon[31019]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:49.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:49 smithi112 ceph-mon[34367]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:49.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:49 smithi145 ceph-mon[34901]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:49.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:49 smithi002 ceph-mon[31019]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:51.335 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:51 smithi112 ceph-mon[34367]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:51.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:51 smithi145 ceph-mon[34901]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:51.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:51 smithi002 ceph-mon[31019]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:52.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:52 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T23:09:52.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:52 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:52.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:52 smithi145 ceph-mon[34901]: Deploying daemon osd.7 on smithi112 2024-09-15T23:09:52.470 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:52 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T23:09:52.470 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:52 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:52.470 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:52 smithi112 ceph-mon[34367]: Deploying daemon osd.7 on smithi112 2024-09-15T23:09:52.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T23:09:52.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:09:52.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:52 smithi002 ceph-mon[31019]: Deploying daemon osd.7 on smithi112 2024-09-15T23:09:53.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:53 smithi112 ceph-mon[34367]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:53.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:53 smithi145 ceph-mon[34901]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:53.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:53 smithi002 ceph-mon[31019]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:55.209 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:55 smithi112 ceph-mon[34367]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:55.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:55 smithi145 ceph-mon[34901]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:55.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:55 smithi002 ceph-mon[31019]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:57.352 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:57 smithi112 ceph-mon[34367]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:57.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:57 smithi145 ceph-mon[34901]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:57.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:57 smithi002 ceph-mon[31019]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:58.345 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:58.346 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:58.346 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:58.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:58.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:58.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:58.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:09:58.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:58.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:09:59.419 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:09:59 smithi112 ceph-mon[34367]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:59.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:09:59 smithi145 ceph-mon[34901]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:09:59.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:09:59 smithi002 ceph-mon[31019]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:10:00.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:00 smithi145 ceph-mon[34901]: overall HEALTH_OK 2024-09-15T23:10:00.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:00 smithi112 ceph-mon[34367]: overall HEALTH_OK 2024-09-15T23:10:00.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:00 smithi002 ceph-mon[31019]: overall HEALTH_OK 2024-09-15T23:10:01.353 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:01 smithi112 ceph-mon[34367]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:10:01.353 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:01.353 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:01.353 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:01.353 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:01.353 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:01.373 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:01 smithi145 ceph-mon[34901]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:10:01.373 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:01.373 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:01.373 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:01.374 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:01.374 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:01.393 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:01.391+0000 7f39beffd640 1 -- 172.21.15.112:0/707510651 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f39c80fe4b0 con 0x7f39b40a3410 2024-09-15T23:10:01.393 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 7 on host 'smithi112' 2024-09-15T23:10:01.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:01.393+0000 7f39cfd56640 1 -- 172.21.15.112:0/707510651 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f39b40a3410 msgr2=0x7f39b40a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:01.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:01.393+0000 7f39cfd56640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f39b40a3410 0x7f39b40a58d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f39c40058c0 tx=0x7f39c4005850 comp rx=0 tx=0).stop 2024-09-15T23:10:01.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:01.393+0000 7f39cfd56640 1 -- 172.21.15.112:0/707510651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102690 msgr2=0x7f39c81a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:01.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:01.393+0000 7f39cfd56640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102690 0x7f39c81a14c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009dc0 tx=0x7f39c0003ba0 comp rx=0 tx=0).stop 2024-09-15T23:10:01.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:01.394+0000 7f39cfd56640 1 -- 172.21.15.112:0/707510651 shutdown_connections 2024-09-15T23:10:01.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:01.394+0000 7f39cfd56640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f39b40a3410 0x7f39b40a58d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:01.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:01.394+0000 7f39cfd56640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39c8102690 0x7f39c81a14c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:01.395 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:01.394+0000 7f39cfd56640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39c8101cd0 0x7f39c819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:01.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:01.394+0000 7f39cfd56640 1 --2- 172.21.15.112:0/707510651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c8100ad0 0x7f39c8199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:01.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:01.394+0000 7f39cfd56640 1 -- 172.21.15.112:0/707510651 >> 172.21.15.112:0/707510651 conn(0x7f39c80fc280 msgr2=0x7f39c80fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:10:01.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:01.394+0000 7f39cfd56640 1 -- 172.21.15.112:0/707510651 shutdown_connections 2024-09-15T23:10:01.396 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:01.394+0000 7f39cfd56640 1 -- 172.21.15.112:0/707510651 wait complete. 2024-09-15T23:10:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:01 smithi002 ceph-mon[31019]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:10:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:01.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:01.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:01.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:01.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:02.084 DEBUG:teuthology.orchestra.run.smithi112:osd.7> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.7.service 2024-09-15T23:10:02.086 INFO:tasks.cephadm:Deploying osd.8 on smithi145 with /dev/vg_nvme/lv_2... 2024-09-15T23:10:02.087 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T23:10:02.341 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:10:02.372 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:02 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:02.372 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:02 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:02.372 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:02 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:02.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:02 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:02.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:02 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:02.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:02 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:02.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:02 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:02.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:02 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:02.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:02 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:03.615 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:03 smithi112 ceph-mon[34367]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:10:03.616 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:10:03 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:10:03.443+0000 7febf044d640 -1 osd.7 0 log_to_monitors true 2024-09-15T23:10:03.644 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:03 smithi145 ceph-mon[34901]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:10:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:03 smithi002 ceph-mon[31019]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:10:04.483 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:04 smithi145 ceph-mon[34901]: from='osd.7 [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T23:10:04.483 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:04 smithi145 ceph-mon[34901]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T23:10:04.672 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:04 smithi112 ceph-mon[34367]: from='osd.7 [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T23:10:04.673 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:04 smithi112 ceph-mon[34367]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T23:10:04.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:04 smithi002 ceph-mon[31019]: from='osd.7 [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T23:10:04.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:04 smithi002 ceph-mon[31019]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T23:10:05.128 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:10:05.155 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi145:vg_nvme/lv_2 2024-09-15T23:10:05.407 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:10:05.668 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:10:05.669 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T23:10:05.669 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: from='osd.7 [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:10:05.669 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T23:10:05.669 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:10:05.669 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:10:05.669 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:05.669 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:05.669 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:05.669 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:05.669 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:05.669 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:05.669 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:05.670 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:05.670 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:05 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:05.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: from='osd.7 [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:05.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:05.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:10:05.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T23:10:05.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: from='osd.7 [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:10:05.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T23:10:05.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:10:05.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:10:05.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:05.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:05.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:05.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:05.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:05.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:05.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:05.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:05.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:05 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:05.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.911+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/3970936431 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f81037c0 msgr2=0x7fc5f810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:05.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.911+0000 7fc5fd4a4640 1 --2- 172.21.15.145:0/3970936431 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f81037c0 0x7fc5f810a050 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009ca0 tx=0x7fc5f002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:10:05.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.911+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/3970936431 shutdown_connections 2024-09-15T23:10:05.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.911+0000 7fc5fd4a4640 1 --2- 172.21.15.145:0/3970936431 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f81037c0 0x7fc5f810a050 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:05.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.911+0000 7fc5fd4a4640 1 --2- 172.21.15.145:0/3970936431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f8102e00 0x7fc5f8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:05.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.911+0000 7fc5fd4a4640 1 --2- 172.21.15.145:0/3970936431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f8101c00 0x7fc5f8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:05.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.911+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/3970936431 >> 172.21.15.145:0/3970936431 conn(0x7fc5f80fd390 msgr2=0x7fc5f80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:10:05.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.911+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/3970936431 shutdown_connections 2024-09-15T23:10:05.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.911+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/3970936431 wait complete. 2024-09-15T23:10:05.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.911+0000 7fc5fd4a4640 1 Processor -- start 2024-09-15T23:10:05.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5fd4a4640 1 -- start start 2024-09-15T23:10:05.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5fd4a4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f8101c00 0x7fc5f8199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:10:05.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5fd4a4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f8102e00 0x7fc5f819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:10:05.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5fd4a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f81037c0 0x7fc5f81a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:10:05.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5fd4a4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f810d790 con 0x7fc5f81037c0 2024-09-15T23:10:05.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5fd4a4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f810d610 con 0x7fc5f8101c00 2024-09-15T23:10:05.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5fd4a4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f810d910 con 0x7fc5f8102e00 2024-09-15T23:10:05.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5f67fc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f8102e00 0x7fc5f819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:10:05.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5f67fc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f8102e00 0x7fc5f819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:50348/0 (socket says 172.21.15.145:50348) 2024-09-15T23:10:05.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5f67fc640 1 -- 172.21.15.145:0/2255054946 learned_addr learned my addr 172.21.15.145:0/2255054946 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-15T23:10:05.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5f6ffd640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f8101c00 0x7fc5f8199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:10:05.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5f77fe640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f81037c0 0x7fc5f81a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:10:05.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5f67fc640 1 -- 172.21.15.145:0/2255054946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f8101c00 msgr2=0x7fc5f8199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:05.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5f67fc640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f8101c00 0x7fc5f8199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:05.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5f67fc640 1 -- 172.21.15.145:0/2255054946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f81037c0 msgr2=0x7fc5f81a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:05.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5f67fc640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f81037c0 0x7fc5f81a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:05.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5f67fc640 1 -- 172.21.15.145:0/2255054946 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f81a1be0 con 0x7fc5f8102e00 2024-09-15T23:10:05.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.912+0000 7fc5f67fc640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f8102e00 0x7fc5f819a4f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00b4a0 tx=0x7fc5ec00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:10:05.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.913+0000 7fc5dffff640 1 -- 172.21.15.145:0/2255054946 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec014070 con 0x7fc5f8102e00 2024-09-15T23:10:05.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.913+0000 7fc5dffff640 1 -- 172.21.15.145:0/2255054946 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc5ec010ac0 con 0x7fc5f8102e00 2024-09-15T23:10:05.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.913+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/2255054946 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f81a1ed0 con 0x7fc5f8102e00 2024-09-15T23:10:05.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.913+0000 7fc5dffff640 1 -- 172.21.15.145:0/2255054946 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec017c30 con 0x7fc5f8102e00 2024-09-15T23:10:05.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.913+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/2255054946 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f81a2380 con 0x7fc5f8102e00 2024-09-15T23:10:05.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.914+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/2255054946 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f81a2610 con 0x7fc5f8102e00 2024-09-15T23:10:05.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.915+0000 7fc5dffff640 1 -- 172.21.15.145:0/2255054946 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc5ec017070 con 0x7fc5f8102e00 2024-09-15T23:10:05.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.915+0000 7fc5dffff640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc5e00a3270 0x7fc5e00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:10:05.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.916+0000 7fc5dffff640 1 -- 172.21.15.145:0/2255054946 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5117+0+0 (secure 0 0 0) 0x7fc5ec0ce050 con 0x7fc5f8102e00 2024-09-15T23:10:05.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.916+0000 7fc5f6ffd640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc5e00a3270 0x7fc5e00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:10:05.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.916+0000 7fc5f6ffd640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc5e00a3270 0x7fc5e00a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80058c0 tx=0x7fc5e8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:10:05.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:05.920+0000 7fc5dffff640 1 -- 172.21.15.145:0/2255054946 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5ec09b9f0 con 0x7fc5f8102e00 2024-09-15T23:10:06.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:06.094+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/2255054946 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc5f81a27e0 con 0x7fc5e00a3270 2024-09-15T23:10:06.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:10:05.811+0000 7febec3d0640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T23:10:06.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:10:05 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:10:05.821+0000 7febe41f0640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:10:06.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:06 smithi145 ceph-mon[34901]: Detected new or changed devices on smithi112 2024-09-15T23:10:06.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:06 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi112 to 5696M 2024-09-15T23:10:06.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:06 smithi145 ceph-mon[34901]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T23:10:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:06 smithi145 ceph-mon[34901]: osdmap e47: 8 total, 7 up, 8 in 2024-09-15T23:10:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:10:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:10:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:06 smithi145 ceph-mon[34901]: from='osd.7 ' entity='osd.7' 2024-09-15T23:10:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:10:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:10:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:06 smithi145 ceph-mon[34901]: osd.7 [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191] boot 2024-09-15T23:10:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:06 smithi145 ceph-mon[34901]: osdmap e48: 8 total, 8 up, 8 in 2024-09-15T23:10:06.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:06 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:10:06.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:06 smithi112 ceph-mon[34367]: Detected new or changed devices on smithi112 2024-09-15T23:10:06.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:06 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi112 to 5696M 2024-09-15T23:10:06.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:06 smithi112 ceph-mon[34367]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T23:10:06.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:06 smithi112 ceph-mon[34367]: osdmap e47: 8 total, 7 up, 8 in 2024-09-15T23:10:06.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:10:06.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:10:06.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:06 smithi112 ceph-mon[34367]: from='osd.7 ' entity='osd.7' 2024-09-15T23:10:06.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:10:06.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:10:06.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:06.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:06 smithi112 ceph-mon[34367]: osd.7 [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191] boot 2024-09-15T23:10:06.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:06 smithi112 ceph-mon[34367]: osdmap e48: 8 total, 8 up, 8 in 2024-09-15T23:10:06.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:06 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:10:06.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:06 smithi002 ceph-mon[31019]: Detected new or changed devices on smithi112 2024-09-15T23:10:06.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:06 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi112 to 5696M 2024-09-15T23:10:06.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:06 smithi002 ceph-mon[31019]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T23:10:06.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:06 smithi002 ceph-mon[31019]: osdmap e47: 8 total, 7 up, 8 in 2024-09-15T23:10:06.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:10:06.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:10:06.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:06 smithi002 ceph-mon[31019]: from='osd.7 ' entity='osd.7' 2024-09-15T23:10:06.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:10:06.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:10:06.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:06.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:06 smithi002 ceph-mon[31019]: osd.7 [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191] boot 2024-09-15T23:10:06.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:06 smithi002 ceph-mon[31019]: osdmap e48: 8 total, 8 up, 8 in 2024-09-15T23:10:06.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:06 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:10:07.518 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:07 smithi145 ceph-mon[34901]: purged_snaps scrub starts 2024-09-15T23:10:07.518 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:07 smithi145 ceph-mon[34901]: purged_snaps scrub ok 2024-09-15T23:10:07.518 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:07 smithi145 ceph-mon[34901]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:10:07.519 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:07 smithi145 ceph-mon[34901]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:10:07.519 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:07 smithi145 ceph-mon[34901]: osdmap e49: 8 total, 8 up, 8 in 2024-09-15T23:10:07.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:07 smithi112 ceph-mon[34367]: purged_snaps scrub starts 2024-09-15T23:10:07.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:07 smithi112 ceph-mon[34367]: purged_snaps scrub ok 2024-09-15T23:10:07.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:07 smithi112 ceph-mon[34367]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:10:07.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:07 smithi112 ceph-mon[34367]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:10:07.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:07 smithi112 ceph-mon[34367]: osdmap e49: 8 total, 8 up, 8 in 2024-09-15T23:10:07.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:07 smithi002 ceph-mon[31019]: purged_snaps scrub starts 2024-09-15T23:10:07.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:07 smithi002 ceph-mon[31019]: purged_snaps scrub ok 2024-09-15T23:10:07.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:07 smithi002 ceph-mon[31019]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:10:07.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:07 smithi002 ceph-mon[31019]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:10:07.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:07 smithi002 ceph-mon[31019]: osdmap e49: 8 total, 8 up, 8 in 2024-09-15T23:10:09.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:09 smithi145 ceph-mon[34901]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:09.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:09 smithi145 ceph-mon[34901]: osdmap e50: 8 total, 8 up, 8 in 2024-09-15T23:10:09.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:09 smithi145 ceph-mon[34901]: from='client.? 172.21.15.145:0/1149772997' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2733f9dd-3872-4bec-9c22-bcdb64828ae7"}]: dispatch 2024-09-15T23:10:09.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:09 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2733f9dd-3872-4bec-9c22-bcdb64828ae7"}]: dispatch 2024-09-15T23:10:09.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:09 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2733f9dd-3872-4bec-9c22-bcdb64828ae7"}]': finished 2024-09-15T23:10:09.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:09 smithi145 ceph-mon[34901]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T23:10:09.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:09 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:09.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:09 smithi145 ceph-mon[34901]: from='client.? 172.21.15.145:0/2988613203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:10:09.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:09 smithi112 ceph-mon[34367]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:09.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:09 smithi112 ceph-mon[34367]: osdmap e50: 8 total, 8 up, 8 in 2024-09-15T23:10:09.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:09 smithi112 ceph-mon[34367]: from='client.? 172.21.15.145:0/1149772997' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2733f9dd-3872-4bec-9c22-bcdb64828ae7"}]: dispatch 2024-09-15T23:10:09.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:09 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2733f9dd-3872-4bec-9c22-bcdb64828ae7"}]: dispatch 2024-09-15T23:10:09.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:09 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2733f9dd-3872-4bec-9c22-bcdb64828ae7"}]': finished 2024-09-15T23:10:09.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:09 smithi112 ceph-mon[34367]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T23:10:09.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:09 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:09.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:09 smithi112 ceph-mon[34367]: from='client.? 172.21.15.145:0/2988613203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:10:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:09 smithi002 ceph-mon[31019]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:09 smithi002 ceph-mon[31019]: osdmap e50: 8 total, 8 up, 8 in 2024-09-15T23:10:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:09 smithi002 ceph-mon[31019]: from='client.? 172.21.15.145:0/1149772997' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2733f9dd-3872-4bec-9c22-bcdb64828ae7"}]: dispatch 2024-09-15T23:10:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:09 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2733f9dd-3872-4bec-9c22-bcdb64828ae7"}]: dispatch 2024-09-15T23:10:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:09 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2733f9dd-3872-4bec-9c22-bcdb64828ae7"}]': finished 2024-09-15T23:10:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:09 smithi002 ceph-mon[31019]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T23:10:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:09 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:09.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:09 smithi002 ceph-mon[31019]: from='client.? 172.21.15.145:0/2988613203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:10:10.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:10 smithi002 ceph-mon[31019]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:10 smithi002 ceph-mon[31019]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T23:10:10.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:10 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:10.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:10 smithi145 ceph-mon[34901]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:10.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:10 smithi145 ceph-mon[34901]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T23:10:10.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:10 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:10.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:10 smithi112 ceph-mon[34367]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:10.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:10 smithi112 ceph-mon[34367]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T23:10:10.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:10 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:12.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:12 smithi002 ceph-mon[31019]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:12.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:12 smithi145 ceph-mon[34901]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:12.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:12 smithi112 ceph-mon[34367]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:14.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:14 smithi145 ceph-mon[34901]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:14.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:14 smithi002 ceph-mon[31019]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:14.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:14 smithi112 ceph-mon[34367]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:16.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:16 smithi002 ceph-mon[31019]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:16.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:16 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T23:10:16.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:16 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:16.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:16 smithi002 ceph-mon[31019]: Deploying daemon osd.8 on smithi145 2024-09-15T23:10:16.853 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:16 smithi145 ceph-mon[34901]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:16.853 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:16 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T23:10:16.853 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:16 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:16.854 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:16 smithi145 ceph-mon[34901]: Deploying daemon osd.8 on smithi145 2024-09-15T23:10:16.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:16 smithi112 ceph-mon[34367]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:16.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:16 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T23:10:16.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:16 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:16.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:16 smithi112 ceph-mon[34367]: Deploying daemon osd.8 on smithi145 2024-09-15T23:10:18.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:18 smithi002 ceph-mon[31019]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:18.831 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:18 smithi145 ceph-mon[34901]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:18.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:18 smithi112 ceph-mon[34367]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:20.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:20 smithi002 ceph-mon[31019]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:20.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:20 smithi145 ceph-mon[34901]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:20.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:20 smithi112 ceph-mon[34367]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:22.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:22 smithi145 ceph-mon[34901]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:22.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:22 smithi002 ceph-mon[31019]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:22.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:22 smithi112 ceph-mon[34367]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:23.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:23.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:23.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:23.811 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:23.811 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:23.811 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:23.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:23.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:23.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:24.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:24 smithi145 ceph-mon[34901]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:24.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:24 smithi112 ceph-mon[34367]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:25.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:24 smithi002 ceph-mon[31019]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:26.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:26.511+0000 7fc5dffff640 1 -- 172.21.15.145:0/2255054946 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc5f81a27e0 con 0x7fc5e00a3270 2024-09-15T23:10:26.512 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 8 on host 'smithi145' 2024-09-15T23:10:26.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:26.513+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/2255054946 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc5e00a3270 msgr2=0x7fc5e00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:26.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:26.513+0000 7fc5fd4a4640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc5e00a3270 0x7fc5e00a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80058c0 tx=0x7fc5e8005850 comp rx=0 tx=0).stop 2024-09-15T23:10:26.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:26.513+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/2255054946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f8102e00 msgr2=0x7fc5f819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:26.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:26.513+0000 7fc5fd4a4640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f8102e00 0x7fc5f819a4f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00b4a0 tx=0x7fc5ec00b960 comp rx=0 tx=0).stop 2024-09-15T23:10:26.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:26.513+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/2255054946 shutdown_connections 2024-09-15T23:10:26.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:26.513+0000 7fc5fd4a4640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc5e00a3270 0x7fc5e00a5730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:26.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:26.513+0000 7fc5fd4a4640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5f81037c0 0x7fc5f81a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:26.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:26.513+0000 7fc5fd4a4640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5f8102e00 0x7fc5f819a4f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:26.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:26.513+0000 7fc5fd4a4640 1 --2- 172.21.15.145:0/2255054946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5f8101c00 0x7fc5f8199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:26.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:26.513+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/2255054946 >> 172.21.15.145:0/2255054946 conn(0x7fc5f80fd390 msgr2=0x7fc5f8074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:10:26.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:26.513+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/2255054946 shutdown_connections 2024-09-15T23:10:26.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:10:26.513+0000 7fc5fd4a4640 1 -- 172.21.15.145:0/2255054946 wait complete. 2024-09-15T23:10:26.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:26 smithi112 ceph-mon[34367]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:26.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:26.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:26.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:26.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:26.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:26.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:26 smithi002 ceph-mon[31019]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:26.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:26.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:26.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:26.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:26.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:26.841 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:26 smithi145 ceph-mon[34901]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:26.841 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:26.841 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:26.841 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:26.841 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:26.841 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:27.169 DEBUG:teuthology.orchestra.run.smithi145:osd.8> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.8.service 2024-09-15T23:10:27.172 INFO:tasks.cephadm:Deploying osd.9 on smithi002 with /dev/vg_nvme/lv_1... 2024-09-15T23:10:27.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T23:10:27.439 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:10:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:27 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:27 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:27 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:27.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:27 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:27.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:27 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:27.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:27 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:27.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:27 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:27 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:27 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:28.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:28 smithi145 ceph-mon[34901]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:28.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:28 smithi145 ceph-mon[34901]: from='osd.8 [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T23:10:28.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:28 smithi145 ceph-mon[34901]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T23:10:28.708 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:10:28 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:10:28.363+0000 7fcfddc4a640 -1 osd.8 0 log_to_monitors true 2024-09-15T23:10:28.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:28 smithi002 ceph-mon[31019]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:28.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:28 smithi002 ceph-mon[31019]: from='osd.8 [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T23:10:28.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:28 smithi002 ceph-mon[31019]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T23:10:28.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:28 smithi112 ceph-mon[34367]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:28.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:28 smithi112 ceph-mon[34367]: from='osd.8 [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T23:10:28.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:28 smithi112 ceph-mon[34367]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T23:10:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:29 smithi145 ceph-mon[34901]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T23:10:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:29 smithi145 ceph-mon[34901]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T23:10:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:29 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:29 smithi145 ceph-mon[34901]: from='osd.8 [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:10:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:29 smithi145 ceph-mon[34901]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:10:29.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:29 smithi002 ceph-mon[31019]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T23:10:29.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:29 smithi002 ceph-mon[31019]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T23:10:29.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:29 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:29.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:29 smithi002 ceph-mon[31019]: from='osd.8 [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:10:29.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:29 smithi002 ceph-mon[31019]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:10:29.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:29 smithi112 ceph-mon[34367]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T23:10:29.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:29 smithi112 ceph-mon[34367]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T23:10:29.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:29 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:29.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:29 smithi112 ceph-mon[34367]: from='osd.8 [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:10:29.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:29 smithi112 ceph-mon[34367]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:10:30.158 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:10:29 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:10:29.951+0000 7fcfd9bcd640 -1 osd.8 0 waiting for initial osdmap 2024-09-15T23:10:30.158 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:10:29 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:10:29.961+0000 7fcfd19ed640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:10:30.406 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:10:30.433 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_1 2024-09-15T23:10:30.693 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:10:30.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:30.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-15T23:10:30.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: osdmap e54: 9 total, 8 up, 9 in 2024-09-15T23:10:30.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:30.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:30.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='osd.8 ' entity='osd.8' 2024-09-15T23:10:30.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: osd.8 [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540] boot 2024-09-15T23:10:30.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: osdmap e55: 9 total, 9 up, 9 in 2024-09-15T23:10:30.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:30.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: Detected new or changed devices on smithi145 2024-09-15T23:10:30.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:30.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:30.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:30.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:30.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:30.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi145 to 5696M 2024-09-15T23:10:30.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:30.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:30.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:30.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:30.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:30.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: osdmap e54: 9 total, 8 up, 9 in 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='osd.8 ' entity='osd.8' 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: osd.8 [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540] boot 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: osdmap e55: 9 total, 9 up, 9 in 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: Detected new or changed devices on smithi145 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:30.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi145 to 5696M 2024-09-15T23:10:30.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:30.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:30.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:30.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:30.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:10:30.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-15T23:10:30.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: osdmap e54: 9 total, 8 up, 9 in 2024-09-15T23:10:30.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:30.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:30.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='osd.8 ' entity='osd.8' 2024-09-15T23:10:30.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: osd.8 [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540] boot 2024-09-15T23:10:30.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: osdmap e55: 9 total, 9 up, 9 in 2024-09-15T23:10:30.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:10:30.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: Detected new or changed devices on smithi145 2024-09-15T23:10:30.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:30.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:30.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:30.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:30.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:30.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi145 to 5696M 2024-09-15T23:10:30.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:30.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:30.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:30.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:31.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.300+0000 7fe870d04640 1 -- 172.21.15.2:0/3837652637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe86c1026d0 msgr2=0x7fe86c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:31.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.300+0000 7fe870d04640 1 --2- 172.21.15.2:0/3837652637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe86c1026d0 0x7fe86c108f60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe864009ca0 tx=0x7fe86402a8c0 comp rx=0 tx=0).stop 2024-09-15T23:10:31.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.300+0000 7fe870d04640 1 -- 172.21.15.2:0/3837652637 shutdown_connections 2024-09-15T23:10:31.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.300+0000 7fe870d04640 1 --2- 172.21.15.2:0/3837652637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe86c1026d0 0x7fe86c108f60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:31.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.300+0000 7fe870d04640 1 --2- 172.21.15.2:0/3837652637 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe86c101d10 0x7fe86c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.300+0000 7fe870d04640 1 --2- 172.21.15.2:0/3837652637 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c100b10 0x7fe86c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.300+0000 7fe870d04640 1 -- 172.21.15.2:0/3837652637 >> 172.21.15.2:0/3837652637 conn(0x7fe86c0fc2a0 msgr2=0x7fe86c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:10:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.300+0000 7fe870d04640 1 -- 172.21.15.2:0/3837652637 shutdown_connections 2024-09-15T23:10:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.300+0000 7fe870d04640 1 -- 172.21.15.2:0/3837652637 wait complete. 2024-09-15T23:10:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.301+0000 7fe870d04640 1 Processor -- start 2024-09-15T23:10:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.301+0000 7fe870d04640 1 -- start start 2024-09-15T23:10:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.301+0000 7fe870d04640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe86c100b10 0x7fe86c196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:10:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.301+0000 7fe870d04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe86c101d10 0x7fe86c197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:10:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.301+0000 7fe870d04640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c1026d0 0x7fe86c19e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:10:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.301+0000 7fe870d04640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c10c690 con 0x7fe86c101d10 2024-09-15T23:10:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.301+0000 7fe870d04640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c10c510 con 0x7fe86c1026d0 2024-09-15T23:10:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.301+0000 7fe870d04640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c10c810 con 0x7fe86c100b10 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe869d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe86c101d10 0x7fe86c197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe869d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe86c101d10 0x7fe86c197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58096/0 (socket says 172.21.15.2:58096) 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe869d9b640 1 -- 172.21.15.2:0/1484418956 learned_addr learned my addr 172.21.15.2:0/1484418956 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe86ad9d640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c1026d0 0x7fe86c19e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe86a59c640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe86c100b10 0x7fe86c196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe869d9b640 1 -- 172.21.15.2:0/1484418956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe86c100b10 msgr2=0x7fe86c196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe869d9b640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe86c100b10 0x7fe86c196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe869d9b640 1 -- 172.21.15.2:0/1484418956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c1026d0 msgr2=0x7fe86c19e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe869d9b640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c1026d0 0x7fe86c19e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe869d9b640 1 -- 172.21.15.2:0/1484418956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c19e950 con 0x7fe86c101d10 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe86a59c640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe86c100b10 0x7fe86c196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe86ad9d640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c1026d0 0x7fe86c19e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe869d9b640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe86c101d10 0x7fe86c197270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe86000c970 tx=0x7fe86000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:10:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe85b7fe640 1 -- 172.21.15.2:0/1484418956 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860007bb0 con 0x7fe86c101d10 2024-09-15T23:10:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe870d04640 1 -- 172.21.15.2:0/1484418956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86c19ec40 con 0x7fe86c101d10 2024-09-15T23:10:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe85b7fe640 1 -- 172.21.15.2:0/1484418956 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe860007d50 con 0x7fe86c101d10 2024-09-15T23:10:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe85b7fe640 1 -- 172.21.15.2:0/1484418956 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86000f450 con 0x7fe86c101d10 2024-09-15T23:10:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.302+0000 7fe870d04640 1 -- 172.21.15.2:0/1484418956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe86c19f180 con 0x7fe86c101d10 2024-09-15T23:10:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.303+0000 7fe870d04640 1 -- 172.21.15.2:0/1484418956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86c107f60 con 0x7fe86c101d10 2024-09-15T23:10:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.305+0000 7fe85b7fe640 1 -- 172.21.15.2:0/1484418956 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe860004f00 con 0x7fe86c101d10 2024-09-15T23:10:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.305+0000 7fe85b7fe640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe8540a3240 0x7fe8540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:10:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.305+0000 7fe86a59c640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe8540a3240 0x7fe8540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:10:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.305+0000 7fe85b7fe640 1 -- 172.21.15.2:0/1484418956 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5858+0+0 (secure 0 0 0) 0x7fe8600cf180 con 0x7fe86c101d10 2024-09-15T23:10:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.306+0000 7fe86a59c640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe8540a3240 0x7fe8540a5700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe85c005fd0 tx=0x7fe85c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:10:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.308+0000 7fe85b7fe640 1 -- 172.21.15.2:0/1484418956 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe860014030 con 0x7fe86c101d10 2024-09-15T23:10:31.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:31.492+0000 7fe870d04640 1 -- 172.21.15.2:0/1484418956 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe86c062630 con 0x7fe8540a3240 2024-09-15T23:10:32.163 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:31 smithi002 ceph-mon[31019]: purged_snaps scrub starts 2024-09-15T23:10:32.163 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:31 smithi002 ceph-mon[31019]: purged_snaps scrub ok 2024-09-15T23:10:32.163 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:31 smithi002 ceph-mon[31019]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T23:10:32.163 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:31 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:10:32.163 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:31 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:10:32.163 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:31 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:32.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:31 smithi112 ceph-mon[34367]: purged_snaps scrub starts 2024-09-15T23:10:32.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:31 smithi112 ceph-mon[34367]: purged_snaps scrub ok 2024-09-15T23:10:32.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:31 smithi112 ceph-mon[34367]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T23:10:32.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:31 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:10:32.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:31 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:10:32.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:31 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:32.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:31 smithi145 ceph-mon[34901]: purged_snaps scrub starts 2024-09-15T23:10:32.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:31 smithi145 ceph-mon[34901]: purged_snaps scrub ok 2024-09-15T23:10:32.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:31 smithi145 ceph-mon[34901]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T23:10:32.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:31 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:10:32.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:31 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:10:32.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:31 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:33.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:32 smithi112 ceph-mon[34367]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:33.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:32 smithi112 ceph-mon[34367]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:10:33.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:32 smithi112 ceph-mon[34367]: osdmap e57: 9 total, 9 up, 9 in 2024-09-15T23:10:33.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:32 smithi002 ceph-mon[31019]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:33.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:32 smithi002 ceph-mon[31019]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:10:33.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:32 smithi002 ceph-mon[31019]: osdmap e57: 9 total, 9 up, 9 in 2024-09-15T23:10:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:32 smithi145 ceph-mon[34901]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:32 smithi145 ceph-mon[34901]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:10:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:32 smithi145 ceph-mon[34901]: osdmap e57: 9 total, 9 up, 9 in 2024-09-15T23:10:34.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:33 smithi112 ceph-mon[34367]: osdmap e58: 9 total, 9 up, 9 in 2024-09-15T23:10:34.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:33 smithi002 ceph-mon[31019]: osdmap e58: 9 total, 9 up, 9 in 2024-09-15T23:10:34.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:33 smithi145 ceph-mon[34901]: osdmap e58: 9 total, 9 up, 9 in 2024-09-15T23:10:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:34 smithi112 ceph-mon[34367]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:35.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:34 smithi112 ceph-mon[34367]: osdmap e59: 9 total, 9 up, 9 in 2024-09-15T23:10:35.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:34 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2104648127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd1f4a4a-547c-43a9-859a-75b37b06905f"}]: dispatch 2024-09-15T23:10:35.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:34 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2104648127' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd1f4a4a-547c-43a9-859a-75b37b06905f"}]': finished 2024-09-15T23:10:35.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:34 smithi112 ceph-mon[34367]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T23:10:35.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:34 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:35.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:34 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/307412637' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:10:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:34 smithi002 ceph-mon[31019]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:34 smithi002 ceph-mon[31019]: osdmap e59: 9 total, 9 up, 9 in 2024-09-15T23:10:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:34 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2104648127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd1f4a4a-547c-43a9-859a-75b37b06905f"}]: dispatch 2024-09-15T23:10:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:34 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2104648127' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd1f4a4a-547c-43a9-859a-75b37b06905f"}]': finished 2024-09-15T23:10:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:34 smithi002 ceph-mon[31019]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T23:10:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:34 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:35.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:34 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/307412637' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:10:35.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:34 smithi145 ceph-mon[34901]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:35.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:34 smithi145 ceph-mon[34901]: osdmap e59: 9 total, 9 up, 9 in 2024-09-15T23:10:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:34 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2104648127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd1f4a4a-547c-43a9-859a-75b37b06905f"}]: dispatch 2024-09-15T23:10:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:34 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2104648127' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd1f4a4a-547c-43a9-859a-75b37b06905f"}]': finished 2024-09-15T23:10:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:34 smithi145 ceph-mon[34901]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T23:10:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:34 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:35.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:34 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/307412637' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:10:37.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:36 smithi112 ceph-mon[34367]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:37.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:36 smithi002 ceph-mon[31019]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:37.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:36 smithi145 ceph-mon[34901]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:39.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:38 smithi002 ceph-mon[31019]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-15T23:10:39.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:38 smithi145 ceph-mon[34901]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-15T23:10:39.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:38 smithi112 ceph-mon[34367]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-15T23:10:41.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:41 smithi002 ceph-mon[31019]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-15T23:10:41.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:41 smithi145 ceph-mon[34901]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-15T23:10:41.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:41 smithi112 ceph-mon[34367]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-15T23:10:43.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:43 smithi002 ceph-mon[31019]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T23:10:43.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:43 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T23:10:43.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:43 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:43 smithi145 ceph-mon[34901]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T23:10:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:43 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T23:10:43.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:43 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:43.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:43 smithi112 ceph-mon[34367]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T23:10:43.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:43 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T23:10:43.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:43 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:44.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:44 smithi002 ceph-mon[31019]: Deploying daemon osd.9 on smithi002 2024-09-15T23:10:44.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:44 smithi145 ceph-mon[34901]: Deploying daemon osd.9 on smithi002 2024-09-15T23:10:44.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:44 smithi112 ceph-mon[34367]: Deploying daemon osd.9 on smithi002 2024-09-15T23:10:45.265 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:45 smithi002 ceph-mon[31019]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-15T23:10:45.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:45 smithi145 ceph-mon[34901]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-15T23:10:45.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:45 smithi112 ceph-mon[34367]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-15T23:10:47.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:47 smithi002 ceph-mon[31019]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-15T23:10:47.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:47 smithi145 ceph-mon[34901]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-15T23:10:47.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:47 smithi112 ceph-mon[34367]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-15T23:10:49.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:49 smithi002 ceph-mon[31019]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:10:49.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:49.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:49.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:49.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:49 smithi145 ceph-mon[34901]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:10:49.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:49.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:49.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:49.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:49 smithi112 ceph-mon[34367]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:10:49.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:49.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:49.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:51.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:51 smithi002 ceph-mon[31019]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:51.272 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:51 smithi145 ceph-mon[34901]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:51.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:51 smithi112 ceph-mon[34367]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:52.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:52.782+0000 7fe85b7fe640 1 -- 172.21.15.2:0/1484418956 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe86c062630 con 0x7fe8540a3240 2024-09-15T23:10:52.784 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 9 on host 'smithi002' 2024-09-15T23:10:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:52.785+0000 7fe870d04640 1 -- 172.21.15.2:0/1484418956 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe8540a3240 msgr2=0x7fe8540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:52.785+0000 7fe870d04640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe8540a3240 0x7fe8540a5700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe85c005fd0 tx=0x7fe85c005850 comp rx=0 tx=0).stop 2024-09-15T23:10:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:52.785+0000 7fe870d04640 1 -- 172.21.15.2:0/1484418956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe86c101d10 msgr2=0x7fe86c197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:52.785+0000 7fe870d04640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe86c101d10 0x7fe86c197270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe86000c970 tx=0x7fe86000ce30 comp rx=0 tx=0).stop 2024-09-15T23:10:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:52.785+0000 7fe870d04640 1 -- 172.21.15.2:0/1484418956 shutdown_connections 2024-09-15T23:10:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:52.785+0000 7fe870d04640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe8540a3240 0x7fe8540a5700 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:52.785+0000 7fe870d04640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe86c1026d0 0x7fe86c19e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:52.785+0000 7fe870d04640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe86c101d10 0x7fe86c197270 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:52.785+0000 7fe870d04640 1 --2- 172.21.15.2:0/1484418956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe86c100b10 0x7fe86c196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:52.785+0000 7fe870d04640 1 -- 172.21.15.2:0/1484418956 >> 172.21.15.2:0/1484418956 conn(0x7fe86c0fc2a0 msgr2=0x7fe86c105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:10:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:52.785+0000 7fe870d04640 1 -- 172.21.15.2:0/1484418956 shutdown_connections 2024-09-15T23:10:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:10:52.785+0000 7fe870d04640 1 -- 172.21.15.2:0/1484418956 wait complete. 2024-09-15T23:10:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:52 smithi002 ceph-mon[31019]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:53.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:52 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:52 smithi145 ceph-mon[34901]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:53.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:52 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:52 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:52 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:53.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:52 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:53.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:52 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:52 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:53.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:52 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:52 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:52 smithi112 ceph-mon[34367]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:53.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:52 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:52 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:52 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:53.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:52 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:53.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:52 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:52 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:10:53.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:52 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:52 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:53.494 DEBUG:teuthology.orchestra.run.smithi002:osd.9> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.9.service 2024-09-15T23:10:53.497 INFO:tasks.cephadm:Deploying osd.10 on smithi112 with /dev/vg_nvme/lv_1... 2024-09-15T23:10:53.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T23:10:53.750 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:10:55.197 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:54 smithi112 ceph-mon[34367]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:55.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:54 smithi145 ceph-mon[34901]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:55.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:54 smithi002 ceph-mon[31019]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:55.259 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:10:54 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:10:54.958+0000 7f513fc0d640 -1 osd.9 0 log_to_monitors true 2024-09-15T23:10:56.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:55 smithi002 ceph-mon[31019]: from='osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T23:10:56.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:55 smithi145 ceph-mon[34901]: from='osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T23:10:56.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:55 smithi112 ceph-mon[34367]: from='osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T23:10:56.341 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-15T23:10:56.369 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_1 2024-09-15T23:10:56.633 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:10:57.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.116+0000 7f165ffb1640 1 -- 172.21.15.112:0/3648245616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1658101730 msgr2=0x7f1658101be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:57.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.116+0000 7f165ffb1640 1 --2- 172.21.15.112:0/3648245616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1658101730 0x7f1658101be0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1650009ca0 tx=0x7f165002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:10:57.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.116+0000 7f165ffb1640 1 -- 172.21.15.112:0/3648245616 shutdown_connections 2024-09-15T23:10:57.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.116+0000 7f165ffb1640 1 --2- 172.21.15.112:0/3648245616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1658101730 0x7f1658101be0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:57.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.116+0000 7f165ffb1640 1 --2- 172.21.15.112:0/3648245616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1658100d90 0x7f16581011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:57.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.116+0000 7f165ffb1640 1 --2- 172.21.15.112:0/3648245616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1658100450 0x7f1658100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:57.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.116+0000 7f165ffb1640 1 -- 172.21.15.112:0/3648245616 >> 172.21.15.112:0/3648245616 conn(0x7f16580fc280 msgr2=0x7f16580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:10:57.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.116+0000 7f165ffb1640 1 -- 172.21.15.112:0/3648245616 shutdown_connections 2024-09-15T23:10:57.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.116+0000 7f165ffb1640 1 -- 172.21.15.112:0/3648245616 wait complete. 2024-09-15T23:10:57.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.117+0000 7f165ffb1640 1 Processor -- start 2024-09-15T23:10:57.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.117+0000 7f165ffb1640 1 -- start start 2024-09-15T23:10:57.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.117+0000 7f165ffb1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1658100450 0x7f1658199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:10:57.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.117+0000 7f165ffb1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1658100d90 0x7f165819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:10:57.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.117+0000 7f165ffb1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1658101730 0x7f16581a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:10:57.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.117+0000 7f165ffb1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f165810f8f0 con 0x7f1658100450 2024-09-15T23:10:57.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.117+0000 7f165ffb1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f165810f770 con 0x7f1658101730 2024-09-15T23:10:57.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.117+0000 7f165ffb1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f165810fa70 con 0x7f1658100d90 2024-09-15T23:10:57.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.117+0000 7f165e54e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1658101730 0x7f16581a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:10:57.135 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.117+0000 7f165e54e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1658101730 0x7f16581a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:45684/0 (socket says 172.21.15.112:45684) 2024-09-15T23:10:57.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.117+0000 7f165e54e640 1 -- 172.21.15.112:0/170628088 learned_addr learned my addr 172.21.15.112:0/170628088 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-15T23:10:57.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.117+0000 7f165d54c640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1658100d90 0x7f165819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:10:57.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f165dd4d640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1658100450 0x7f1658199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:10:57.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f165e54e640 1 -- 172.21.15.112:0/170628088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1658100d90 msgr2=0x7f165819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:57.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f165e54e640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1658100d90 0x7f165819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:57.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f165e54e640 1 -- 172.21.15.112:0/170628088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1658100450 msgr2=0x7f1658199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:10:57.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f165e54e640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1658100450 0x7f1658199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:10:57.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f165e54e640 1 -- 172.21.15.112:0/170628088 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16581a1be0 con 0x7f1658101730 2024-09-15T23:10:57.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f165dd4d640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1658100450 0x7f1658199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:10:57.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f165d54c640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1658100d90 0x7f165819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:10:57.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f165e54e640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1658101730 0x7f16581a1570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1650009dc0 tx=0x7f1650003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:10:57.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f164effd640 1 -- 172.21.15.112:0/170628088 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1650032ec0 con 0x7f1658101730 2024-09-15T23:10:57.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f165ffb1640 1 -- 172.21.15.112:0/170628088 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16581a1e70 con 0x7f1658101730 2024-09-15T23:10:57.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f164effd640 1 -- 172.21.15.112:0/170628088 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16500044f0 con 0x7f1658101730 2024-09-15T23:10:57.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f164effd640 1 -- 172.21.15.112:0/170628088 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1650030d40 con 0x7f1658101730 2024-09-15T23:10:57.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.118+0000 7f165ffb1640 1 -- 172.21.15.112:0/170628088 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16581a2320 con 0x7f1658101730 2024-09-15T23:10:57.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.119+0000 7f165ffb1640 1 -- 172.21.15.112:0/170628088 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f165810b1a0 con 0x7f1658101730 2024-09-15T23:10:57.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.120+0000 7f164effd640 1 -- 172.21.15.112:0/170628088 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1650004040 con 0x7f1658101730 2024-09-15T23:10:57.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.121+0000 7f164effd640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f16440a3410 0x7f16440a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:10:57.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.121+0000 7f164effd640 1 -- 172.21.15.112:0/170628088 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5981+0+0 (secure 0 0 0) 0x7f16500f07e0 con 0x7f1658101730 2024-09-15T23:10:57.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.121+0000 7f165dd4d640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f16440a3410 0x7f16440a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:10:57.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.122+0000 7f165dd4d640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f16440a3410 0x7f16440a58d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1654009b40 tx=0x7f1654005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:10:57.137 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.128+0000 7f164effd640 1 -- 172.21.15.112:0/170628088 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16500bde20 con 0x7f1658101730 2024-09-15T23:10:57.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:57.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: from='osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T23:10:57.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: osdmap e61: 10 total, 9 up, 10 in 2024-09-15T23:10:57.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: from='osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-15T23:10:57.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:57.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:57.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:57.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:57.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:57.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:57.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:57.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:57.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:57.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:57.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:56 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:57.308 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:10:56.971+0000 7f513bb90640 -1 osd.9 0 waiting for initial osdmap 2024-09-15T23:10:57.308 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:10:56.983+0000 7f51379b8640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:10:57.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:57.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: from='osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T23:10:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: osdmap e61: 10 total, 9 up, 10 in 2024-09-15T23:10:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: from='osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-15T23:10:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:57.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:56 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:57.311 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:10:57.309+0000 7f165ffb1640 1 -- 172.21.15.112:0/170628088 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1658062630 con 0x7f16440a3410 2024-09-15T23:10:57.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: from='osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: osdmap e61: 10 total, 9 up, 10 in 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: from='osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:10:57.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:56 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:10:58.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:57 smithi112 ceph-mon[34367]: purged_snaps scrub starts 2024-09-15T23:10:58.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:57 smithi112 ceph-mon[34367]: purged_snaps scrub ok 2024-09-15T23:10:58.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:57 smithi112 ceph-mon[34367]: Detected new or changed devices on smithi002 2024-09-15T23:10:58.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:57 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-15T23:10:58.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:57 smithi112 ceph-mon[34367]: from='osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-15T23:10:58.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:57 smithi112 ceph-mon[34367]: osdmap e62: 10 total, 9 up, 10 in 2024-09-15T23:10:58.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:57 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:58.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:57 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:58.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:57 smithi112 ceph-mon[34367]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:10:58.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:57 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:10:58.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:57 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:10:58.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:57 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:58.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:57 smithi002 ceph-mon[31019]: purged_snaps scrub starts 2024-09-15T23:10:58.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:57 smithi002 ceph-mon[31019]: purged_snaps scrub ok 2024-09-15T23:10:58.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:57 smithi002 ceph-mon[31019]: Detected new or changed devices on smithi002 2024-09-15T23:10:58.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:57 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-15T23:10:58.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:57 smithi002 ceph-mon[31019]: from='osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-15T23:10:58.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:57 smithi002 ceph-mon[31019]: osdmap e62: 10 total, 9 up, 10 in 2024-09-15T23:10:58.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:57 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:58.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:57 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:58.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:57 smithi002 ceph-mon[31019]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:10:58.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:57 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:10:58.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:57 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:10:58.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:57 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:58.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:57 smithi145 ceph-mon[34901]: purged_snaps scrub starts 2024-09-15T23:10:58.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:57 smithi145 ceph-mon[34901]: purged_snaps scrub ok 2024-09-15T23:10:58.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:57 smithi145 ceph-mon[34901]: Detected new or changed devices on smithi002 2024-09-15T23:10:58.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:57 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi002 to 4273M 2024-09-15T23:10:58.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:57 smithi145 ceph-mon[34901]: from='osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-15T23:10:58.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:57 smithi145 ceph-mon[34901]: osdmap e62: 10 total, 9 up, 10 in 2024-09-15T23:10:58.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:57 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:58.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:57 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:58.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:57 smithi145 ceph-mon[34901]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:10:58.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:57 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:10:58.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:57 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:10:58.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:57 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:10:59.073 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:58 smithi112 ceph-mon[34367]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:59.073 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:58 smithi112 ceph-mon[34367]: osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702] boot 2024-09-15T23:10:59.073 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:58 smithi112 ceph-mon[34367]: osdmap e63: 10 total, 10 up, 10 in 2024-09-15T23:10:59.073 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:58 smithi002 ceph-mon[31019]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:58 smithi002 ceph-mon[31019]: osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702] boot 2024-09-15T23:10:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:58 smithi002 ceph-mon[31019]: osdmap e63: 10 total, 10 up, 10 in 2024-09-15T23:10:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:10:59.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:58 smithi145 ceph-mon[34901]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:10:59.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:58 smithi145 ceph-mon[34901]: osd.9 [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702] boot 2024-09-15T23:10:59.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:58 smithi145 ceph-mon[34901]: osdmap e63: 10 total, 10 up, 10 in 2024-09-15T23:10:59.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:11:00.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:59 smithi112 ceph-mon[34367]: osdmap e64: 10 total, 10 up, 10 in 2024-09-15T23:11:00.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:59 smithi112 ceph-mon[34367]: from='client.? 172.21.15.112:0/3448211628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8b895e8-39f5-4753-9343-03f96da12246"}]: dispatch 2024-09-15T23:11:00.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:59 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8b895e8-39f5-4753-9343-03f96da12246"}]: dispatch 2024-09-15T23:11:00.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:59 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8b895e8-39f5-4753-9343-03f96da12246"}]': finished 2024-09-15T23:11:00.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:59 smithi112 ceph-mon[34367]: osdmap e65: 11 total, 10 up, 11 in 2024-09-15T23:11:00.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:10:59 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:00.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:59 smithi002 ceph-mon[31019]: osdmap e64: 10 total, 10 up, 10 in 2024-09-15T23:11:00.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:59 smithi002 ceph-mon[31019]: from='client.? 172.21.15.112:0/3448211628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8b895e8-39f5-4753-9343-03f96da12246"}]: dispatch 2024-09-15T23:11:00.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:59 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8b895e8-39f5-4753-9343-03f96da12246"}]: dispatch 2024-09-15T23:11:00.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:59 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8b895e8-39f5-4753-9343-03f96da12246"}]': finished 2024-09-15T23:11:00.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:59 smithi002 ceph-mon[31019]: osdmap e65: 11 total, 10 up, 11 in 2024-09-15T23:11:00.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:10:59 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:00.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:59 smithi145 ceph-mon[34901]: osdmap e64: 10 total, 10 up, 10 in 2024-09-15T23:11:00.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:59 smithi145 ceph-mon[34901]: from='client.? 172.21.15.112:0/3448211628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8b895e8-39f5-4753-9343-03f96da12246"}]: dispatch 2024-09-15T23:11:00.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:59 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f8b895e8-39f5-4753-9343-03f96da12246"}]: dispatch 2024-09-15T23:11:00.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:59 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f8b895e8-39f5-4753-9343-03f96da12246"}]': finished 2024-09-15T23:11:00.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:59 smithi145 ceph-mon[34901]: osdmap e65: 11 total, 10 up, 11 in 2024-09-15T23:11:00.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:10:59 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:01.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:00 smithi112 ceph-mon[34367]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:01.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:00 smithi112 ceph-mon[34367]: from='client.? 172.21.15.112:0/3615331389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:11:01.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:00 smithi002 ceph-mon[31019]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:01.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:00 smithi002 ceph-mon[31019]: from='client.? 172.21.15.112:0/3615331389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:11:01.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:00 smithi145 ceph-mon[34901]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:01.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:00 smithi145 ceph-mon[34901]: from='client.? 172.21.15.112:0/3615331389' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:11:03.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:02 smithi112 ceph-mon[34367]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:03.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:02 smithi002 ceph-mon[31019]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:03.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:02 smithi145 ceph-mon[34901]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:05.176 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:04 smithi112 ceph-mon[34367]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:05.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:04 smithi002 ceph-mon[31019]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:05.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:04 smithi145 ceph-mon[34901]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:07.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:06 smithi002 ceph-mon[31019]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:07.333 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:07 smithi112 ceph-mon[34367]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:07.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:07 smithi145 ceph-mon[34901]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:09.039 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:09 smithi112 ceph-mon[34367]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:09.039 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:09 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T23:11:09.039 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:09 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:09.039 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:09 smithi112 ceph-mon[34367]: Deploying daemon osd.10 on smithi112 2024-09-15T23:11:09.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:09 smithi002 ceph-mon[31019]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:09.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:09 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T23:11:09.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:09 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:09.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:09 smithi002 ceph-mon[31019]: Deploying daemon osd.10 on smithi112 2024-09-15T23:11:09.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:09 smithi145 ceph-mon[34901]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:09.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:09 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T23:11:09.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:09 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:09.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:09 smithi145 ceph-mon[34901]: Deploying daemon osd.10 on smithi112 2024-09-15T23:11:11.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:11 smithi112 ceph-mon[34367]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:11.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:11 smithi002 ceph-mon[31019]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:11.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:11 smithi145 ceph-mon[34901]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:13.199 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:13 smithi112 ceph-mon[34367]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:13.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:13 smithi002 ceph-mon[31019]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:13.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:13 smithi145 ceph-mon[34901]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:15.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:15 smithi002 ceph-mon[31019]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:15.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:15 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:15.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:15 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:15.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:15 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:15.369 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:15 smithi112 ceph-mon[34367]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:15.369 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:15 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:15.370 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:15 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:15.370 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:15 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:15.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:15 smithi145 ceph-mon[34901]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:15.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:15 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:15.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:15 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:15.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:15 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:17.174 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:17 smithi112 ceph-mon[34367]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:17.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:17 smithi002 ceph-mon[31019]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:17.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:17 smithi145 ceph-mon[34901]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:18.228 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:11:18.224+0000 7f164effd640 1 -- 172.21.15.112:0/170628088 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f1658062630 con 0x7f16440a3410 2024-09-15T23:11:18.229 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 10 on host 'smithi112' 2024-09-15T23:11:18.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:11:18.226+0000 7f165ffb1640 1 -- 172.21.15.112:0/170628088 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f16440a3410 msgr2=0x7f16440a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:18.229 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:11:18.226+0000 7f165ffb1640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f16440a3410 0x7f16440a58d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1654009b40 tx=0x7f1654005e50 comp rx=0 tx=0).stop 2024-09-15T23:11:18.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:11:18.226+0000 7f165ffb1640 1 -- 172.21.15.112:0/170628088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1658101730 msgr2=0x7f16581a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:18.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:11:18.226+0000 7f165ffb1640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1658101730 0x7f16581a1570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1650009dc0 tx=0x7f1650003ba0 comp rx=0 tx=0).stop 2024-09-15T23:11:18.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:11:18.226+0000 7f165ffb1640 1 -- 172.21.15.112:0/170628088 shutdown_connections 2024-09-15T23:11:18.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:11:18.226+0000 7f165ffb1640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f16440a3410 0x7f16440a58d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:18.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:11:18.226+0000 7f165ffb1640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1658101730 0x7f16581a1570 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:18.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:11:18.226+0000 7f165ffb1640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1658100d90 0x7f165819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:18.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:11:18.226+0000 7f165ffb1640 1 --2- 172.21.15.112:0/170628088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1658100450 0x7f1658199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:18.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:11:18.226+0000 7f165ffb1640 1 -- 172.21.15.112:0/170628088 >> 172.21.15.112:0/170628088 conn(0x7f16580fc280 msgr2=0x7f16580fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:18.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:11:18.227+0000 7f165ffb1640 1 -- 172.21.15.112:0/170628088 shutdown_connections 2024-09-15T23:11:18.230 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-15T23:11:18.227+0000 7f165ffb1640 1 -- 172.21.15.112:0/170628088 wait complete. 2024-09-15T23:11:18.959 DEBUG:teuthology.orchestra.run.smithi112:osd.10> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.10.service 2024-09-15T23:11:18.962 INFO:tasks.cephadm:Deploying osd.11 on smithi145 with /dev/vg_nvme/lv_1... 2024-09-15T23:11:18.962 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T23:11:19.215 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:11:19.336 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:19 smithi145 ceph-mon[34901]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:19.337 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:19.337 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:19.337 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:19.337 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:19 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:19.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:19 smithi112 ceph-mon[34367]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:19.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:19 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:19.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:19 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:19.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:19 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:19.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:19 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:19.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:19 smithi002 ceph-mon[31019]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:19.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:19.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:19.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:19.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:19 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:20.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:11:20 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:11:20.626+0000 7f0d6877b640 -1 osd.10 0 log_to_monitors true 2024-09-15T23:11:21.296 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:21 smithi112 ceph-mon[34367]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:21.296 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:21 smithi112 ceph-mon[34367]: from='osd.10 [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T23:11:21.296 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:21 smithi112 ceph-mon[34367]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T23:11:21.338 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:21 smithi145 ceph-mon[34901]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:21.338 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:21 smithi145 ceph-mon[34901]: from='osd.10 [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T23:11:21.338 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:21 smithi145 ceph-mon[34901]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T23:11:21.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:21 smithi002 ceph-mon[31019]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:21.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:21 smithi002 ceph-mon[31019]: from='osd.10 [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T23:11:21.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:21 smithi002 ceph-mon[31019]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T23:11:22.167 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-15T23:11:22.193 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi145:vg_nvme/lv_1 2024-09-15T23:11:22.453 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:11:22.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:22 smithi145 ceph-mon[34901]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T23:11:22.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:22 smithi145 ceph-mon[34901]: from='osd.10 [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:11:22.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:22 smithi145 ceph-mon[34901]: osdmap e66: 11 total, 10 up, 11 in 2024-09-15T23:11:22.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:22 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:22.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:22 smithi145 ceph-mon[34901]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:11:22.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:22 smithi145 ceph-mon[34901]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T23:11:22.496 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:11:22 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:11:22.229+0000 7f0d646fe640 -1 osd.10 0 waiting for initial osdmap 2024-09-15T23:11:22.497 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:11:22 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:11:22.243+0000 7f0d60526640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:11:22.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:22 smithi112 ceph-mon[34367]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T23:11:22.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:22 smithi112 ceph-mon[34367]: from='osd.10 [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:11:22.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:22 smithi112 ceph-mon[34367]: osdmap e66: 11 total, 10 up, 11 in 2024-09-15T23:11:22.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:22 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:22.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:22 smithi112 ceph-mon[34367]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:11:22.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:22 smithi112 ceph-mon[34367]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T23:11:22.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:22 smithi002 ceph-mon[31019]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T23:11:22.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:22 smithi002 ceph-mon[31019]: from='osd.10 [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:11:22.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:22 smithi002 ceph-mon[31019]: osdmap e66: 11 total, 10 up, 11 in 2024-09-15T23:11:22.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:22 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:22.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:22 smithi002 ceph-mon[31019]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]: dispatch 2024-09-15T23:11:22.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:22 smithi002 ceph-mon[31019]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-15T23:11:22.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.928+0000 7f3fec84f640 1 -- 172.21.15.145:0/18228414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fe8100ad0 msgr2=0x7f3fe8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:22.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.928+0000 7f3fec84f640 1 --2- 172.21.15.145:0/18228414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fe8100ad0 0x7f3fe8100ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009900 tx=0x7f3fd002a410 comp rx=0 tx=0).stop 2024-09-15T23:11:22.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.928+0000 7f3fec84f640 1 -- 172.21.15.145:0/18228414 shutdown_connections 2024-09-15T23:11:22.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.928+0000 7f3fec84f640 1 --2- 172.21.15.145:0/18228414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe8102690 0x7f3fe8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:22.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.928+0000 7f3fec84f640 1 --2- 172.21.15.145:0/18228414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe8101cd0 0x7f3fe8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:22.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.928+0000 7f3fec84f640 1 --2- 172.21.15.145:0/18228414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fe8100ad0 0x7f3fe8100ed0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:22.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.928+0000 7f3fec84f640 1 -- 172.21.15.145:0/18228414 >> 172.21.15.145:0/18228414 conn(0x7f3fe80fc280 msgr2=0x7f3fe80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:22.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.928+0000 7f3fec84f640 1 -- 172.21.15.145:0/18228414 shutdown_connections 2024-09-15T23:11:22.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.928+0000 7f3fec84f640 1 -- 172.21.15.145:0/18228414 wait complete. 2024-09-15T23:11:22.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fec84f640 1 Processor -- start 2024-09-15T23:11:22.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fec84f640 1 -- start start 2024-09-15T23:11:22.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fec84f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe8100ad0 0x7f3fe8197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:22.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fec84f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fe8101cd0 0x7f3fe81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:22.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fec84f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe8102690 0x7f3fe819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:22.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fec84f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe810d770 con 0x7f3fe8102690 2024-09-15T23:11:22.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fec84f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe810d5f0 con 0x7f3fe8100ad0 2024-09-15T23:11:22.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fec84f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe810d8f0 con 0x7f3fe8101cd0 2024-09-15T23:11:22.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fe5d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fe8101cd0 0x7f3fe81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:22.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fe5d9b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fe8101cd0 0x7f3fe81983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:36534/0 (socket says 172.21.15.145:36534) 2024-09-15T23:11:22.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fe5d9b640 1 -- 172.21.15.145:0/2362108585 learned_addr learned my addr 172.21.15.145:0/2362108585 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-15T23:11:22.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fe6d9d640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe8102690 0x7f3fe819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fe659c640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe8100ad0 0x7f3fe8197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fe5d9b640 1 -- 172.21.15.145:0/2362108585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe8100ad0 msgr2=0x7f3fe8197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fe5d9b640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe8100ad0 0x7f3fe8197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fe5d9b640 1 -- 172.21.15.145:0/2362108585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe8102690 msgr2=0x7f3fe819f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fe5d9b640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe8102690 0x7f3fe819f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fe5d9b640 1 -- 172.21.15.145:0/2362108585 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe819fae0 con 0x7f3fe8101cd0 2024-09-15T23:11:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.929+0000 7f3fe659c640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe8100ad0 0x7f3fe8197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:11:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.930+0000 7f3fe5d9b640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fe8101cd0 0x7f3fe81983f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800b4a0 tx=0x7f3fd800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.930+0000 7f3fdf7fe640 1 -- 172.21.15.145:0/2362108585 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8014070 con 0x7f3fe8101cd0 2024-09-15T23:11:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.930+0000 7f3fec84f640 1 -- 172.21.15.145:0/2362108585 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe819fdd0 con 0x7f3fe8101cd0 2024-09-15T23:11:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.930+0000 7f3fdf7fe640 1 -- 172.21.15.145:0/2362108585 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3fd8010ac0 con 0x7f3fe8101cd0 2024-09-15T23:11:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.930+0000 7f3fdf7fe640 1 -- 172.21.15.145:0/2362108585 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8017c30 con 0x7f3fe8101cd0 2024-09-15T23:11:22.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.930+0000 7f3fec84f640 1 -- 172.21.15.145:0/2362108585 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe81a0300 con 0x7f3fe8101cd0 2024-09-15T23:11:22.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.931+0000 7f3fec84f640 1 -- 172.21.15.145:0/2362108585 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe8107f60 con 0x7f3fe8101cd0 2024-09-15T23:11:22.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.932+0000 7f3fdf7fe640 1 -- 172.21.15.145:0/2362108585 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f3fd8017070 con 0x7f3fe8101cd0 2024-09-15T23:11:22.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.933+0000 7f3fdf7fe640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3fd40a3270 0x7f3fd40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:22.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.933+0000 7f3fdf7fe640 1 -- 172.21.15.145:0/2362108585 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6414+0+0 (secure 0 0 0) 0x7f3fd80ce980 con 0x7f3fe8101cd0 2024-09-15T23:11:22.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.933+0000 7f3fe659c640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3fd40a3270 0x7f3fd40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:22.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.933+0000 7f3fe659c640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3fd40a3270 0x7f3fd40a5730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0006010 tx=0x7f3fd0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:22.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:22.936+0000 7f3fdf7fe640 1 -- 172.21.15.145:0/2362108585 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fd809be10 con 0x7f3fe8101cd0 2024-09-15T23:11:23.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:23.112+0000 7f3fec84f640 1 -- 172.21.15.145:0/2362108585 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3fe8062630 con 0x7f3fd40a3270 2024-09-15T23:11:23.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: osdmap e67: 11 total, 10 up, 11 in 2024-09-15T23:11:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:23.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:23.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:23.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:23.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:23.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:11:23.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:11:23.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:23.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: osd.10 [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908] boot 2024-09-15T23:11:23.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: osdmap e68: 11 total, 11 up, 11 in 2024-09-15T23:11:23.459 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:23 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: osdmap e67: 11 total, 10 up, 11 in 2024-09-15T23:11:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: osd.10 [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908] boot 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: osdmap e68: 11 total, 11 up, 11 in 2024-09-15T23:11:23.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:23 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:23.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:11:23.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: osdmap e67: 11 total, 10 up, 11 in 2024-09-15T23:11:23.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:23.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:23.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.560 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:23.560 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:23.560 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:23.560 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:23.560 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:23.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:23.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:23.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:23.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:23.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:23.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:11:23.562 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:11:23.562 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:23.562 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: osd.10 [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908] boot 2024-09-15T23:11:23.562 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: osdmap e68: 11 total, 11 up, 11 in 2024-09-15T23:11:23.562 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:23 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:11:24.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:24 smithi112 ceph-mon[34367]: purged_snaps scrub starts 2024-09-15T23:11:24.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:24 smithi112 ceph-mon[34367]: purged_snaps scrub ok 2024-09-15T23:11:24.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:24 smithi112 ceph-mon[34367]: Detected new or changed devices on smithi112 2024-09-15T23:11:24.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:24 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi112 to 4272M 2024-09-15T23:11:24.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:24 smithi112 ceph-mon[34367]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:11:24.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:24 smithi002 ceph-mon[31019]: purged_snaps scrub starts 2024-09-15T23:11:24.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:24 smithi002 ceph-mon[31019]: purged_snaps scrub ok 2024-09-15T23:11:24.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:24 smithi002 ceph-mon[31019]: Detected new or changed devices on smithi112 2024-09-15T23:11:24.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:24 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi112 to 4272M 2024-09-15T23:11:24.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:24 smithi002 ceph-mon[31019]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:11:24.701 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:24 smithi145 ceph-mon[34901]: purged_snaps scrub starts 2024-09-15T23:11:24.701 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:24 smithi145 ceph-mon[34901]: purged_snaps scrub ok 2024-09-15T23:11:24.701 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:24 smithi145 ceph-mon[34901]: Detected new or changed devices on smithi112 2024-09-15T23:11:24.701 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:24 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi112 to 4272M 2024-09-15T23:11:24.701 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:24 smithi145 ceph-mon[34901]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:11:25.264 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:25 smithi145 ceph-mon[34901]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:25.264 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:25 smithi145 ceph-mon[34901]: osdmap e69: 11 total, 11 up, 11 in 2024-09-15T23:11:25.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:25 smithi002 ceph-mon[31019]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:25.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:25 smithi002 ceph-mon[31019]: osdmap e69: 11 total, 11 up, 11 in 2024-09-15T23:11:25.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:25 smithi112 ceph-mon[34367]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:25.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:25 smithi112 ceph-mon[34367]: osdmap e69: 11 total, 11 up, 11 in 2024-09-15T23:11:26.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:26 smithi002 ceph-mon[31019]: osdmap e70: 11 total, 11 up, 11 in 2024-09-15T23:11:26.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:26 smithi002 ceph-mon[31019]: from='client.? 172.21.15.145:0/2246752943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc018bfc-bc13-4ef2-a712-5cd406a56cba"}]: dispatch 2024-09-15T23:11:26.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:26 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc018bfc-bc13-4ef2-a712-5cd406a56cba"}]: dispatch 2024-09-15T23:11:26.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:26 smithi002 ceph-mon[31019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc018bfc-bc13-4ef2-a712-5cd406a56cba"}]': finished 2024-09-15T23:11:26.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:26 smithi002 ceph-mon[31019]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T23:11:26.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:26 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:26.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:26 smithi145 ceph-mon[34901]: osdmap e70: 11 total, 11 up, 11 in 2024-09-15T23:11:26.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:26 smithi145 ceph-mon[34901]: from='client.? 172.21.15.145:0/2246752943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc018bfc-bc13-4ef2-a712-5cd406a56cba"}]: dispatch 2024-09-15T23:11:26.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:26 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc018bfc-bc13-4ef2-a712-5cd406a56cba"}]: dispatch 2024-09-15T23:11:26.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:26 smithi145 ceph-mon[34901]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc018bfc-bc13-4ef2-a712-5cd406a56cba"}]': finished 2024-09-15T23:11:26.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:26 smithi145 ceph-mon[34901]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T23:11:26.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:26 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:26.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:26 smithi112 ceph-mon[34367]: osdmap e70: 11 total, 11 up, 11 in 2024-09-15T23:11:26.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:26 smithi112 ceph-mon[34367]: from='client.? 172.21.15.145:0/2246752943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc018bfc-bc13-4ef2-a712-5cd406a56cba"}]: dispatch 2024-09-15T23:11:26.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:26 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc018bfc-bc13-4ef2-a712-5cd406a56cba"}]: dispatch 2024-09-15T23:11:26.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:26 smithi112 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc018bfc-bc13-4ef2-a712-5cd406a56cba"}]': finished 2024-09-15T23:11:26.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:26 smithi112 ceph-mon[34367]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T23:11:26.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:26 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:27 smithi002 ceph-mon[31019]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:27 smithi002 ceph-mon[31019]: from='client.? 172.21.15.145:0/3224855669' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:11:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:27 smithi002 ceph-mon[31019]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T23:11:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:27 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:27.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:27 smithi145 ceph-mon[34901]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:27.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:27 smithi145 ceph-mon[34901]: from='client.? 172.21.15.145:0/3224855669' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:11:27.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:27 smithi145 ceph-mon[34901]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T23:11:27.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:27 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:27 smithi112 ceph-mon[34367]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:27 smithi112 ceph-mon[34367]: from='client.? 172.21.15.145:0/3224855669' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:11:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:27 smithi112 ceph-mon[34367]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T23:11:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:27 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:29 smithi002 ceph-mon[31019]: pgmap v235: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T23:11:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:29 smithi145 ceph-mon[34901]: pgmap v235: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T23:11:29.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:29 smithi112 ceph-mon[34367]: pgmap v235: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T23:11:31.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:31 smithi002 ceph-mon[31019]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-15T23:11:31.678 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:31 smithi145 ceph-mon[34901]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-15T23:11:31.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:31 smithi112 ceph-mon[34367]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-15T23:11:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:33 smithi145 ceph-mon[34901]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-15T23:11:33.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:33 smithi002 ceph-mon[31019]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-15T23:11:33.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:33 smithi112 ceph-mon[34367]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-15T23:11:35.431 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:35 smithi145 ceph-mon[34901]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T23:11:35.431 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T23:11:35.431 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:35.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:35 smithi112 ceph-mon[34367]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T23:11:35.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T23:11:35.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:35 smithi002 ceph-mon[31019]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T23:11:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T23:11:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:36.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:36 smithi145 ceph-mon[34901]: Deploying daemon osd.11 on smithi145 2024-09-15T23:11:36.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:36 smithi002 ceph-mon[31019]: Deploying daemon osd.11 on smithi145 2024-09-15T23:11:36.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:36 smithi112 ceph-mon[34367]: Deploying daemon osd.11 on smithi145 2024-09-15T23:11:37.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:37 smithi002 ceph-mon[31019]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-15T23:11:37.685 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:37 smithi145 ceph-mon[34901]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-15T23:11:37.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:37 smithi112 ceph-mon[34367]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-15T23:11:39.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:39 smithi002 ceph-mon[31019]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:39.580 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:39 smithi145 ceph-mon[34901]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:39.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:39 smithi112 ceph-mon[34367]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:41.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:41 smithi002 ceph-mon[31019]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:41.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:41.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:41.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:41.586 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:41 smithi145 ceph-mon[34901]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:41.586 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:41.586 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:41.586 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:41.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:41 smithi112 ceph-mon[34367]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:41.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:41.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:41.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:43.322 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:43 smithi145 ceph-mon[34901]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:43 smithi002 ceph-mon[31019]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:43.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:43 smithi112 ceph-mon[34367]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:44.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:44.621+0000 7f3fdf7fe640 1 -- 172.21.15.145:0/2362108585 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3fe8062630 con 0x7f3fd40a3270 2024-09-15T23:11:44.623 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 11 on host 'smithi145' 2024-09-15T23:11:44.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:44.624+0000 7f3fec84f640 1 -- 172.21.15.145:0/2362108585 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3fd40a3270 msgr2=0x7f3fd40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:44.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:44.624+0000 7f3fec84f640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3fd40a3270 0x7f3fd40a5730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0006010 tx=0x7f3fd0000bc0 comp rx=0 tx=0).stop 2024-09-15T23:11:44.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:44.624+0000 7f3fec84f640 1 -- 172.21.15.145:0/2362108585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fe8101cd0 msgr2=0x7f3fe81983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:44.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:44.624+0000 7f3fec84f640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fe8101cd0 0x7f3fe81983f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800b4a0 tx=0x7f3fd800b960 comp rx=0 tx=0).stop 2024-09-15T23:11:44.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:44.624+0000 7f3fec84f640 1 -- 172.21.15.145:0/2362108585 shutdown_connections 2024-09-15T23:11:44.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:44.624+0000 7f3fec84f640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3fd40a3270 0x7f3fd40a5730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:44.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:44.624+0000 7f3fec84f640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fe8102690 0x7f3fe819f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:44.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:44.624+0000 7f3fec84f640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3fe8101cd0 0x7f3fe81983f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:44.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:44.624+0000 7f3fec84f640 1 --2- 172.21.15.145:0/2362108585 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe8100ad0 0x7f3fe8197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:44.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:44.624+0000 7f3fec84f640 1 -- 172.21.15.145:0/2362108585 >> 172.21.15.145:0/2362108585 conn(0x7f3fe80fc280 msgr2=0x7f3fe8105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:44.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:44.624+0000 7f3fec84f640 1 -- 172.21.15.145:0/2362108585 shutdown_connections 2024-09-15T23:11:44.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:44.624+0000 7f3fec84f640 1 -- 172.21.15.145:0/2362108585 wait complete. 2024-09-15T23:11:45.353 DEBUG:teuthology.orchestra.run.smithi145:osd.11> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.11.service 2024-09-15T23:11:45.356 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-15T23:11:45.356 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T23:11:45.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:45 smithi002 ceph-mon[31019]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:45.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:45 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:45.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:45 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:45.625 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:11:45.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:45 smithi145 ceph-mon[34901]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:45.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:45 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:45.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:45 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:45.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:45 smithi112 ceph-mon[34367]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:45.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:45 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:45.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:45 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.127+0000 7fdf4e54a640 1 -- 172.21.15.2:0/2290462577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf481026a0 msgr2=0x7fdf48104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.127+0000 7fdf4e54a640 1 --2- 172.21.15.2:0/2290462577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf481026a0 0x7fdf48104a90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009900 tx=0x7fdf3802a410 comp rx=0 tx=0).stop 2024-09-15T23:11:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.128+0000 7fdf4e54a640 1 -- 172.21.15.2:0/2290462577 shutdown_connections 2024-09-15T23:11:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.128+0000 7fdf4e54a640 1 --2- 172.21.15.2:0/2290462577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf48107900 0x7fdf48109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.128+0000 7fdf4e54a640 1 --2- 172.21.15.2:0/2290462577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf48104fd0 0x7fdf481073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.128+0000 7fdf4e54a640 1 --2- 172.21.15.2:0/2290462577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf481026a0 0x7fdf48104a90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.128+0000 7fdf4e54a640 1 -- 172.21.15.2:0/2290462577 >> 172.21.15.2:0/2290462577 conn(0x7fdf480fc2a0 msgr2=0x7fdf480fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.128+0000 7fdf4e54a640 1 -- 172.21.15.2:0/2290462577 shutdown_connections 2024-09-15T23:11:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.128+0000 7fdf4e54a640 1 -- 172.21.15.2:0/2290462577 wait complete. 2024-09-15T23:11:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.128+0000 7fdf4e54a640 1 Processor -- start 2024-09-15T23:11:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.128+0000 7fdf4e54a640 1 -- start start 2024-09-15T23:11:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf4e54a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf481026a0 0x7fdf48197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf4e54a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf48104fd0 0x7fdf48198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf4e54a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf48107900 0x7fdf4819f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf4e54a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4810d7d0 con 0x7fdf481026a0 2024-09-15T23:11:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf4e54a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4810d650 con 0x7fdf48107900 2024-09-15T23:11:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf4e54a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4810d950 con 0x7fdf48104fd0 2024-09-15T23:11:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf481026a0 0x7fdf48197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf481026a0 0x7fdf48197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54754/0 (socket says 172.21.15.2:54754) 2024-09-15T23:11:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf47fff640 1 -- 172.21.15.2:0/291351846 learned_addr learned my addr 172.21.15.2:0/291351846 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:11:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf477fe640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf48104fd0 0x7fdf48198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf4cae7640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf48107900 0x7fdf4819f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf47fff640 1 -- 172.21.15.2:0/291351846 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf48104fd0 msgr2=0x7fdf48198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf47fff640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf48104fd0 0x7fdf48198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf47fff640 1 -- 172.21.15.2:0/291351846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf48107900 msgr2=0x7fdf4819f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf47fff640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf48107900 0x7fdf4819f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf47fff640 1 -- 172.21.15.2:0/291351846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4819fa60 con 0x7fdf481026a0 2024-09-15T23:11:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf477fe640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf48104fd0 0x7fdf48198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:11:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf47fff640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf481026a0 0x7fdf48197e30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf38005940 tx=0x7fdf38004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf457fa640 1 -- 172.21.15.2:0/291351846 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3803f030 con 0x7fdf481026a0 2024-09-15T23:11:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf457fa640 1 -- 172.21.15.2:0/291351846 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdf38003cb0 con 0x7fdf481026a0 2024-09-15T23:11:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.129+0000 7fdf4e54a640 1 -- 172.21.15.2:0/291351846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4819fcf0 con 0x7fdf481026a0 2024-09-15T23:11:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.130+0000 7fdf457fa640 1 -- 172.21.15.2:0/291351846 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38035070 con 0x7fdf481026a0 2024-09-15T23:11:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.130+0000 7fdf4e54a640 1 -- 172.21.15.2:0/291351846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf481a01f0 con 0x7fdf481026a0 2024-09-15T23:11:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.131+0000 7fdf4e54a640 1 -- 172.21.15.2:0/291351846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf480fdd90 con 0x7fdf481026a0 2024-09-15T23:11:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.132+0000 7fdf457fa640 1 -- 172.21.15.2:0/291351846 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fdf38042030 con 0x7fdf481026a0 2024-09-15T23:11:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.132+0000 7fdf457fa640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fdf300a32f0 0x7fdf300a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.132+0000 7fdf477fe640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fdf300a32f0 0x7fdf300a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.132+0000 7fdf457fa640 1 -- 172.21.15.2:0/291351846 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7fdf380efa60 con 0x7fdf481026a0 2024-09-15T23:11:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.133+0000 7fdf477fe640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fdf300a32f0 0x7fdf300a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdf48199350 tx=0x7fdf3c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.137+0000 7fdf457fa640 1 -- 172.21.15.2:0/291351846 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdf380bcd60 con 0x7fdf481026a0 2024-09-15T23:11:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.311+0000 7fdf4e54a640 1 -- 172.21.15.2:0/291351846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fdf48062e90 con 0x7fdf481026a0 2024-09-15T23:11:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.311+0000 7fdf457fa640 1 -- 172.21.15.2:0/291351846 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fdf380bc660 con 0x7fdf481026a0 2024-09-15T23:11:46.313 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:11:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.313+0000 7fdf4e54a640 1 -- 172.21.15.2:0/291351846 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fdf300a32f0 msgr2=0x7fdf300a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.313+0000 7fdf4e54a640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fdf300a32f0 0x7fdf300a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdf48199350 tx=0x7fdf3c00a5c0 comp rx=0 tx=0).stop 2024-09-15T23:11:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.313+0000 7fdf4e54a640 1 -- 172.21.15.2:0/291351846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf481026a0 msgr2=0x7fdf48197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.313+0000 7fdf4e54a640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf481026a0 0x7fdf48197e30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf38005940 tx=0x7fdf38004430 comp rx=0 tx=0).stop 2024-09-15T23:11:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.313+0000 7fdf4e54a640 1 -- 172.21.15.2:0/291351846 shutdown_connections 2024-09-15T23:11:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.313+0000 7fdf4e54a640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fdf300a32f0 0x7fdf300a57b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.313+0000 7fdf4e54a640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf48107900 0x7fdf4819f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.313+0000 7fdf4e54a640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf48104fd0 0x7fdf48198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.313+0000 7fdf4e54a640 1 --2- 172.21.15.2:0/291351846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf481026a0 0x7fdf48197e30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.313+0000 7fdf4e54a640 1 -- 172.21.15.2:0/291351846 >> 172.21.15.2:0/291351846 conn(0x7fdf480fc2a0 msgr2=0x7fdf48103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.314+0000 7fdf4e54a640 1 -- 172.21.15.2:0/291351846 shutdown_connections 2024-09-15T23:11:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:46.314+0000 7fdf4e54a640 1 -- 172.21.15.2:0/291351846 wait complete. 2024-09-15T23:11:46.780 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:46 smithi002 ceph-mon[31019]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:46.780 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:46 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:46.780 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:46 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:46.780 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:46 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/291351846' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:11:46.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:46 smithi145 ceph-mon[34901]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:46.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:46 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:46.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:46 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:46.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:46 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/291351846' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:11:46.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:46 smithi112 ceph-mon[34367]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:46.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:46 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:46.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:46 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:46.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:46 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/291351846' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:11:47.142 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726441883,"num_in_osds":12,"osd_in_since":1726441885,"num_remapped_pgs":0} 2024-09-15T23:11:47.520 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:11:47 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:11:47.264+0000 7f9a9119e640 -1 osd.11 0 log_to_monitors true 2024-09-15T23:11:47.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:47 smithi145 ceph-mon[34901]: from='osd.11 [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T23:11:47.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:47 smithi145 ceph-mon[34901]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T23:11:47.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:47 smithi112 ceph-mon[34367]: from='osd.11 [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T23:11:47.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:47 smithi112 ceph-mon[34367]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T23:11:48.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:47 smithi002 ceph-mon[31019]: from='osd.11 [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T23:11:48.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:47 smithi002 ceph-mon[31019]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T23:11:48.144 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T23:11:48.411 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:11:48.707 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:11:48 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:11:48.568+0000 7f9a8d121640 -1 osd.11 0 waiting for initial osdmap 2024-09-15T23:11:48.707 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:11:48 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:11:48.579+0000 7f9a88f49640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:11:48.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:48 smithi145 ceph-mon[34901]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:48.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:48 smithi145 ceph-mon[34901]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T23:11:48.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:48 smithi145 ceph-mon[34901]: osdmap e73: 12 total, 11 up, 12 in 2024-09-15T23:11:48.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:48 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:48.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:48 smithi145 ceph-mon[34901]: from='osd.11 [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:11:48.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:48 smithi145 ceph-mon[34901]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:11:48.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:48 smithi002 ceph-mon[31019]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:48.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:48 smithi002 ceph-mon[31019]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T23:11:48.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:48 smithi002 ceph-mon[31019]: osdmap e73: 12 total, 11 up, 12 in 2024-09-15T23:11:48.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:48 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:48.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:48 smithi002 ceph-mon[31019]: from='osd.11 [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:11:48.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:48 smithi002 ceph-mon[31019]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:11:48.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.910+0000 7fa365798640 1 -- 172.21.15.2:0/490378265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3601004b0 msgr2=0x7fa3601008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.910+0000 7fa365798640 1 --2- 172.21.15.2:0/490378265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3601004b0 0x7fa3601008b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa350009900 tx=0x7fa35002a410 comp rx=0 tx=0).stop 2024-09-15T23:11:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.910+0000 7fa365798640 1 -- 172.21.15.2:0/490378265 shutdown_connections 2024-09-15T23:11:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.910+0000 7fa365798640 1 --2- 172.21.15.2:0/490378265 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa360101790 0x7fa360101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.910+0000 7fa365798640 1 --2- 172.21.15.2:0/490378265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa360100df0 0x7fa360101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.910+0000 7fa365798640 1 --2- 172.21.15.2:0/490378265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3601004b0 0x7fa3601008b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.910+0000 7fa365798640 1 -- 172.21.15.2:0/490378265 >> 172.21.15.2:0/490378265 conn(0x7fa3600fc280 msgr2=0x7fa3600fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.910+0000 7fa365798640 1 -- 172.21.15.2:0/490378265 shutdown_connections 2024-09-15T23:11:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.910+0000 7fa365798640 1 -- 172.21.15.2:0/490378265 wait complete. 2024-09-15T23:11:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.911+0000 7fa365798640 1 Processor -- start 2024-09-15T23:11:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.911+0000 7fa365798640 1 -- start start 2024-09-15T23:11:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.911+0000 7fa365798640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3601004b0 0x7fa36019a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.911+0000 7fa365798640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa360100df0 0x7fa36019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.911+0000 7fa365798640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa360101790 0x7fa3601a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.911+0000 7fa365798640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa36010f8f0 con 0x7fa3601004b0 2024-09-15T23:11:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.911+0000 7fa365798640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa36010f770 con 0x7fa360101790 2024-09-15T23:11:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.911+0000 7fa365798640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa36010fa70 con 0x7fa360100df0 2024-09-15T23:11:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.911+0000 7fa35effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3601004b0 0x7fa36019a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.911+0000 7fa35effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3601004b0 0x7fa36019a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52678/0 (socket says 172.21.15.2:52678) 2024-09-15T23:11:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.911+0000 7fa35effd640 1 -- 172.21.15.2:0/214527599 learned_addr learned my addr 172.21.15.2:0/214527599 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:11:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.911+0000 7fa35e7fc640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa360100df0 0x7fa36019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.912+0000 7fa35f7fe640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa360101790 0x7fa3601a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.912+0000 7fa35effd640 1 -- 172.21.15.2:0/214527599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa360100df0 msgr2=0x7fa36019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.912+0000 7fa35effd640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa360100df0 0x7fa36019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.912+0000 7fa35effd640 1 -- 172.21.15.2:0/214527599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa360101790 msgr2=0x7fa3601a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.912+0000 7fa35effd640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa360101790 0x7fa3601a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.912+0000 7fa35effd640 1 -- 172.21.15.2:0/214527599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3601a1c70 con 0x7fa3601004b0 2024-09-15T23:11:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.912+0000 7fa35f7fe640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa360101790 0x7fa3601a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:11:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.912+0000 7fa35effd640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3601004b0 0x7fa36019a040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa350005940 tx=0x7fa3500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.912+0000 7fa347fff640 1 -- 172.21.15.2:0/214527599 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35003f030 con 0x7fa3601004b0 2024-09-15T23:11:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.912+0000 7fa347fff640 1 -- 172.21.15.2:0/214527599 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa350003cb0 con 0x7fa3601004b0 2024-09-15T23:11:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.912+0000 7fa347fff640 1 -- 172.21.15.2:0/214527599 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350035070 con 0x7fa3601004b0 2024-09-15T23:11:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.912+0000 7fa365798640 1 -- 172.21.15.2:0/214527599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3601a1f00 con 0x7fa3601004b0 2024-09-15T23:11:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.912+0000 7fa365798640 1 -- 172.21.15.2:0/214527599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3601a2300 con 0x7fa3601004b0 2024-09-15T23:11:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.913+0000 7fa365798640 1 -- 172.21.15.2:0/214527599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa36010b200 con 0x7fa3601004b0 2024-09-15T23:11:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.915+0000 7fa347fff640 1 -- 172.21.15.2:0/214527599 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa350042030 con 0x7fa3601004b0 2024-09-15T23:11:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.915+0000 7fa347fff640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa3480a3270 0x7fa3480a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.915+0000 7fa35e7fc640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa3480a3270 0x7fa3480a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:48.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.915+0000 7fa347fff640 1 -- 172.21.15.2:0/214527599 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6847+0+0 (secure 0 0 0) 0x7fa3500ef8f0 con 0x7fa3601004b0 2024-09-15T23:11:48.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.916+0000 7fa35e7fc640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa3480a3270 0x7fa3480a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa36019b560 tx=0x7fa35400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:48.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:48.919+0000 7fa347fff640 1 -- 172.21.15.2:0/214527599 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3500bcbd0 con 0x7fa3601004b0 2024-09-15T23:11:48.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:48 smithi112 ceph-mon[34367]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:48.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:48 smithi112 ceph-mon[34367]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T23:11:48.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:48 smithi112 ceph-mon[34367]: osdmap e73: 12 total, 11 up, 12 in 2024-09-15T23:11:48.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:48 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:48.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:48 smithi112 ceph-mon[34367]: from='osd.11 [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:11:48.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:48 smithi112 ceph-mon[34367]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-15T23:11:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.099+0000 7fa365798640 1 -- 172.21.15.2:0/214527599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa36002da30 con 0x7fa3601004b0 2024-09-15T23:11:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.099+0000 7fa347fff640 1 -- 172.21.15.2:0/214527599 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7fa3500bc4d0 con 0x7fa3601004b0 2024-09-15T23:11:49.101 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:11:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.102+0000 7fa365798640 1 -- 172.21.15.2:0/214527599 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa3480a3270 msgr2=0x7fa3480a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.102+0000 7fa365798640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa3480a3270 0x7fa3480a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa36019b560 tx=0x7fa35400b390 comp rx=0 tx=0).stop 2024-09-15T23:11:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.102+0000 7fa365798640 1 -- 172.21.15.2:0/214527599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3601004b0 msgr2=0x7fa36019a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.102+0000 7fa365798640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3601004b0 0x7fa36019a040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa350005940 tx=0x7fa3500042f0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.102+0000 7fa365798640 1 -- 172.21.15.2:0/214527599 shutdown_connections 2024-09-15T23:11:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.102+0000 7fa365798640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa3480a3270 0x7fa3480a5730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.102+0000 7fa365798640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa360101790 0x7fa3601a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.102+0000 7fa365798640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa360100df0 0x7fa36019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.102+0000 7fa365798640 1 --2- 172.21.15.2:0/214527599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3601004b0 0x7fa36019a040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.102+0000 7fa365798640 1 -- 172.21.15.2:0/214527599 >> 172.21.15.2:0/214527599 conn(0x7fa3600fc280 msgr2=0x7fa3600fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:49.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.102+0000 7fa365798640 1 -- 172.21.15.2:0/214527599 shutdown_connections 2024-09-15T23:11:49.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:49.102+0000 7fa365798640 1 -- 172.21.15.2:0/214527599 wait complete. 2024-09-15T23:11:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-15T23:11:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: osdmap e74: 12 total, 11 up, 12 in 2024-09-15T23:11:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: Detected new or changed devices on smithi145 2024-09-15T23:11:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi145 to 4272M 2024-09-15T23:11:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:49 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/214527599' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:11:49.930 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1726441883,"num_in_osds":12,"osd_in_since":1726441885,"num_remapped_pgs":0} 2024-09-15T23:11:49.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-15T23:11:49.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: osdmap e74: 12 total, 11 up, 12 in 2024-09-15T23:11:49.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: Detected new or changed devices on smithi145 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi145 to 4272M 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:49.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:49.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:49.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:49 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/214527599' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:11:49.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-15T23:11:49.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: osdmap e74: 12 total, 11 up, 12 in 2024-09-15T23:11:49.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:49.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:49.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: Detected new or changed devices on smithi145 2024-09-15T23:11:49.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:49.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:49.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:49.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:11:49.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi145 to 4272M 2024-09-15T23:11:49.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:49.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:49.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:49.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:49.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:49.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:49.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:49 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/214527599' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:11:50.932 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T23:11:50.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:50 smithi145 ceph-mon[34901]: purged_snaps scrub starts 2024-09-15T23:11:50.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:50 smithi145 ceph-mon[34901]: purged_snaps scrub ok 2024-09-15T23:11:50.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:50 smithi145 ceph-mon[34901]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:50.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:50 smithi145 ceph-mon[34901]: osd.11 [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289] boot 2024-09-15T23:11:50.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:50 smithi145 ceph-mon[34901]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T23:11:50.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:50 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:50.959 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:50 smithi002 ceph-mon[31019]: purged_snaps scrub starts 2024-09-15T23:11:50.959 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:50 smithi002 ceph-mon[31019]: purged_snaps scrub ok 2024-09-15T23:11:50.959 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:50 smithi002 ceph-mon[31019]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:50.960 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:50 smithi002 ceph-mon[31019]: osd.11 [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289] boot 2024-09-15T23:11:50.960 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:50 smithi002 ceph-mon[31019]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T23:11:50.960 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:50 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:50.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:50 smithi112 ceph-mon[34367]: purged_snaps scrub starts 2024-09-15T23:11:50.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:50 smithi112 ceph-mon[34367]: purged_snaps scrub ok 2024-09-15T23:11:50.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:50 smithi112 ceph-mon[34367]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:11:50.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:50 smithi112 ceph-mon[34367]: osd.11 [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289] boot 2024-09-15T23:11:50.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:50 smithi112 ceph-mon[34367]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T23:11:50.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:50 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:11:51.199 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:11:51.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.711+0000 7f8bb98bd640 1 -- 172.21.15.2:0/472356352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb4101cd0 msgr2=0x7f8bb4102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.711+0000 7f8bb98bd640 1 --2- 172.21.15.2:0/472356352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb4101cd0 0x7f8bb4102150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009900 tx=0x7f8b9c02a410 comp rx=0 tx=0).stop 2024-09-15T23:11:51.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.711+0000 7f8bb98bd640 1 -- 172.21.15.2:0/472356352 shutdown_connections 2024-09-15T23:11:51.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.711+0000 7f8bb98bd640 1 --2- 172.21.15.2:0/472356352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bb4102690 0x7f8bb4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.711+0000 7f8bb98bd640 1 --2- 172.21.15.2:0/472356352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb4101cd0 0x7f8bb4102150 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.712+0000 7f8bb98bd640 1 --2- 172.21.15.2:0/472356352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bb4100ad0 0x7f8bb4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.712+0000 7f8bb98bd640 1 -- 172.21.15.2:0/472356352 >> 172.21.15.2:0/472356352 conn(0x7f8bb40fc280 msgr2=0x7f8bb40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.712+0000 7f8bb98bd640 1 -- 172.21.15.2:0/472356352 shutdown_connections 2024-09-15T23:11:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.712+0000 7f8bb98bd640 1 -- 172.21.15.2:0/472356352 wait complete. 2024-09-15T23:11:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.712+0000 7f8bb98bd640 1 Processor -- start 2024-09-15T23:11:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.712+0000 7f8bb98bd640 1 -- start start 2024-09-15T23:11:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb98bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb4100ad0 0x7f8bb406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb98bd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bb4101cd0 0x7f8bb419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb98bd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bb4102690 0x7f8bb419f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb98bd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb410c6b0 con 0x7f8bb4100ad0 2024-09-15T23:11:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb98bd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb410c530 con 0x7f8bb4102690 2024-09-15T23:11:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb98bd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb410c830 con 0x7f8bb4101cd0 2024-09-15T23:11:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb4100ad0 0x7f8bb406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb4100ad0 0x7f8bb406aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52696/0 (socket says 172.21.15.2:52696) 2024-09-15T23:11:51.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb2ffd640 1 -- 172.21.15.2:0/3792035043 learned_addr learned my addr 172.21.15.2:0/3792035043 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:11:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb27fc640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bb4101cd0 0x7f8bb419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb2ffd640 1 -- 172.21.15.2:0/3792035043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bb4101cd0 msgr2=0x7f8bb419cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb2ffd640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bb4101cd0 0x7f8bb419cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb2ffd640 1 -- 172.21.15.2:0/3792035043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bb4102690 msgr2=0x7f8bb419f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb37fe640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bb4102690 0x7f8bb419f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb2ffd640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bb4102690 0x7f8bb419f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb2ffd640 1 -- 172.21.15.2:0/3792035043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb419fac0 con 0x7f8bb4100ad0 2024-09-15T23:11:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb27fc640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bb4101cd0 0x7f8bb419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:11:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb2ffd640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb4100ad0 0x7f8bb406aad0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400c970 tx=0x7f8ba400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.713+0000 7f8bb88bb640 1 -- 172.21.15.2:0/3792035043 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4007c10 con 0x7f8bb4100ad0 2024-09-15T23:11:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.714+0000 7f8bb88bb640 1 -- 172.21.15.2:0/3792035043 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ba4007db0 con 0x7f8bb4100ad0 2024-09-15T23:11:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.714+0000 7f8bb88bb640 1 -- 172.21.15.2:0/3792035043 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400f870 con 0x7f8bb4100ad0 2024-09-15T23:11:51.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.714+0000 7f8bb98bd640 1 -- 172.21.15.2:0/3792035043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb419fd50 con 0x7f8bb4100ad0 2024-09-15T23:11:51.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.714+0000 7f8bb98bd640 1 -- 172.21.15.2:0/3792035043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb41a02d0 con 0x7f8bb4100ad0 2024-09-15T23:11:51.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.715+0000 7f8bb98bd640 1 -- 172.21.15.2:0/3792035043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb4107ea0 con 0x7f8bb4100ad0 2024-09-15T23:11:51.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.716+0000 7f8bb88bb640 1 -- 172.21.15.2:0/3792035043 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8ba400fa10 con 0x7f8bb4100ad0 2024-09-15T23:11:51.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.716+0000 7f8bb88bb640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ba00a32c0 0x7f8ba00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.717+0000 7f8bb27fc640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ba00a32c0 0x7f8ba00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.717+0000 7f8bb88bb640 1 -- 172.21.15.2:0/3792035043 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f8ba40cf840 con 0x7f8bb4100ad0 2024-09-15T23:11:51.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.717+0000 7f8bb27fc640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ba00a32c0 0x7f8ba00a5780 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c000c00 tx=0x7f8b9c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:51.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.721+0000 7f8bb88bb640 1 -- 172.21.15.2:0/3792035043 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ba409ca90 con 0x7f8bb4100ad0 2024-09-15T23:11:51.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.894+0000 7f8bb98bd640 1 -- 172.21.15.2:0/3792035043 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8bb402d9b0 con 0x7f8bb4100ad0 2024-09-15T23:11:51.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.895+0000 7f8bb88bb640 1 -- 172.21.15.2:0/3792035043 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f8ba409c390 con 0x7f8bb4100ad0 2024-09-15T23:11:51.896 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:11:51.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.897+0000 7f8bb98bd640 1 -- 172.21.15.2:0/3792035043 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ba00a32c0 msgr2=0x7f8ba00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.897+0000 7f8bb98bd640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ba00a32c0 0x7f8ba00a5780 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c000c00 tx=0x7f8b9c0314a0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.897+0000 7f8bb98bd640 1 -- 172.21.15.2:0/3792035043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb4100ad0 msgr2=0x7f8bb406aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.897+0000 7f8bb98bd640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb4100ad0 0x7f8bb406aad0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400c970 tx=0x7f8ba400ce30 comp rx=0 tx=0).stop 2024-09-15T23:11:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.897+0000 7f8bb98bd640 1 -- 172.21.15.2:0/3792035043 shutdown_connections 2024-09-15T23:11:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.897+0000 7f8bb98bd640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ba00a32c0 0x7f8ba00a5780 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.897+0000 7f8bb98bd640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8bb4102690 0x7f8bb419f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.897+0000 7f8bb98bd640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bb4101cd0 0x7f8bb419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.897+0000 7f8bb98bd640 1 --2- 172.21.15.2:0/3792035043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bb4100ad0 0x7f8bb406aad0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.897+0000 7f8bb98bd640 1 -- 172.21.15.2:0/3792035043 >> 172.21.15.2:0/3792035043 conn(0x7f8bb40fc280 msgr2=0x7f8bb4105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:51.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.897+0000 7f8bb98bd640 1 -- 172.21.15.2:0/3792035043 shutdown_connections 2024-09-15T23:11:51.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:51.897+0000 7f8bb98bd640 1 -- 172.21.15.2:0/3792035043 wait complete. 2024-09-15T23:11:52.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:52 smithi002 ceph-mon[31019]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T23:11:52.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:52 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3792035043' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:11:52.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:52 smithi145 ceph-mon[34901]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T23:11:52.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:52 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3792035043' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:11:52.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:52 smithi112 ceph-mon[34367]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T23:11:52.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:52 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3792035043' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:11:52.692 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1726441909,"num_in_osds":12,"osd_in_since":1726441885,"num_remapped_pgs":0} 2024-09-15T23:11:52.693 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:11:52.993 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:11:53.288 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:53 smithi002 ceph-mon[31019]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:11:53.398 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:53 smithi112 ceph-mon[34367]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:11:53.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:53 smithi145 ceph-mon[34901]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:11:53.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.504+0000 7f2abf05e640 1 -- 172.21.15.2:0/2256814856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab81049b0 msgr2=0x7f2ab8108a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.504+0000 7f2abf05e640 1 --2- 172.21.15.2:0/2256814856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab81049b0 0x7f2ab8108a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009900 tx=0x7f2aa402a410 comp rx=0 tx=0).stop 2024-09-15T23:11:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.504+0000 7f2abf05e640 1 -- 172.21.15.2:0/2256814856 shutdown_connections 2024-09-15T23:11:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.504+0000 7f2abf05e640 1 --2- 172.21.15.2:0/2256814856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab8109130 0x7f2ab8110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.504+0000 7f2abf05e640 1 --2- 172.21.15.2:0/2256814856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab81049b0 0x7f2ab8108a00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.504+0000 7f2abf05e640 1 --2- 172.21.15.2:0/2256814856 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ab8104000 0x7f2ab81043e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.504+0000 7f2abf05e640 1 -- 172.21.15.2:0/2256814856 >> 172.21.15.2:0/2256814856 conn(0x7f2ab80ffa20 msgr2=0x7f2ab8101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.504+0000 7f2abf05e640 1 -- 172.21.15.2:0/2256814856 shutdown_connections 2024-09-15T23:11:53.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.504+0000 7f2abf05e640 1 -- 172.21.15.2:0/2256814856 wait complete. 2024-09-15T23:11:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abf05e640 1 Processor -- start 2024-09-15T23:11:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abf05e640 1 -- start start 2024-09-15T23:11:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abf05e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab8104000 0x7f2ab819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abf05e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ab81049b0 0x7f2ab819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abf05e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab8109130 0x7f2ab819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abf05e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab8114060 con 0x7f2ab8104000 2024-09-15T23:11:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abf05e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab8113ee0 con 0x7f2ab8109130 2024-09-15T23:11:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abf05e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab81141e0 con 0x7f2ab81049b0 2024-09-15T23:11:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abcdfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab8104000 0x7f2ab819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abcdfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab8104000 0x7f2ab819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52714/0 (socket says 172.21.15.2:52714) 2024-09-15T23:11:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abcdfa640 1 -- 172.21.15.2:0/3916887782 learned_addr learned my addr 172.21.15.2:0/3916887782 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2ab7fff640 1 --2- 172.21.15.2:0/3916887782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ab81049b0 0x7f2ab819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abcdfa640 1 -- 172.21.15.2:0/3916887782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ab81049b0 msgr2=0x7f2ab819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abcdfa640 1 --2- 172.21.15.2:0/3916887782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ab81049b0 0x7f2ab819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abcdfa640 1 -- 172.21.15.2:0/3916887782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab8109130 msgr2=0x7f2ab819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abcdfa640 1 --2- 172.21.15.2:0/3916887782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab8109130 0x7f2ab819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.505+0000 7f2abcdfa640 1 -- 172.21.15.2:0/3916887782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab819f570 con 0x7f2ab8104000 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.506+0000 7f2abcdfa640 1 --2- 172.21.15.2:0/3916887782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab8104000 0x7f2ab819a5c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00d950 tx=0x7f2aac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.506+0000 7f2ab5ffb640 1 -- 172.21.15.2:0/3916887782 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aac017030 con 0x7f2ab8104000 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.506+0000 7f2ab5ffb640 1 -- 172.21.15.2:0/3916887782 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2aac004020 con 0x7f2ab8104000 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.506+0000 7f2abf05e640 1 -- 172.21.15.2:0/3916887782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab819f860 con 0x7f2ab8104000 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.506+0000 7f2ab5ffb640 1 -- 172.21.15.2:0/3916887782 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aac0047a0 con 0x7f2ab8104000 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.506+0000 7f2abf05e640 1 -- 172.21.15.2:0/3916887782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab81a7140 con 0x7f2ab8104000 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.507+0000 7f2abf05e640 1 -- 172.21.15.2:0/3916887782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab81043e0 con 0x7f2ab8104000 2024-09-15T23:11:53.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.508+0000 7f2ab5ffb640 1 -- 172.21.15.2:0/3916887782 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2aac0041d0 con 0x7f2ab8104000 2024-09-15T23:11:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.509+0000 7f2ab5ffb640 1 --2- 172.21.15.2:0/3916887782 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f2aa80a32c0 0x7f2aa80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.509+0000 7f2ab7fff640 1 --2- 172.21.15.2:0/3916887782 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f2aa80a32c0 0x7f2aa80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.509+0000 7f2ab5ffb640 1 -- 172.21.15.2:0/3916887782 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f2aac0cee80 con 0x7f2ab8104000 2024-09-15T23:11:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.509+0000 7f2ab7fff640 1 --2- 172.21.15.2:0/3916887782 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f2aa80a32c0 0x7f2aa80a5780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4031440 tx=0x7f2aa4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.513+0000 7f2ab5ffb640 1 -- 172.21.15.2:0/3916887782 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2aac09c040 con 0x7f2ab8104000 2024-09-15T23:11:53.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.691+0000 7f2abf05e640 1 -- 172.21.15.2:0/3916887782 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ab810bde0 con 0x7f2ab8104000 2024-09-15T23:11:53.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.692+0000 7f2ab5ffb640 1 -- 172.21.15.2:0/3916887782 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18384 (secure 0 0 0) 0x7f2aac09b940 con 0x7f2ab8104000 2024-09-15T23:11:53.693 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:11:53.694 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":76,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","created":"2024-09-15T23:04:45.101432+0000","modified":"2024-09-15T23:11:51.027241+0000","last_up_change":"2024-09-15T23:11:49.566858+0000","last_in_change":"2024-09-15T23:11:25.723093+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:07:57.919291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40ff4fd9-3904-4178-a9cb-51f4647be540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6803","nonce":280991401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6805","nonce":280991401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6809","nonce":280991401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6807","nonce":280991401}]},"public_addr":"172.21.15.2:6803/280991401","cluster_addr":"172.21.15.2:6805/280991401","heartbeat_back_addr":"172.21.15.2:6809/280991401","heartbeat_front_addr":"172.21.15.2:6807/280991401","state":["exists","up"]},{"osd":1,"uuid":"af5e265d-fe45-4d9c-a34c-6f0b103d75d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6801","nonce":2649210970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6803","nonce":2649210970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6807","nonce":2649210970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6805","nonce":2649210970}]},"public_addr":"172.21.15.112:6801/2649210970","cluster_addr":"172.21.15.112:6803/2649210970","heartbeat_back_addr":"172.21.15.112:6807/2649210970","heartbeat_front_addr":"172.21.15.112:6805/2649210970","state":["exists","up"]},{"osd":2,"uuid":"8df9e644-fc51-4626-a1a7-6ac4448a5b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6801","nonce":3485615437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6803","nonce":3485615437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6807","nonce":3485615437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6805","nonce":3485615437}]},"public_addr":"172.21.15.145:6801/3485615437","cluster_addr":"172.21.15.145:6803/3485615437","heartbeat_back_addr":"172.21.15.145:6807/3485615437","heartbeat_front_addr":"172.21.15.145:6805/3485615437","state":["exists","up"]},{"osd":3,"uuid":"dbab372a-8fdd-4b0c-bee3-16cd75b35ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6811","nonce":113061968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6813","nonce":113061968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6817","nonce":113061968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6815","nonce":113061968}]},"public_addr":"172.21.15.2:6811/113061968","cluster_addr":"172.21.15.2:6813/113061968","heartbeat_back_addr":"172.21.15.2:6817/113061968","heartbeat_front_addr":"172.21.15.2:6815/113061968","state":["exists","up"]},{"osd":4,"uuid":"73bab8af-3973-4beb-a034-d00bcf0c572f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6809","nonce":2519162767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6811","nonce":2519162767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6815","nonce":2519162767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6813","nonce":2519162767}]},"public_addr":"172.21.15.112:6809/2519162767","cluster_addr":"172.21.15.112:6811/2519162767","heartbeat_back_addr":"172.21.15.112:6815/2519162767","heartbeat_front_addr":"172.21.15.112:6813/2519162767","state":["exists","up"]},{"osd":5,"uuid":"2d163e61-5891-46c1-b1c2-39d50a3b6f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6809","nonce":712427242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6811","nonce":712427242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6815","nonce":712427242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6813","nonce":712427242}]},"public_addr":"172.21.15.145:6809/712427242","cluster_addr":"172.21.15.145:6811/712427242","heartbeat_back_addr":"172.21.15.145:6815/712427242","heartbeat_front_addr":"172.21.15.145:6813/712427242","state":["exists","up"]},{"osd":6,"uuid":"bca02c96-10de-4953-96e9-42fc9ddf7c1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6819","nonce":2930673197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6821","nonce":2930673197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6825","nonce":2930673197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6823","nonce":2930673197}]},"public_addr":"172.21.15.2:6819/2930673197","cluster_addr":"172.21.15.2:6821/2930673197","heartbeat_back_addr":"172.21.15.2:6825/2930673197","heartbeat_front_addr":"172.21.15.2:6823/2930673197","state":["exists","up"]},{"osd":7,"uuid":"4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6817","nonce":830628191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6819","nonce":830628191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6823","nonce":830628191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6821","nonce":830628191}]},"public_addr":"172.21.15.112:6817/830628191","cluster_addr":"172.21.15.112:6819/830628191","heartbeat_back_addr":"172.21.15.112:6823/830628191","heartbeat_front_addr":"172.21.15.112:6821/830628191","state":["exists","up"]},{"osd":8,"uuid":"2733f9dd-3872-4bec-9c22-bcdb64828ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6817","nonce":3634470540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6819","nonce":3634470540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6823","nonce":3634470540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6821","nonce":3634470540}]},"public_addr":"172.21.15.145:6817/3634470540","cluster_addr":"172.21.15.145:6819/3634470540","heartbeat_back_addr":"172.21.15.145:6823/3634470540","heartbeat_front_addr":"172.21.15.145:6821/3634470540","state":["exists","up"]},{"osd":9,"uuid":"bd1f4a4a-547c-43a9-859a-75b37b06905f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6827","nonce":1417377702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6829","nonce":1417377702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6833","nonce":1417377702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6831","nonce":1417377702}]},"public_addr":"172.21.15.2:6827/1417377702","cluster_addr":"172.21.15.2:6829/1417377702","heartbeat_back_addr":"172.21.15.2:6833/1417377702","heartbeat_front_addr":"172.21.15.2:6831/1417377702","state":["exists","up"]},{"osd":10,"uuid":"f8b895e8-39f5-4753-9343-03f96da12246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6825","nonce":105615908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6827","nonce":105615908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6831","nonce":105615908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6829","nonce":105615908}]},"public_addr":"172.21.15.112:6825/105615908","cluster_addr":"172.21.15.112:6827/105615908","heartbeat_back_addr":"172.21.15.112:6831/105615908","heartbeat_front_addr":"172.21.15.112:6829/105615908","state":["exists","up"]},{"osd":11,"uuid":"dc018bfc-bc13-4ef2-a712-5cd406a56cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6825","nonce":430484289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6827","nonce":430484289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6831","nonce":430484289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6829","nonce":430484289}]},"public_addr":"172.21.15.145:6825/430484289","cluster_addr":"172.21.15.145:6827/430484289","heartbeat_back_addr":"172.21.15.145:6831/430484289","heartbeat_front_addr":"172.21.15.145:6829/430484289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:03.938207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:29.814740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:54.853802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:20.802021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:47.028090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:13.226130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:39.003023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:04.465156+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:29.321331+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:55.992585+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:21.623406+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:48.269840+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/2956732837":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6800/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/896502743":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/3802152324":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/1891095221":"2024-09-16T23:05:17.756048+0000","172.21.15.2:6800/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/236781836":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/2404111366":"2024-09-16T23:05:17.756048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:11:53.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.694+0000 7f2abf05e640 1 -- 172.21.15.2:0/3916887782 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f2aa80a32c0 msgr2=0x7f2aa80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:53.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.694+0000 7f2abf05e640 1 --2- 172.21.15.2:0/3916887782 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f2aa80a32c0 0x7f2aa80a5780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4031440 tx=0x7f2aa4005b50 comp rx=0 tx=0).stop 2024-09-15T23:11:53.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.694+0000 7f2abf05e640 1 -- 172.21.15.2:0/3916887782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab8104000 msgr2=0x7f2ab819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.694+0000 7f2abf05e640 1 --2- 172.21.15.2:0/3916887782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab8104000 0x7f2ab819a5c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00d950 tx=0x7f2aac00de10 comp rx=0 tx=0).stop 2024-09-15T23:11:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.694+0000 7f2abf05e640 1 -- 172.21.15.2:0/3916887782 shutdown_connections 2024-09-15T23:11:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.694+0000 7f2abf05e640 1 --2- 172.21.15.2:0/3916887782 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f2aa80a32c0 0x7f2aa80a5780 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.694+0000 7f2abf05e640 1 --2- 172.21.15.2:0/3916887782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2ab8109130 0x7f2ab819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.694+0000 7f2abf05e640 1 --2- 172.21.15.2:0/3916887782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ab81049b0 0x7f2ab819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.694+0000 7f2abf05e640 1 --2- 172.21.15.2:0/3916887782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab8104000 0x7f2ab819a5c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.694+0000 7f2abf05e640 1 -- 172.21.15.2:0/3916887782 >> 172.21.15.2:0/3916887782 conn(0x7f2ab80ffa20 msgr2=0x7f2ab8100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.694+0000 7f2abf05e640 1 -- 172.21.15.2:0/3916887782 shutdown_connections 2024-09-15T23:11:53.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:53.694+0000 7f2abf05e640 1 -- 172.21.15.2:0/3916887782 wait complete. 2024-09-15T23:11:54.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:54 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3916887782' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:11:54.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:54 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3916887782' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:11:54.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:54 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3916887782' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:11:54.512 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:07:57.919291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:11:54.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-15T23:11:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:11:55.181 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:55 smithi002 ceph-mon[31019]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:11:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.265+0000 7fc184474640 1 -- 172.21.15.2:0/1411269450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c106a80 msgr2=0x7fc17c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.265+0000 7fc184474640 1 --2- 172.21.15.2:0/1411269450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c106a80 0x7fc17c106e60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc178009930 tx=0x7fc17802a420 comp rx=0 tx=0).stop 2024-09-15T23:11:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.265+0000 7fc184474640 1 -- 172.21.15.2:0/1411269450 shutdown_connections 2024-09-15T23:11:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.265+0000 7fc184474640 1 --2- 172.21.15.2:0/1411269450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc17c101420 0x7fc17c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.265+0000 7fc184474640 1 --2- 172.21.15.2:0/1411269450 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc17c100a80 0x7fc17c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.265+0000 7fc184474640 1 --2- 172.21.15.2:0/1411269450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c106a80 0x7fc17c106e60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.265+0000 7fc184474640 1 -- 172.21.15.2:0/1411269450 >> 172.21.15.2:0/1411269450 conn(0x7fc17c0fc7a0 msgr2=0x7fc17c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.265+0000 7fc184474640 1 -- 172.21.15.2:0/1411269450 shutdown_connections 2024-09-15T23:11:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.266+0000 7fc184474640 1 -- 172.21.15.2:0/1411269450 wait complete. 2024-09-15T23:11:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.266+0000 7fc184474640 1 Processor -- start 2024-09-15T23:11:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.266+0000 7fc184474640 1 -- start start 2024-09-15T23:11:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.266+0000 7fc184474640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc17c100a80 0x7fc17c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.266+0000 7fc184474640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c101420 0x7fc17c1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.266+0000 7fc184474640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc17c106a80 0x7fc17c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.266+0000 7fc184474640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c110d30 con 0x7fc17c101420 2024-09-15T23:11:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.266+0000 7fc184474640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c110bb0 con 0x7fc17c106a80 2024-09-15T23:11:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.266+0000 7fc184474640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c110eb0 con 0x7fc17c100a80 2024-09-15T23:11:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc181a0f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c101420 0x7fc17c1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc181a0f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c101420 0x7fc17c1988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52730/0 (socket says 172.21.15.2:52730) 2024-09-15T23:11:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc181a0f640 1 -- 172.21.15.2:0/3588035952 learned_addr learned my addr 172.21.15.2:0/3588035952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:11:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc182210640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc17c100a80 0x7fc17c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc182a11640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc17c106a80 0x7fc17c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc181a0f640 1 -- 172.21.15.2:0/3588035952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc17c100a80 msgr2=0x7fc17c198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc181a0f640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc17c100a80 0x7fc17c198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc181a0f640 1 -- 172.21.15.2:0/3588035952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc17c106a80 msgr2=0x7fc17c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc181a0f640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc17c106a80 0x7fc17c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc181a0f640 1 -- 172.21.15.2:0/3588035952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c19d340 con 0x7fc17c101420 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc182210640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc17c100a80 0x7fc17c198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc182a11640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc17c106a80 0x7fc17c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc181a0f640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c101420 0x7fc17c1988d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00d950 tx=0x7fc16c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc1737fe640 1 -- 172.21.15.2:0/3588035952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c017070 con 0x7fc17c101420 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc1737fe640 1 -- 172.21.15.2:0/3588035952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc16c009c30 con 0x7fc17c101420 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc184474640 1 -- 172.21.15.2:0/3588035952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17c19d630 con 0x7fc17c101420 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc1737fe640 1 -- 172.21.15.2:0/3588035952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00f620 con 0x7fc17c101420 2024-09-15T23:11:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.267+0000 7fc184474640 1 -- 172.21.15.2:0/3588035952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17c1a4f10 con 0x7fc17c101420 2024-09-15T23:11:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.268+0000 7fc184474640 1 -- 172.21.15.2:0/3588035952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17c100ee0 con 0x7fc17c101420 2024-09-15T23:11:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.270+0000 7fc1737fe640 1 -- 172.21.15.2:0/3588035952 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc16c0109a0 con 0x7fc17c101420 2024-09-15T23:11:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.270+0000 7fc1737fe640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc1680a32c0 0x7fc1680a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.270+0000 7fc182210640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc1680a32c0 0x7fc1680a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.270+0000 7fc1737fe640 1 -- 172.21.15.2:0/3588035952 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fc16c0cf090 con 0x7fc17c101420 2024-09-15T23:11:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.271+0000 7fc182210640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc1680a32c0 0x7fc1680a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc178000c00 tx=0x7fc178009610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.273+0000 7fc1737fe640 1 -- 172.21.15.2:0/3588035952 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc16c009de0 con 0x7fc17c101420 2024-09-15T23:11:55.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.450+0000 7fc184474640 1 -- 172.21.15.2:0/3588035952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc17c1a51a0 con 0x7fc17c101420 2024-09-15T23:11:55.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.450+0000 7fc1737fe640 1 -- 172.21.15.2:0/3588035952 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7fc16c09c2d0 con 0x7fc17c101420 2024-09-15T23:11:55.451 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-15T23:11:55.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.452+0000 7fc184474640 1 -- 172.21.15.2:0/3588035952 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc1680a32c0 msgr2=0x7fc1680a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:55.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.452+0000 7fc184474640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc1680a32c0 0x7fc1680a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc178000c00 tx=0x7fc178009610 comp rx=0 tx=0).stop 2024-09-15T23:11:55.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.452+0000 7fc184474640 1 -- 172.21.15.2:0/3588035952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c101420 msgr2=0x7fc17c1988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:55.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.452+0000 7fc184474640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c101420 0x7fc17c1988d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00d950 tx=0x7fc16c00de10 comp rx=0 tx=0).stop 2024-09-15T23:11:55.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.452+0000 7fc184474640 1 -- 172.21.15.2:0/3588035952 shutdown_connections 2024-09-15T23:11:55.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.452+0000 7fc184474640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc1680a32c0 0x7fc1680a5780 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:55.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.452+0000 7fc184474640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc17c106a80 0x7fc17c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:55.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.452+0000 7fc184474640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc17c101420 0x7fc17c1988d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:55.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.452+0000 7fc184474640 1 --2- 172.21.15.2:0/3588035952 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc17c100a80 0x7fc17c198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:55.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.452+0000 7fc184474640 1 -- 172.21.15.2:0/3588035952 >> 172.21.15.2:0/3588035952 conn(0x7fc17c0fc7a0 msgr2=0x7fc17c06a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:55.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.452+0000 7fc184474640 1 -- 172.21.15.2:0/3588035952 shutdown_connections 2024-09-15T23:11:55.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:55.452+0000 7fc184474640 1 -- 172.21.15.2:0/3588035952 wait complete. 2024-09-15T23:11:55.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:55 smithi145 ceph-mon[34901]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:11:55.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:55 smithi112 ceph-mon[34367]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:11:56.152 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:56 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3588035952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:11:56.181 INFO:tasks.cephadm:Adding mds.a on smithi002 2024-09-15T23:11:56.181 INFO:tasks.cephadm:Adding mds.d on smithi002 2024-09-15T23:11:56.181 INFO:tasks.cephadm:Adding mds.g on smithi002 2024-09-15T23:11:56.181 INFO:tasks.cephadm:Adding mds.j on smithi002 2024-09-15T23:11:56.181 INFO:tasks.cephadm:Adding mds.b on smithi112 2024-09-15T23:11:56.181 INFO:tasks.cephadm:Adding mds.e on smithi112 2024-09-15T23:11:56.181 INFO:tasks.cephadm:Adding mds.h on smithi112 2024-09-15T23:11:56.181 INFO:tasks.cephadm:Adding mds.k on smithi112 2024-09-15T23:11:56.182 INFO:tasks.cephadm:Adding mds.c on smithi145 2024-09-15T23:11:56.182 INFO:tasks.cephadm:Adding mds.f on smithi145 2024-09-15T23:11:56.182 INFO:tasks.cephadm:Adding mds.i on smithi145 2024-09-15T23:11:56.182 INFO:tasks.cephadm:Adding mds.l on smithi145 2024-09-15T23:11:56.182 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l' 2024-09-15T23:11:56.442 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:11:56.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:56 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3588035952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:11:56.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:56 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3588035952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:11:57.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.963+0000 7f240375a640 1 -- 172.21.15.145:0/3560235868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23fc076220 msgr2=0x7f23fc074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:57.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.963+0000 7f240375a640 1 --2- 172.21.15.145:0/3560235868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23fc076220 0x7f23fc074680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009900 tx=0x7f23f802a410 comp rx=0 tx=0).stop 2024-09-15T23:11:57.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.963+0000 7f240375a640 1 -- 172.21.15.145:0/3560235868 shutdown_connections 2024-09-15T23:11:57.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.963+0000 7f240375a640 1 --2- 172.21.15.145:0/3560235868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23fc10e1e0 0x7f23fc1105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:57.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.963+0000 7f240375a640 1 --2- 172.21.15.145:0/3560235868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23fc074c50 0x7f23fc0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:57.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.963+0000 7f240375a640 1 --2- 172.21.15.145:0/3560235868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23fc076220 0x7f23fc074680 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:57.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.963+0000 7f240375a640 1 -- 172.21.15.145:0/3560235868 >> 172.21.15.145:0/3560235868 conn(0x7f23fc0fd390 msgr2=0x7f23fc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:57.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.963+0000 7f240375a640 1 -- 172.21.15.145:0/3560235868 shutdown_connections 2024-09-15T23:11:57.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.963+0000 7f240375a640 1 -- 172.21.15.145:0/3560235868 wait complete. 2024-09-15T23:11:57.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f240375a640 1 Processor -- start 2024-09-15T23:11:57.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f240375a640 1 -- start start 2024-09-15T23:11:57.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f240375a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23fc074c50 0x7f23fc19e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:57.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f240375a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23fc076220 0x7f23fc19e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:57.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f240375a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23fc10e1e0 0x7f23fc1a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:57.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f240375a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc113d50 con 0x7f23fc076220 2024-09-15T23:11:57.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f240375a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc113bd0 con 0x7f23fc074c50 2024-09-15T23:11:57.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f240375a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc113ed0 con 0x7f23fc10e1e0 2024-09-15T23:11:57.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f2401cf7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23fc10e1e0 0x7f23fc1a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:57.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f2401cf7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23fc10e1e0 0x7f23fc1a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:51920/0 (socket says 172.21.15.145:51920) 2024-09-15T23:11:57.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f2401cf7640 1 -- 172.21.15.145:0/1715855356 learned_addr learned my addr 172.21.15.145:0/1715855356 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-15T23:11:57.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f2400cf5640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23fc076220 0x7f23fc19e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:57.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f24014f6640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23fc074c50 0x7f23fc19e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:57.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f2401cf7640 1 -- 172.21.15.145:0/1715855356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23fc074c50 msgr2=0x7f23fc19e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:57.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f2401cf7640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23fc074c50 0x7f23fc19e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:57.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f2401cf7640 1 -- 172.21.15.145:0/1715855356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23fc076220 msgr2=0x7f23fc19e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:57.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f2401cf7640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23fc076220 0x7f23fc19e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:57.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f2401cf7640 1 -- 172.21.15.145:0/1715855356 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc1a5fb0 con 0x7f23fc10e1e0 2024-09-15T23:11:57.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f24014f6640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23fc074c50 0x7f23fc19e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:11:57.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.964+0000 7f2400cf5640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23fc076220 0x7f23fc19e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:11:57.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.965+0000 7f2401cf7640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23fc10e1e0 0x7f23fc1a5940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f23f400cce0 tx=0x7f23f400a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:57.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.965+0000 7f23f27fc640 1 -- 172.21.15.145:0/1715855356 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f400f450 con 0x7f23fc10e1e0 2024-09-15T23:11:57.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.965+0000 7f23f27fc640 1 -- 172.21.15.145:0/1715855356 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23f400faa0 con 0x7f23fc10e1e0 2024-09-15T23:11:57.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.965+0000 7f240375a640 1 -- 172.21.15.145:0/1715855356 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23fc1a62a0 con 0x7f23fc10e1e0 2024-09-15T23:11:57.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.965+0000 7f23f27fc640 1 -- 172.21.15.145:0/1715855356 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4018b70 con 0x7f23fc10e1e0 2024-09-15T23:11:57.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.965+0000 7f240375a640 1 -- 172.21.15.145:0/1715855356 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23fc1a67e0 con 0x7f23fc10e1e0 2024-09-15T23:11:57.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.966+0000 7f240375a640 1 -- 172.21.15.145:0/1715855356 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23fc104290 con 0x7f23fc10e1e0 2024-09-15T23:11:57.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.967+0000 7f23f27fc640 1 -- 172.21.15.145:0/1715855356 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f23f4018d10 con 0x7f23fc10e1e0 2024-09-15T23:11:57.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.967+0000 7f23f27fc640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23e80a32f0 0x7f23e80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:57.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.968+0000 7f23f27fc640 1 -- 172.21.15.145:0/1715855356 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f23f40cf900 con 0x7f23fc10e1e0 2024-09-15T23:11:57.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.968+0000 7f24014f6640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23e80a32f0 0x7f23e80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:57.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.968+0000 7f24014f6640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23e80a32f0 0x7f23e80a57b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f23f8006010 tx=0x7f23f8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:57.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:56.971+0000 7f23f27fc640 1 -- 172.21.15.145:0/1715855356 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23f4014030 con 0x7f23fc10e1e0 2024-09-15T23:11:57.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.150+0000 7f240375a640 1 -- 172.21.15.145:0/1715855356 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l", "target": ["mon-mgr", ""]}) -- 0x7f23fc062730 con 0x7f23e80a32f0 2024-09-15T23:11:57.152 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:57 smithi145 ceph-mon[34901]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:11:57.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.158+0000 7f23f27fc640 1 -- 172.21.15.145:0/1715855356 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f23fc062730 con 0x7f23e80a32f0 2024-09-15T23:11:57.159 INFO:teuthology.orchestra.run.smithi145.stdout:Scheduled mds.all update... 2024-09-15T23:11:57.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.160+0000 7f240375a640 1 -- 172.21.15.145:0/1715855356 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23e80a32f0 msgr2=0x7f23e80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:57.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.160+0000 7f240375a640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23e80a32f0 0x7f23e80a57b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f23f8006010 tx=0x7f23f8000bc0 comp rx=0 tx=0).stop 2024-09-15T23:11:57.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.160+0000 7f240375a640 1 -- 172.21.15.145:0/1715855356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23fc10e1e0 msgr2=0x7f23fc1a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:57.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.160+0000 7f240375a640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23fc10e1e0 0x7f23fc1a5940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f23f400cce0 tx=0x7f23f400a620 comp rx=0 tx=0).stop 2024-09-15T23:11:57.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.160+0000 7f240375a640 1 -- 172.21.15.145:0/1715855356 shutdown_connections 2024-09-15T23:11:57.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.160+0000 7f240375a640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23e80a32f0 0x7f23e80a57b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:57.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.160+0000 7f240375a640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23fc10e1e0 0x7f23fc1a5940 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:57.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.160+0000 7f240375a640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23fc076220 0x7f23fc19e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:57.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.160+0000 7f240375a640 1 --2- 172.21.15.145:0/1715855356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23fc074c50 0x7f23fc19e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:57.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.160+0000 7f240375a640 1 -- 172.21.15.145:0/1715855356 >> 172.21.15.145:0/1715855356 conn(0x7f23fc0fd390 msgr2=0x7f23fc101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:57.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.160+0000 7f240375a640 1 -- 172.21.15.145:0/1715855356 shutdown_connections 2024-09-15T23:11:57.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-15T23:11:57.160+0000 7f240375a640 1 -- 172.21.15.145:0/1715855356 wait complete. 2024-09-15T23:11:57.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:57 smithi002 ceph-mon[31019]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:11:57.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:57 smithi112 ceph-mon[34367]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:11:57.878 DEBUG:teuthology.orchestra.run.smithi002:mds.a> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.a.service 2024-09-15T23:11:57.885 DEBUG:teuthology.orchestra.run.smithi002:mds.d> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.d.service 2024-09-15T23:11:57.932 DEBUG:teuthology.orchestra.run.smithi002:mds.g> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.g.service 2024-09-15T23:11:57.979 DEBUG:teuthology.orchestra.run.smithi002:mds.j> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.j.service 2024-09-15T23:11:58.024 DEBUG:teuthology.orchestra.run.smithi112:mds.b> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.b.service 2024-09-15T23:11:58.029 DEBUG:teuthology.orchestra.run.smithi112:mds.e> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.e.service 2024-09-15T23:11:58.073 DEBUG:teuthology.orchestra.run.smithi112:mds.h> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.h.service 2024-09-15T23:11:58.120 DEBUG:teuthology.orchestra.run.smithi112:mds.k> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.k.service 2024-09-15T23:11:58.166 DEBUG:teuthology.orchestra.run.smithi145:mds.c> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.c.service 2024-09-15T23:11:58.168 DEBUG:teuthology.orchestra.run.smithi145:mds.f> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.f.service 2024-09-15T23:11:58.213 DEBUG:teuthology.orchestra.run.smithi145:mds.i> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.i.service 2024-09-15T23:11:58.257 DEBUG:teuthology.orchestra.run.smithi145:mds.l> sudo journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.l.service 2024-09-15T23:11:58.301 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-15T23:11:58.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:11:58.438 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:58 smithi145 ceph-mon[34901]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:11:58.438 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:58 smithi145 ceph-mon[34901]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l;count:12 2024-09-15T23:11:58.438 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:58.439 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:58.439 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:58.439 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:58.439 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:58.439 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:11:58.439 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:11:58.439 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:58 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:58.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:58 smithi112 ceph-mon[34367]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:11:58.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:58 smithi112 ceph-mon[34367]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l;count:12 2024-09-15T23:11:58.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:58.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:58.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:58.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:58.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:58.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:11:58.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:11:58.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:58 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:58.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:58 smithi002 ceph-mon[31019]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:11:58.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:58 smithi002 ceph-mon[31019]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l;count:12 2024-09-15T23:11:58.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:58.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:11:58.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:58.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:11:58.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:11:58.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:11:58.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:11:58.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:58 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:11:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:11:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.035+0000 7f9bdfe22640 1 -- 172.21.15.2:0/245296140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd8069f00 msgr2=0x7f9bd8100480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.035+0000 7f9bdfe22640 1 --2- 172.21.15.2:0/245296140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd8069f00 0x7f9bd8100480 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009900 tx=0x7f9bd402a410 comp rx=0 tx=0).stop 2024-09-15T23:11:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.036+0000 7f9bdfe22640 1 -- 172.21.15.2:0/245296140 shutdown_connections 2024-09-15T23:11:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.036+0000 7f9bdfe22640 1 --2- 172.21.15.2:0/245296140 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bd8104e80 0x7f9bd8105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.036+0000 7f9bdfe22640 1 --2- 172.21.15.2:0/245296140 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd806a370 0x7f9bd81009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.036+0000 7f9bdfe22640 1 --2- 172.21.15.2:0/245296140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd8069f00 0x7f9bd8100480 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.036+0000 7f9bdfe22640 1 -- 172.21.15.2:0/245296140 >> 172.21.15.2:0/245296140 conn(0x7f9bd8077210 msgr2=0x7f9bd80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.036+0000 7f9bdfe22640 1 -- 172.21.15.2:0/245296140 shutdown_connections 2024-09-15T23:11:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.036+0000 7f9bdfe22640 1 -- 172.21.15.2:0/245296140 wait complete. 2024-09-15T23:11:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.036+0000 7f9bdfe22640 1 Processor -- start 2024-09-15T23:11:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.036+0000 7f9bdfe22640 1 -- start start 2024-09-15T23:11:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.036+0000 7f9bdfe22640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bd8069f00 0x7f9bd8198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bdfe22640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd806a370 0x7f9bd81988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bdfe22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd8104e80 0x7f9bd819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bdfe22640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd8110d20 con 0x7f9bd8104e80 2024-09-15T23:11:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bdfe22640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd8110ba0 con 0x7f9bd806a370 2024-09-15T23:11:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bdfe22640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd8110ea0 con 0x7f9bd8069f00 2024-09-15T23:11:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bde3bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd8104e80 0x7f9bd819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bde3bf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd8104e80 0x7f9bd819cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37728/0 (socket says 172.21.15.2:37728) 2024-09-15T23:11:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bddbbe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bd8069f00 0x7f9bd8198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bde3bf640 1 -- 172.21.15.2:0/305571153 learned_addr learned my addr 172.21.15.2:0/305571153 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:11:59.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bdd3bd640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd806a370 0x7f9bd81988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bde3bf640 1 -- 172.21.15.2:0/305571153 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bd8069f00 msgr2=0x7f9bd8198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bde3bf640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bd8069f00 0x7f9bd8198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bde3bf640 1 -- 172.21.15.2:0/305571153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd806a370 msgr2=0x7f9bd81988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bde3bf640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd806a370 0x7f9bd81988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bde3bf640 1 -- 172.21.15.2:0/305571153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd819d320 con 0x7f9bd8104e80 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bddbbe640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bd8069f00 0x7f9bd8198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bde3bf640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd8104e80 0x7f9bd819cc40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000eb10 tx=0x7f9bd000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bceffd640 1 -- 172.21.15.2:0/305571153 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0004b20 con 0x7f9bd8104e80 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bceffd640 1 -- 172.21.15.2:0/305571153 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9bd0004cc0 con 0x7f9bd8104e80 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bdfe22640 1 -- 172.21.15.2:0/305571153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd819d610 con 0x7f9bd8104e80 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bceffd640 1 -- 172.21.15.2:0/305571153 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0010690 con 0x7f9bd8104e80 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.037+0000 7f9bdfe22640 1 -- 172.21.15.2:0/305571153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd81a4ef0 con 0x7f9bd8104e80 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.038+0000 7f9bdfe22640 1 -- 172.21.15.2:0/305571153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd8105330 con 0x7f9bd8104e80 2024-09-15T23:11:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.040+0000 7f9bceffd640 1 -- 172.21.15.2:0/305571153 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9bd0005020 con 0x7f9bd8104e80 2024-09-15T23:11:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.041+0000 7f9bceffd640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f9bc40a3240 0x7f9bc40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.041+0000 7f9bddbbe640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f9bc40a3240 0x7f9bc40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.041+0000 7f9bceffd640 1 -- 172.21.15.2:0/305571153 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f9bd00cf980 con 0x7f9bd8104e80 2024-09-15T23:11:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.041+0000 7f9bddbbe640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f9bc40a3240 0x7f9bc40a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4031440 tx=0x7f9bd4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.045+0000 7f9bceffd640 1 -- 172.21.15.2:0/305571153 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9bd009cb40 con 0x7f9bd8104e80 2024-09-15T23:11:59.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.256+0000 7f9bdfe22640 1 -- 172.21.15.2:0/305571153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bd81a5190 con 0x7f9bd8104e80 2024-09-15T23:11:59.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:59 smithi002 ceph-mon[31019]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:11:59.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:11:59 smithi002 ceph-mon[31019]: Deploying daemon mds.l on smithi145 2024-09-15T23:11:59.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.257+0000 7f9bceffd640 1 -- 172.21.15.2:0/305571153 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f9bd009c440 con 0x7f9bd8104e80 2024-09-15T23:11:59.259 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:11:59.259 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":1,"btime":"2024-09-15T23:04:45:101276+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-15T23:11:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 1 2024-09-15T23:11:59.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.259+0000 7f9bdfe22640 1 -- 172.21.15.2:0/305571153 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f9bc40a3240 msgr2=0x7f9bc40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:59.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.259+0000 7f9bdfe22640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f9bc40a3240 0x7f9bc40a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4031440 tx=0x7f9bd4005b50 comp rx=0 tx=0).stop 2024-09-15T23:11:59.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.259+0000 7f9bdfe22640 1 -- 172.21.15.2:0/305571153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd8104e80 msgr2=0x7f9bd819cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:59.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.259+0000 7f9bdfe22640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd8104e80 0x7f9bd819cc40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000eb10 tx=0x7f9bd000c2d0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.259+0000 7f9bdfe22640 1 -- 172.21.15.2:0/305571153 shutdown_connections 2024-09-15T23:11:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.259+0000 7f9bdfe22640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f9bc40a3240 0x7f9bc40a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.259+0000 7f9bdfe22640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd8104e80 0x7f9bd819cc40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.259+0000 7f9bdfe22640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9bd806a370 0x7f9bd81988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.259+0000 7f9bdfe22640 1 --2- 172.21.15.2:0/305571153 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9bd8069f00 0x7f9bd8198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.259+0000 7f9bdfe22640 1 -- 172.21.15.2:0/305571153 >> 172.21.15.2:0/305571153 conn(0x7f9bd8077210 msgr2=0x7f9bd80fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.259+0000 7f9bdfe22640 1 -- 172.21.15.2:0/305571153 shutdown_connections 2024-09-15T23:11:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:11:59.259+0000 7f9bdfe22640 1 -- 172.21.15.2:0/305571153 wait complete. 2024-09-15T23:11:59.430 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:59 smithi145 ceph-mon[34901]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:11:59.430 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:11:59 smithi145 ceph-mon[34901]: Deploying daemon mds.l on smithi145 2024-09-15T23:11:59.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:59 smithi112 ceph-mon[34367]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:11:59.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:11:59 smithi112 ceph-mon[34367]: Deploying daemon mds.l on smithi145 2024-09-15T23:11:59.708 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:11:59 smithi145 systemd[1]: Starting Ceph mds.l for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:12:00.107 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:11:59 smithi145 podman[63955]: 2024-09-15 23:11:59.735883785 +0000 UTC m=+0.015636988 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:12:00.107 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:11:59 smithi145 podman[63955]: 2024-09-15 23:11:59.845375428 +0000 UTC m=+0.125128621 container create 36dfc9e6f2e8d3946120ed60d224db31ec6b0eeae592a4ff24055391a11dc980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-15T23:12:00.107 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:12:00 smithi145 podman[63955]: 2024-09-15 23:12:00.106535413 +0000 UTC m=+0.386288606 container init 36dfc9e6f2e8d3946120ed60d224db31ec6b0eeae592a4ff24055391a11dc980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:12:00.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:00 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/305571153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:00.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:00 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.145:6832/3192333396,v1:172.21.15.145:6833/3192333396] up:boot 2024-09-15T23:12:00.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:00 smithi145 ceph-mon[34901]: fsmap 1 up:standby 2024-09-15T23:12:00.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:00 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T23:12:00.458 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:12:00 smithi145 podman[63955]: 2024-09-15 23:12:00.109445803 +0000 UTC m=+0.389198996 container start 36dfc9e6f2e8d3946120ed60d224db31ec6b0eeae592a4ff24055391a11dc980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-15T23:12:00.458 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:12:00 smithi145 ceph-mds[63974]: -- 172.21.15.145:0/3004446798 <== mon.1 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559df7f8d860 con 0x559df7f6a800 2024-09-15T23:12:00.458 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:12:00 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-l[63970]: starting mds.l at 2024-09-15T23:12:00.458 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:12:00 smithi145 bash[63955]: 36dfc9e6f2e8d3946120ed60d224db31ec6b0eeae592a4ff24055391a11dc980 2024-09-15T23:12:00.458 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:12:00 smithi145 systemd[1]: Started Ceph mds.l for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:12:00.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:00 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/305571153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:00.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:00 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.145:6832/3192333396,v1:172.21.15.145:6833/3192333396] up:boot 2024-09-15T23:12:00.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:00 smithi112 ceph-mon[34367]: fsmap 1 up:standby 2024-09-15T23:12:00.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:00 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T23:12:00.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:00 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/305571153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:00.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:00 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.145:6832/3192333396,v1:172.21.15.145:6833/3192333396] up:boot 2024-09-15T23:12:00.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:00 smithi002 ceph-mon[31019]: fsmap 1 up:standby 2024-09-15T23:12:00.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:00 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T23:12:01.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:01 smithi112 ceph-mon[34367]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:01.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:01.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:01.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:01.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:01.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:01.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:01 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:01.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:01 smithi112 ceph-mon[34367]: Deploying daemon mds.k on smithi112 2024-09-15T23:12:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:01 smithi002 ceph-mon[31019]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:01.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:01 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:01.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:01 smithi002 ceph-mon[31019]: Deploying daemon mds.k on smithi112 2024-09-15T23:12:01.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:01 smithi145 ceph-mon[34901]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:01.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:01.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:01.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:01.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:01.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:01.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:01 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:01.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:01 smithi145 ceph-mon[34901]: Deploying daemon mds.k on smithi112 2024-09-15T23:12:02.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:12:02.376 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:02.496 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:12:02 smithi112 systemd[1]: Starting Ceph mds.k for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:12:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.861+0000 7fcab8be8640 1 -- 172.21.15.2:0/1530789526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab41027a0 msgr2=0x7fcab41067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.861+0000 7fcab8be8640 1 --2- 172.21.15.2:0/1530789526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab41027a0 0x7fcab41067f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009900 tx=0x7fca9c02a3f0 comp rx=0 tx=0).stop 2024-09-15T23:12:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.861+0000 7fcab8be8640 1 -- 172.21.15.2:0/1530789526 shutdown_connections 2024-09-15T23:12:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.861+0000 7fcab8be8640 1 --2- 172.21.15.2:0/1530789526 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcab4106f20 0x7fcab410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:02.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.861+0000 7fcab8be8640 1 --2- 172.21.15.2:0/1530789526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab41027a0 0x7fcab41067f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.861+0000 7fcab8be8640 1 --2- 172.21.15.2:0/1530789526 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcab4101df0 0x7fcab41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.861+0000 7fcab8be8640 1 -- 172.21.15.2:0/1530789526 >> 172.21.15.2:0/1530789526 conn(0x7fcab40fd8f0 msgr2=0x7fcab40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.861+0000 7fcab8be8640 1 -- 172.21.15.2:0/1530789526 shutdown_connections 2024-09-15T23:12:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.861+0000 7fcab8be8640 1 -- 172.21.15.2:0/1530789526 wait complete. 2024-09-15T23:12:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.861+0000 7fcab8be8640 1 Processor -- start 2024-09-15T23:12:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.861+0000 7fcab8be8640 1 -- start start 2024-09-15T23:12:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab8be8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab4101df0 0x7fcab4198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab8be8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcab41027a0 0x7fcab4198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab8be8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcab4106f20 0x7fcab419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab8be8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcab4111e30 con 0x7fcab4101df0 2024-09-15T23:12:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab8be8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcab4111cb0 con 0x7fcab4106f20 2024-09-15T23:12:02.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab8be8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcab4111fb0 con 0x7fcab41027a0 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab4101df0 0x7fcab4198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab4101df0 0x7fcab4198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37746/0 (socket says 172.21.15.2:37746) 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab259c640 1 -- 172.21.15.2:0/1539262473 learned_addr learned my addr 172.21.15.2:0/1539262473 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab2d9d640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcab4106f20 0x7fcab419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcaabfff640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcab41027a0 0x7fcab4198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab259c640 1 -- 172.21.15.2:0/1539262473 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcab41027a0 msgr2=0x7fcab4198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab259c640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcab41027a0 0x7fcab4198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab259c640 1 -- 172.21.15.2:0/1539262473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcab4106f20 msgr2=0x7fcab419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab259c640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcab4106f20 0x7fcab419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab259c640 1 -- 172.21.15.2:0/1539262473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab419d2c0 con 0x7fcab4101df0 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab2d9d640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcab4106f20 0x7fcab419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab259c640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab4101df0 0x7fcab4198310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400c920 tx=0x7fcaa400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcaab7fe640 1 -- 172.21.15.2:0/1539262473 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4007c70 con 0x7fcab4101df0 2024-09-15T23:12:02.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcaab7fe640 1 -- 172.21.15.2:0/1539262473 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcaa4007e10 con 0x7fcab4101df0 2024-09-15T23:12:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcaab7fe640 1 -- 172.21.15.2:0/1539262473 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4018820 con 0x7fcab4101df0 2024-09-15T23:12:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.862+0000 7fcab8be8640 1 -- 172.21.15.2:0/1539262473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab419d5b0 con 0x7fcab4101df0 2024-09-15T23:12:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.863+0000 7fcab8be8640 1 -- 172.21.15.2:0/1539262473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab41a4e90 con 0x7fcab4101df0 2024-09-15T23:12:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.864+0000 7fcab8be8640 1 -- 172.21.15.2:0/1539262473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcab41021d0 con 0x7fcab4101df0 2024-09-15T23:12:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.865+0000 7fcaab7fe640 1 -- 172.21.15.2:0/1539262473 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fcaa40189c0 con 0x7fcab4101df0 2024-09-15T23:12:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.865+0000 7fcaab7fe640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcaa00a32c0 0x7fcaa00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.866+0000 7fcaabfff640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcaa00a32c0 0x7fcaa00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.866+0000 7fcaab7fe640 1 -- 172.21.15.2:0/1539262473 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fcaa40cf870 con 0x7fcab4101df0 2024-09-15T23:12:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.866+0000 7fcaabfff640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcaa00a32c0 0x7fcaa00a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fca9c006010 tx=0x7fca9c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:02.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:02.869+0000 7fcaab7fe640 1 -- 172.21.15.2:0/1539262473 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcaa4014030 con 0x7fcab4101df0 2024-09-15T23:12:02.898 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:12:02 smithi112 podman[63616]: 2024-09-15 23:12:02.5114395 +0000 UTC m=+0.016566373 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:12:02.899 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:12:02 smithi112 podman[63616]: 2024-09-15 23:12:02.662344439 +0000 UTC m=+0.167471311 container create 73e6b6932b6cb60f53a6cd71fc7f5626e1e30a65ab3fa86538ce0f75ece1777d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-15T23:12:02.899 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:12:02 smithi112 podman[63616]: 2024-09-15 23:12:02.898560066 +0000 UTC m=+0.403686938 container init 73e6b6932b6cb60f53a6cd71fc7f5626e1e30a65ab3fa86538ce0f75ece1777d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-k, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, io.buildah.version=1.37.2) 2024-09-15T23:12:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.084+0000 7fcab8be8640 1 -- 172.21.15.2:0/1539262473 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcab4199670 con 0x7fcab4101df0 2024-09-15T23:12:03.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.084+0000 7fcaab7fe640 1 -- 172.21.15.2:0/1539262473 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fcaa409cb40 con 0x7fcab4101df0 2024-09-15T23:12:03.086 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:12:03.086 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"btime":"2024-09-15T23:12:00:137296+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T23:12:03.086 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2024-09-15T23:12:03.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.086+0000 7fcab8be8640 1 -- 172.21.15.2:0/1539262473 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcaa00a32c0 msgr2=0x7fcaa00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.086+0000 7fcab8be8640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcaa00a32c0 0x7fcaa00a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fca9c006010 tx=0x7fca9c000bc0 comp rx=0 tx=0).stop 2024-09-15T23:12:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.086+0000 7fcab8be8640 1 -- 172.21.15.2:0/1539262473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab4101df0 msgr2=0x7fcab4198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.086+0000 7fcab8be8640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab4101df0 0x7fcab4198310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400c920 tx=0x7fcaa400cde0 comp rx=0 tx=0).stop 2024-09-15T23:12:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.086+0000 7fcab8be8640 1 -- 172.21.15.2:0/1539262473 shutdown_connections 2024-09-15T23:12:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.086+0000 7fcab8be8640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcaa00a32c0 0x7fcaa00a5780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.086+0000 7fcab8be8640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcab4106f20 0x7fcab419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.086+0000 7fcab8be8640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcab41027a0 0x7fcab4198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.086+0000 7fcab8be8640 1 --2- 172.21.15.2:0/1539262473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab4101df0 0x7fcab4198310 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.086+0000 7fcab8be8640 1 -- 172.21.15.2:0/1539262473 >> 172.21.15.2:0/1539262473 conn(0x7fcab40fd8f0 msgr2=0x7fcab40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.087+0000 7fcab8be8640 1 -- 172.21.15.2:0/1539262473 shutdown_connections 2024-09-15T23:12:03.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:03.087+0000 7fcab8be8640 1 -- 172.21.15.2:0/1539262473 wait complete. 2024-09-15T23:12:03.246 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:12:02 smithi112 podman[63616]: 2024-09-15 23:12:02.901546334 +0000 UTC m=+0.406673217 container start 73e6b6932b6cb60f53a6cd71fc7f5626e1e30a65ab3fa86538ce0f75ece1777d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-15T23:12:03.247 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:12:02 smithi112 ceph-mds[63635]: -- 172.21.15.112:0/685536813 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5566240a3860 con 0x556624081400 2024-09-15T23:12:03.247 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:12:02 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-k[63631]: starting mds.k at 2024-09-15T23:12:03.247 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:12:02 smithi112 bash[63616]: 73e6b6932b6cb60f53a6cd71fc7f5626e1e30a65ab3fa86538ce0f75ece1777d 2024-09-15T23:12:03.247 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:12:03 smithi112 systemd[1]: Started Ceph mds.k for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:12:03.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:03 smithi002 ceph-mon[31019]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:03.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:03.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:03.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:03.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:03.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:03.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:03 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:03.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:03 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1539262473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:03.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:03 smithi145 ceph-mon[34901]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:03.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:03 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:03.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:03 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:03.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:03 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:03.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:03 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:03.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:03 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:03.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:03 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:03.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:03 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1539262473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:03.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:03 smithi112 ceph-mon[34367]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:03.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:03.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:03.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:03.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:03.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:03.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:03 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:03.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:03 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1539262473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:04.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:04 smithi112 ceph-mon[34367]: Deploying daemon mds.j on smithi002 2024-09-15T23:12:04.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:04 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.112:6832/4192340343,v1:172.21.15.112:6833/4192340343] up:boot 2024-09-15T23:12:04.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:04 smithi112 ceph-mon[34367]: fsmap 2 up:standby 2024-09-15T23:12:04.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:04 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T23:12:04.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:04 smithi002 ceph-mon[31019]: Deploying daemon mds.j on smithi002 2024-09-15T23:12:04.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:04 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.112:6832/4192340343,v1:172.21.15.112:6833/4192340343] up:boot 2024-09-15T23:12:04.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:04 smithi002 ceph-mon[31019]: fsmap 2 up:standby 2024-09-15T23:12:04.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:04 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T23:12:04.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:04 smithi145 ceph-mon[34901]: Deploying daemon mds.j on smithi002 2024-09-15T23:12:04.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:04 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.112:6832/4192340343,v1:172.21.15.112:6833/4192340343] up:boot 2024-09-15T23:12:04.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:04 smithi145 ceph-mon[34901]: fsmap 2 up:standby 2024-09-15T23:12:04.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:04 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T23:12:05.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:05 smithi002 ceph-mon[31019]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:05.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:05 smithi145 ceph-mon[34901]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:05.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:05 smithi112 ceph-mon[34367]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:05.808 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:12:05 smithi002 systemd[1]: Starting Ceph mds.j for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:12:05.913 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:12:06.165 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:12:05 smithi002 podman[67842]: 2024-09-15 23:12:05.780842437 +0000 UTC m=+0.016296054 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:12:06.165 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:12:05 smithi002 podman[67842]: 2024-09-15 23:12:05.903812799 +0000 UTC m=+0.139266403 container create e7f4095fc8c9ff8fcdeb06802e43f0714fac25c346519cc105bba98b097019b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-15T23:12:06.165 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:12:06 smithi002 podman[67842]: 2024-09-15 23:12:06.16469511 +0000 UTC m=+0.400148727 container init e7f4095fc8c9ff8fcdeb06802e43f0714fac25c346519cc105bba98b097019b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-15T23:12:06.359 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:06.482 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:12:06 smithi002 podman[67842]: 2024-09-15 23:12:06.167854616 +0000 UTC m=+0.403308221 container start e7f4095fc8c9ff8fcdeb06802e43f0714fac25c346519cc105bba98b097019b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-15T23:12:06.482 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:12:06 smithi002 ceph-mds[67890]: -- 172.21.15.2:0/4196609858 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fed0cb7860 con 0x55fed0c94800 2024-09-15T23:12:06.482 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:12:06 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-j[67875]: starting mds.j at 2024-09-15T23:12:06.482 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:12:06 smithi002 bash[67842]: e7f4095fc8c9ff8fcdeb06802e43f0714fac25c346519cc105bba98b097019b7 2024-09-15T23:12:06.482 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:12:06 smithi002 systemd[1]: Started Ceph mds.j for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:12:06.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.858+0000 7f0aac9da640 1 -- 172.21.15.2:0/1206714636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aa8106f10 msgr2=0x7f0aa810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.858+0000 7f0aac9da640 1 --2- 172.21.15.2:0/1206714636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aa8106f10 0x7f0aa810ea90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009ca0 tx=0x7f0aa002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:12:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.858+0000 7f0aac9da640 1 -- 172.21.15.2:0/1206714636 shutdown_connections 2024-09-15T23:12:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.858+0000 7f0aac9da640 1 --2- 172.21.15.2:0/1206714636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aa8106f10 0x7f0aa810ea90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.858+0000 7f0aac9da640 1 --2- 172.21.15.2:0/1206714636 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0aa8102790 0x7f0aa81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.858+0000 7f0aac9da640 1 --2- 172.21.15.2:0/1206714636 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0aa8101de0 0x7f0aa81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.858+0000 7f0aac9da640 1 -- 172.21.15.2:0/1206714636 >> 172.21.15.2:0/1206714636 conn(0x7f0aa80fd8c0 msgr2=0x7f0aa80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.858+0000 7f0aac9da640 1 -- 172.21.15.2:0/1206714636 shutdown_connections 2024-09-15T23:12:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.858+0000 7f0aac9da640 1 -- 172.21.15.2:0/1206714636 wait complete. 2024-09-15T23:12:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.859+0000 7f0aac9da640 1 Processor -- start 2024-09-15T23:12:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.859+0000 7f0aac9da640 1 -- start start 2024-09-15T23:12:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.859+0000 7f0aac9da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aa8101de0 0x7f0aa819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.859+0000 7f0aac9da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0aa8102790 0x7f0aa819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.859+0000 7f0aac9da640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0aa8106f10 0x7f0aa819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.859+0000 7f0aac9da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa8111ec0 con 0x7f0aa8101de0 2024-09-15T23:12:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.859+0000 7f0aac9da640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa8111d40 con 0x7f0aa8102790 2024-09-15T23:12:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.859+0000 7f0aac9da640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa8112040 con 0x7f0aa8106f10 2024-09-15T23:12:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.859+0000 7f0aa659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aa8101de0 0x7f0aa819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0aa659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aa8101de0 0x7f0aa819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54226/0 (socket says 172.21.15.2:54226) 2024-09-15T23:12:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0aa659c640 1 -- 172.21.15.2:0/1238318369 learned_addr learned my addr 172.21.15.2:0/1238318369 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0aa6d9d640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0aa8106f10 0x7f0aa819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0a9dd9b640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0aa8102790 0x7f0aa819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0aa659c640 1 -- 172.21.15.2:0/1238318369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0aa8106f10 msgr2=0x7f0aa819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0aa659c640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0aa8106f10 0x7f0aa819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0aa659c640 1 -- 172.21.15.2:0/1238318369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0aa8102790 msgr2=0x7f0aa819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0aa659c640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0aa8102790 0x7f0aa819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0aa659c640 1 -- 172.21.15.2:0/1238318369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa819f650 con 0x7f0aa8101de0 2024-09-15T23:12:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0a9dd9b640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0aa8102790 0x7f0aa819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0aa659c640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aa8101de0 0x7f0aa819a6a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800b4a0 tx=0x7f0a9800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0a9ffff640 1 -- 172.21.15.2:0/1238318369 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a98014070 con 0x7f0aa8101de0 2024-09-15T23:12:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0aac9da640 1 -- 172.21.15.2:0/1238318369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa819f940 con 0x7f0aa8101de0 2024-09-15T23:12:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0a9ffff640 1 -- 172.21.15.2:0/1238318369 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0a98010ac0 con 0x7f0aa8101de0 2024-09-15T23:12:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0a9ffff640 1 -- 172.21.15.2:0/1238318369 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a98017c30 con 0x7f0aa8101de0 2024-09-15T23:12:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.860+0000 7f0aac9da640 1 -- 172.21.15.2:0/1238318369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa81a7220 con 0x7f0aa8101de0 2024-09-15T23:12:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.861+0000 7f0aac9da640 1 -- 172.21.15.2:0/1238318369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa81021c0 con 0x7f0aa8101de0 2024-09-15T23:12:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.863+0000 7f0a9ffff640 1 -- 172.21.15.2:0/1238318369 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0a98017070 con 0x7f0aa8101de0 2024-09-15T23:12:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.863+0000 7f0a9ffff640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0a940a3240 0x7f0a940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.863+0000 7f0a9dd9b640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0a940a3240 0x7f0a940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.863+0000 7f0a9ffff640 1 -- 172.21.15.2:0/1238318369 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f0a980ceba0 con 0x7f0aa8101de0 2024-09-15T23:12:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.864+0000 7f0a9dd9b640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0a940a3240 0x7f0a940a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0a90006fd0 tx=0x7f0a90008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:06.867+0000 7f0a9ffff640 1 -- 172.21.15.2:0/1238318369 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a9809bd60 con 0x7f0aa8101de0 2024-09-15T23:12:07.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.084+0000 7f0aac9da640 1 -- 172.21.15.2:0/1238318369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0aa81a7450 con 0x7f0aa8101de0 2024-09-15T23:12:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.084+0000 7f0a9ffff640 1 -- 172.21.15.2:0/1238318369 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f0a9809b660 con 0x7f0aa8101de0 2024-09-15T23:12:07.086 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:12:07.086 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":4,"btime":"2024-09-15T23:12:06:280338+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-15T23:12:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 4 2024-09-15T23:12:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.086+0000 7f0aac9da640 1 -- 172.21.15.2:0/1238318369 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0a940a3240 msgr2=0x7f0a940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.086+0000 7f0aac9da640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0a940a3240 0x7f0a940a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0a90006fd0 tx=0x7f0a90008040 comp rx=0 tx=0).stop 2024-09-15T23:12:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.086+0000 7f0aac9da640 1 -- 172.21.15.2:0/1238318369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aa8101de0 msgr2=0x7f0aa819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.086+0000 7f0aac9da640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aa8101de0 0x7f0aa819a6a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800b4a0 tx=0x7f0a9800b960 comp rx=0 tx=0).stop 2024-09-15T23:12:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.087+0000 7f0aac9da640 1 -- 172.21.15.2:0/1238318369 shutdown_connections 2024-09-15T23:12:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.087+0000 7f0aac9da640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0a940a3240 0x7f0a940a5700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.087+0000 7f0aac9da640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0aa8106f10 0x7f0aa819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.087+0000 7f0aac9da640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0aa8102790 0x7f0aa819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.087+0000 7f0aac9da640 1 --2- 172.21.15.2:0/1238318369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0aa8101de0 0x7f0aa819a6a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.087+0000 7f0aac9da640 1 -- 172.21.15.2:0/1238318369 >> 172.21.15.2:0/1238318369 conn(0x7f0aa80fd8c0 msgr2=0x7f0aa80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.087+0000 7f0aac9da640 1 -- 172.21.15.2:0/1238318369 shutdown_connections 2024-09-15T23:12:07.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:07.087+0000 7f0aac9da640 1 -- 172.21.15.2:0/1238318369 wait complete. 2024-09-15T23:12:07.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:07 smithi002 ceph-mon[31019]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:07.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:07 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.2:6834/3895460397,v1:172.21.15.2:6835/3895460397] up:boot 2024-09-15T23:12:07.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:07 smithi002 ceph-mon[31019]: fsmap 3 up:standby 2024-09-15T23:12:07.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:07 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T23:12:07.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:07 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:07.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:07 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:07.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:07 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:07.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:07 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:07.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:07 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:07.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:07 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:07.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:07 smithi002 ceph-mon[31019]: Deploying daemon mds.d on smithi002 2024-09-15T23:12:07.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:07 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1238318369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:07.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:07 smithi145 ceph-mon[34901]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:07.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:07 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.2:6834/3895460397,v1:172.21.15.2:6835/3895460397] up:boot 2024-09-15T23:12:07.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:07 smithi145 ceph-mon[34901]: fsmap 3 up:standby 2024-09-15T23:12:07.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:07 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T23:12:07.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:07 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:07.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:07 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:07.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:07 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:07.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:07 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:07.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:07 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:07.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:07 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:07.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:07 smithi145 ceph-mon[34901]: Deploying daemon mds.d on smithi002 2024-09-15T23:12:07.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:07 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1238318369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:07.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:07 smithi112 ceph-mon[34367]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:07.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:07 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.2:6834/3895460397,v1:172.21.15.2:6835/3895460397] up:boot 2024-09-15T23:12:07.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:07 smithi112 ceph-mon[34367]: fsmap 3 up:standby 2024-09-15T23:12:07.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:07 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T23:12:07.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:07 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:07.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:07 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:07.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:07 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:07.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:07 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:07.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:07 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:07.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:07 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:07.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:07 smithi112 ceph-mon[34367]: Deploying daemon mds.d on smithi002 2024-09-15T23:12:07.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:07 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1238318369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:09.331 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:09 smithi002 ceph-mon[31019]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:09.583 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:12:09 smithi002 podman[68257]: 2024-09-15 23:12:09.454584522 +0000 UTC m=+0.017537509 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:12:09.583 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:12:09 smithi002 podman[68257]: 2024-09-15 23:12:09.582894916 +0000 UTC m=+0.145847910 container create a2362a05268e9f71f3c3aadc0ae86848cb62403788229eaee2b5a46185e15218 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-d, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-8921c8e) 2024-09-15T23:12:09.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:09 smithi145 ceph-mon[34901]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:09.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:09 smithi112 ceph-mon[34367]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:09.855 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:12:09 smithi002 podman[68257]: 2024-09-15 23:12:09.827156059 +0000 UTC m=+0.390109047 container init a2362a05268e9f71f3c3aadc0ae86848cb62403788229eaee2b5a46185e15218 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-15T23:12:09.855 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:12:09 smithi002 podman[68257]: 2024-09-15 23:12:09.830227446 +0000 UTC m=+0.393180433 container start a2362a05268e9f71f3c3aadc0ae86848cb62403788229eaee2b5a46185e15218 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-15T23:12:09.884 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:12:10.155 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:10.277 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:12:09 smithi002 ceph-mds[68284]: -- 172.21.15.2:0/2689223011 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b8f37f5860 con 0x55b8f37d3000 2024-09-15T23:12:10.277 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:12:09 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-d[68280]: starting mds.d at 2024-09-15T23:12:10.277 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:12:09 smithi002 bash[68257]: a2362a05268e9f71f3c3aadc0ae86848cb62403788229eaee2b5a46185e15218 2024-09-15T23:12:10.277 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:12:09 smithi002 systemd[1]: Started Ceph mds.d for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:12:10.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.672+0000 7f7d3e958640 1 -- 172.21.15.2:0/445634916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d38103660 msgr2=0x7f7d3810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:10.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.672+0000 7f7d3e958640 1 --2- 172.21.15.2:0/445634916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d38103660 0x7f7d3810bb50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009900 tx=0x7f7d2c02a480 comp rx=0 tx=0).stop 2024-09-15T23:12:10.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.672+0000 7f7d3e958640 1 -- 172.21.15.2:0/445634916 shutdown_connections 2024-09-15T23:12:10.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.672+0000 7f7d3e958640 1 --2- 172.21.15.2:0/445634916 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d3810c170 0x7f7d3810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.672+0000 7f7d3e958640 1 --2- 172.21.15.2:0/445634916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d38103660 0x7f7d3810bb50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.672+0000 7f7d3e958640 1 --2- 172.21.15.2:0/445634916 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d38102d40 0x7f7d38103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.672+0000 7f7d3e958640 1 -- 172.21.15.2:0/445634916 >> 172.21.15.2:0/445634916 conn(0x7f7d380fc7a0 msgr2=0x7f7d380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:10.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.672+0000 7f7d3e958640 1 -- 172.21.15.2:0/445634916 shutdown_connections 2024-09-15T23:12:10.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.672+0000 7f7d3e958640 1 -- 172.21.15.2:0/445634916 wait complete. 2024-09-15T23:12:10.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.672+0000 7f7d3e958640 1 Processor -- start 2024-09-15T23:12:10.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.672+0000 7f7d3e958640 1 -- start start 2024-09-15T23:12:10.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d3e958640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d38102d40 0x7f7d381009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:10.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d3e958640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d38103660 0x7f7d38100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:10.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d3e958640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d3810c170 0x7f7d38101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:10.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d3e958640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38111e20 con 0x7f7d38102d40 2024-09-15T23:12:10.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d3e958640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38111ca0 con 0x7f7d3810c170 2024-09-15T23:12:10.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d3e958640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38111fa0 con 0x7f7d38103660 2024-09-15T23:12:10.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d37fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d38102d40 0x7f7d381009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:10.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d37fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d38102d40 0x7f7d381009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54256/0 (socket says 172.21.15.2:54256) 2024-09-15T23:12:10.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d37fff640 1 -- 172.21.15.2:0/1566553569 learned_addr learned my addr 172.21.15.2:0/1566553569 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:10.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d377fe640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d38103660 0x7f7d38100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:10.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d3cef5640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d3810c170 0x7f7d38101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:10.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d37fff640 1 -- 172.21.15.2:0/1566553569 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d38103660 msgr2=0x7f7d38100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:10.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d37fff640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d38103660 0x7f7d38100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d37fff640 1 -- 172.21.15.2:0/1566553569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d3810c170 msgr2=0x7f7d38101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:10.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d37fff640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d3810c170 0x7f7d38101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d37fff640 1 -- 172.21.15.2:0/1566553569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d381a6880 con 0x7f7d38102d40 2024-09-15T23:12:10.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d3cef5640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d3810c170 0x7f7d38101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:10.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d377fe640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d38103660 0x7f7d38100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:10.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.673+0000 7f7d37fff640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d38102d40 0x7f7d381009a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800d950 tx=0x7f7d2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:10.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.674+0000 7f7d357fa640 1 -- 172.21.15.2:0/1566553569 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28017070 con 0x7f7d38102d40 2024-09-15T23:12:10.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.674+0000 7f7d3e958640 1 -- 172.21.15.2:0/1566553569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d381a6b70 con 0x7f7d38102d40 2024-09-15T23:12:10.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.674+0000 7f7d357fa640 1 -- 172.21.15.2:0/1566553569 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d28009c30 con 0x7f7d38102d40 2024-09-15T23:12:10.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.674+0000 7f7d357fa640 1 -- 172.21.15.2:0/1566553569 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2800f620 con 0x7f7d38102d40 2024-09-15T23:12:10.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.674+0000 7f7d3e958640 1 -- 172.21.15.2:0/1566553569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d381a7100 con 0x7f7d38102d40 2024-09-15T23:12:10.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.675+0000 7f7d3e958640 1 -- 172.21.15.2:0/1566553569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d38103120 con 0x7f7d38102d40 2024-09-15T23:12:10.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.676+0000 7f7d357fa640 1 -- 172.21.15.2:0/1566553569 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f7d280109a0 con 0x7f7d38102d40 2024-09-15T23:12:10.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.676+0000 7f7d357fa640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7d200a3240 0x7f7d200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:10.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.677+0000 7f7d377fe640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7d200a3240 0x7f7d200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:10.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.677+0000 7f7d357fa640 1 -- 172.21.15.2:0/1566553569 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f7d280cf150 con 0x7f7d38102d40 2024-09-15T23:12:10.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.677+0000 7f7d377fe640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7d200a3240 0x7f7d200a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c000c00 tx=0x7f7d2c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:10.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.681+0000 7f7d357fa640 1 -- 172.21.15.2:0/1566553569 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d28009de0 con 0x7f7d38102d40 2024-09-15T23:12:10.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.892+0000 7f7d3e958640 1 -- 172.21.15.2:0/1566553569 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d38106c50 con 0x7f7d38102d40 2024-09-15T23:12:10.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.892+0000 7f7d357fa640 1 -- 172.21.15.2:0/1566553569 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7f7d2809c310 con 0x7f7d38102d40 2024-09-15T23:12:10.894 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:12:10.894 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"btime":"2024-09-15T23:12:10:291359+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-15T23:12:10.894 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 5 2024-09-15T23:12:10.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.894+0000 7f7d3e958640 1 -- 172.21.15.2:0/1566553569 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7d200a3240 msgr2=0x7f7d200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:10.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.894+0000 7f7d3e958640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7d200a3240 0x7f7d200a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c000c00 tx=0x7f7d2c031400 comp rx=0 tx=0).stop 2024-09-15T23:12:10.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.894+0000 7f7d3e958640 1 -- 172.21.15.2:0/1566553569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d38102d40 msgr2=0x7f7d381009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:10.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.894+0000 7f7d3e958640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d38102d40 0x7f7d381009a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800d950 tx=0x7f7d2800de10 comp rx=0 tx=0).stop 2024-09-15T23:12:10.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.895+0000 7f7d3e958640 1 -- 172.21.15.2:0/1566553569 shutdown_connections 2024-09-15T23:12:10.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.895+0000 7f7d3e958640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7d200a3240 0x7f7d200a5700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.895+0000 7f7d3e958640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d3810c170 0x7f7d38101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.895+0000 7f7d3e958640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7d38103660 0x7f7d38100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.895+0000 7f7d3e958640 1 --2- 172.21.15.2:0/1566553569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d38102d40 0x7f7d381009a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.895+0000 7f7d3e958640 1 -- 172.21.15.2:0/1566553569 >> 172.21.15.2:0/1566553569 conn(0x7f7d380fc7a0 msgr2=0x7f7d380fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:10.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.895+0000 7f7d3e958640 1 -- 172.21.15.2:0/1566553569 shutdown_connections 2024-09-15T23:12:10.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:10.895+0000 7f7d3e958640 1 -- 172.21.15.2:0/1566553569 wait complete. 2024-09-15T23:12:11.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:11 smithi112 ceph-mon[34367]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:11.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:11 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:11.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:11 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:11.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:11 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:11.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:11 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:11.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:11 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:11.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:11 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:11.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:11 smithi112 ceph-mon[34367]: Deploying daemon mds.e on smithi112 2024-09-15T23:12:11.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:11 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.2:6836/2892386790,v1:172.21.15.2:6837/2892386790] up:boot 2024-09-15T23:12:11.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:11 smithi112 ceph-mon[34367]: fsmap 4 up:standby 2024-09-15T23:12:11.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:11 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T23:12:11.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:11 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1566553569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:11.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:11 smithi002 ceph-mon[31019]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:11.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:11 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:11.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:11 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:11.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:11 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:11.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:11 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:11.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:11 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:11.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:11 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:11.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:11 smithi002 ceph-mon[31019]: Deploying daemon mds.e on smithi112 2024-09-15T23:12:11.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:11 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.2:6836/2892386790,v1:172.21.15.2:6837/2892386790] up:boot 2024-09-15T23:12:11.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:11 smithi002 ceph-mon[31019]: fsmap 4 up:standby 2024-09-15T23:12:11.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:11 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T23:12:11.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:11 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1566553569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:11.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:11 smithi145 ceph-mon[34901]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:11.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:11 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:11.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:11 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:11.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:11 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:11.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:11 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:11.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:11 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:11.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:11 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:11.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:11 smithi145 ceph-mon[34901]: Deploying daemon mds.e on smithi112 2024-09-15T23:12:11.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:11 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.2:6836/2892386790,v1:172.21.15.2:6837/2892386790] up:boot 2024-09-15T23:12:11.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:11 smithi145 ceph-mon[34901]: fsmap 4 up:standby 2024-09-15T23:12:11.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:11 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T23:12:11.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:11 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1566553569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:12.223 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:12:12 smithi112 systemd[1]: Starting Ceph mds.e for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:12:12.497 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:12:12 smithi112 podman[63929]: 2024-09-15 23:12:12.125385409 +0000 UTC m=+0.015846450 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:12:12.497 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:12:12 smithi112 podman[63929]: 2024-09-15 23:12:12.26048868 +0000 UTC m=+0.150949713 container create 7b9493fdbe5f3f06eafd9c0caafa66d2e41e750ab568ed0a93239066c96a0331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:12:12.997 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:12:12 smithi112 podman[63929]: 2024-09-15 23:12:12.521724052 +0000 UTC m=+0.412185085 container init 7b9493fdbe5f3f06eafd9c0caafa66d2e41e750ab568ed0a93239066c96a0331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:12:12.997 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:12:12 smithi112 podman[63929]: 2024-09-15 23:12:12.524475703 +0000 UTC m=+0.414936735 container start 7b9493fdbe5f3f06eafd9c0caafa66d2e41e750ab568ed0a93239066c96a0331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-15T23:12:12.997 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:12:12 smithi112 ceph-mds[63948]: -- 172.21.15.112:0/250830732 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555a84d19860 con 0x555a84cf7000 2024-09-15T23:12:12.997 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:12:12 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-e[63944]: starting mds.e at 2024-09-15T23:12:12.997 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:12:12 smithi112 bash[63929]: 7b9493fdbe5f3f06eafd9c0caafa66d2e41e750ab568ed0a93239066c96a0331 2024-09-15T23:12:12.997 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:12:12 smithi112 systemd[1]: Started Ceph mds.e for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:12:13.271 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:13 smithi145 ceph-mon[34901]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:13.271 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:13.271 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:13.272 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:13.272 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:13.272 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:13.272 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:13 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:13.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:13 smithi002 ceph-mon[31019]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:13.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:13.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:13.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:13.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:13.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:13.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:13 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:13.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:13 smithi112 ceph-mon[34367]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:13.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:13 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:13.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:12:13.889 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:14.147 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:14 smithi145 ceph-mon[34901]: Deploying daemon mds.f on smithi145 2024-09-15T23:12:14.147 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:14 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.112:6834/2358660924,v1:172.21.15.112:6835/2358660924] up:boot 2024-09-15T23:12:14.147 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:14 smithi145 ceph-mon[34901]: fsmap 5 up:standby 2024-09-15T23:12:14.148 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:14 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T23:12:14.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:14 smithi002 ceph-mon[31019]: Deploying daemon mds.f on smithi145 2024-09-15T23:12:14.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:14 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.112:6834/2358660924,v1:172.21.15.112:6835/2358660924] up:boot 2024-09-15T23:12:14.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:14 smithi002 ceph-mon[31019]: fsmap 5 up:standby 2024-09-15T23:12:14.297 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:14 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T23:12:14.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.378+0000 7fe54a2e0640 1 -- 172.21.15.2:0/27574309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe544100a80 msgr2=0x7fe544100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.378+0000 7fe54a2e0640 1 --2- 172.21.15.2:0/27574309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe544100a80 0x7fe544100ee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009930 tx=0x7fe52c02a420 comp rx=0 tx=0).stop 2024-09-15T23:12:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.378+0000 7fe54a2e0640 1 -- 172.21.15.2:0/27574309 shutdown_connections 2024-09-15T23:12:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.378+0000 7fe54a2e0640 1 --2- 172.21.15.2:0/27574309 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe544101420 0x7fe54410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.378+0000 7fe54a2e0640 1 --2- 172.21.15.2:0/27574309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe544100a80 0x7fe544100ee0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.378+0000 7fe54a2e0640 1 --2- 172.21.15.2:0/27574309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe544106a80 0x7fe544106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.378+0000 7fe54a2e0640 1 -- 172.21.15.2:0/27574309 >> 172.21.15.2:0/27574309 conn(0x7fe5440fc7a0 msgr2=0x7fe5440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.378+0000 7fe54a2e0640 1 -- 172.21.15.2:0/27574309 shutdown_connections 2024-09-15T23:12:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.378+0000 7fe54a2e0640 1 -- 172.21.15.2:0/27574309 wait complete. 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.378+0000 7fe54a2e0640 1 Processor -- start 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.378+0000 7fe54a2e0640 1 -- start start 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe54a2e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe544100a80 0x7fe5441991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe54a2e0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe544101420 0x7fe5441996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe54a2e0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe544106a80 0x7fe5441a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe54a2e0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe544110d30 con 0x7fe544100a80 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe54a2e0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe544110bb0 con 0x7fe544101420 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe54a2e0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe544110eb0 con 0x7fe544106a80 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe543fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe544100a80 0x7fe5441991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe543fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe544100a80 0x7fe5441991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54282/0 (socket says 172.21.15.2:54282) 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe543fff640 1 -- 172.21.15.2:0/1746722866 learned_addr learned my addr 172.21.15.2:0/1746722866 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe54887d640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe544106a80 0x7fe5441a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe53bfff640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe544101420 0x7fe5441996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe543fff640 1 -- 172.21.15.2:0/1746722866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe544106a80 msgr2=0x7fe5441a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe543fff640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe544106a80 0x7fe5441a4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe543fff640 1 -- 172.21.15.2:0/1746722866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe544101420 msgr2=0x7fe5441996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe543fff640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe544101420 0x7fe5441996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe543fff640 1 -- 172.21.15.2:0/1746722866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5441a4760 con 0x7fe544100a80 2024-09-15T23:12:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe543fff640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe544100a80 0x7fe5441991a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe53400c920 tx=0x7fe53400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe541ffb640 1 -- 172.21.15.2:0/1746722866 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe534007c70 con 0x7fe544100a80 2024-09-15T23:12:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe541ffb640 1 -- 172.21.15.2:0/1746722866 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe534007e10 con 0x7fe544100a80 2024-09-15T23:12:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe54a2e0640 1 -- 172.21.15.2:0/1746722866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5441a4930 con 0x7fe544100a80 2024-09-15T23:12:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe541ffb640 1 -- 172.21.15.2:0/1746722866 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe534018820 con 0x7fe544100a80 2024-09-15T23:12:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.379+0000 7fe54a2e0640 1 -- 172.21.15.2:0/1746722866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5441a4e40 con 0x7fe544100a80 2024-09-15T23:12:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.380+0000 7fe54a2e0640 1 -- 172.21.15.2:0/1746722866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe544100ee0 con 0x7fe544100a80 2024-09-15T23:12:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.381+0000 7fe541ffb640 1 -- 172.21.15.2:0/1746722866 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe5340189c0 con 0x7fe544100a80 2024-09-15T23:12:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.382+0000 7fe541ffb640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe5300a32c0 0x7fe5300a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.382+0000 7fe541ffb640 1 -- 172.21.15.2:0/1746722866 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fe5340cf440 con 0x7fe544100a80 2024-09-15T23:12:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.382+0000 7fe53bfff640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe5300a32c0 0x7fe5300a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.383+0000 7fe53bfff640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe5300a32c0 0x7fe5300a5780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe52c006010 tx=0x7fe52c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:14.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.386+0000 7fe541ffb640 1 -- 172.21.15.2:0/1746722866 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe534014030 con 0x7fe544100a80 2024-09-15T23:12:14.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:14 smithi112 ceph-mon[34367]: Deploying daemon mds.f on smithi145 2024-09-15T23:12:14.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:14 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.112:6834/2358660924,v1:172.21.15.112:6835/2358660924] up:boot 2024-09-15T23:12:14.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:14 smithi112 ceph-mon[34367]: fsmap 5 up:standby 2024-09-15T23:12:14.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:14 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T23:12:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.597+0000 7fe54a2e0640 1 -- 172.21.15.2:0/1746722866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe544109040 con 0x7fe544100a80 2024-09-15T23:12:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.598+0000 7fe541ffb640 1 -- 172.21.15.2:0/1746722866 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7fe53409c600 con 0x7fe544100a80 2024-09-15T23:12:14.599 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:12:14.599 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"btime":"2024-09-15T23:12:13:006880+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-15T23:12:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2024-09-15T23:12:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.600+0000 7fe54a2e0640 1 -- 172.21.15.2:0/1746722866 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe5300a32c0 msgr2=0x7fe5300a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.600+0000 7fe54a2e0640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe5300a32c0 0x7fe5300a5780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe52c006010 tx=0x7fe52c000bc0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.600+0000 7fe54a2e0640 1 -- 172.21.15.2:0/1746722866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe544100a80 msgr2=0x7fe5441991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.600+0000 7fe54a2e0640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe544100a80 0x7fe5441991a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe53400c920 tx=0x7fe53400cde0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.600+0000 7fe54a2e0640 1 -- 172.21.15.2:0/1746722866 shutdown_connections 2024-09-15T23:12:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.600+0000 7fe54a2e0640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe5300a32c0 0x7fe5300a5780 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.600+0000 7fe54a2e0640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe544106a80 0x7fe5441a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.600+0000 7fe54a2e0640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe544101420 0x7fe5441996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.600+0000 7fe54a2e0640 1 --2- 172.21.15.2:0/1746722866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe544100a80 0x7fe5441991a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.600+0000 7fe54a2e0640 1 -- 172.21.15.2:0/1746722866 >> 172.21.15.2:0/1746722866 conn(0x7fe5440fc7a0 msgr2=0x7fe5440fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.600+0000 7fe54a2e0640 1 -- 172.21.15.2:0/1746722866 shutdown_connections 2024-09-15T23:12:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:14.600+0000 7fe54a2e0640 1 -- 172.21.15.2:0/1746722866 wait complete. 2024-09-15T23:12:14.707 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:12:14 smithi145 systemd[1]: Starting Ceph mds.f for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:12:15.078 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:15 smithi145 ceph-mon[34901]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:15.078 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:15 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1746722866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:15.078 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:12:14 smithi145 podman[64254]: 2024-09-15 23:12:14.718728157 +0000 UTC m=+0.016216296 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:12:15.078 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:12:14 smithi145 podman[64254]: 2024-09-15 23:12:14.958186413 +0000 UTC m=+0.255674542 container create 585e2dda576f9465b4b39bfde44b63209be341245833e66ffdd5f5f9f0bcac18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-15T23:12:15.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:15 smithi112 ceph-mon[34367]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:15.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:15 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1746722866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:15.274 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:15 smithi002 ceph-mon[31019]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:15.275 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:15 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1746722866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:15.457 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:12:15 smithi145 podman[64254]: 2024-09-15 23:12:15.202838657 +0000 UTC m=+0.500326798 container init 585e2dda576f9465b4b39bfde44b63209be341245833e66ffdd5f5f9f0bcac18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, io.buildah.version=1.37.2) 2024-09-15T23:12:15.457 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:12:15 smithi145 podman[64254]: 2024-09-15 23:12:15.205605757 +0000 UTC m=+0.503093889 container start 585e2dda576f9465b4b39bfde44b63209be341245833e66ffdd5f5f9f0bcac18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-f, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:12:15.457 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:12:15 smithi145 ceph-mds[64274]: -- 172.21.15.145:0/1987741278 <== mon.1 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558546795860 con 0x558546772800 2024-09-15T23:12:15.458 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:12:15 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-f[64270]: starting mds.f at 2024-09-15T23:12:15.458 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:12:15 smithi145 bash[64254]: 585e2dda576f9465b4b39bfde44b63209be341245833e66ffdd5f5f9f0bcac18 2024-09-15T23:12:15.458 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:12:15 smithi145 systemd[1]: Started Ceph mds.f for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:12:16.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:16 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:16.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:16 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:16.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:16 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:16.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:16 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:16.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:16 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:16.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:16 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:16.709 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:16 smithi145 ceph-mon[34901]: Deploying daemon mds.c on smithi145 2024-09-15T23:12:16.709 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:16 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.145:6834/91315913,v1:172.21.15.145:6835/91315913] up:boot 2024-09-15T23:12:16.709 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:16 smithi145 ceph-mon[34901]: fsmap 6 up:standby 2024-09-15T23:12:16.709 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:16 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T23:12:16.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:16 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:16.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:16 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:16.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:16 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:16.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:16 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:16.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:16 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:16.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:16 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:16.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:16 smithi112 ceph-mon[34367]: Deploying daemon mds.c on smithi145 2024-09-15T23:12:16.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:16 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.145:6834/91315913,v1:172.21.15.145:6835/91315913] up:boot 2024-09-15T23:12:16.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:16 smithi112 ceph-mon[34367]: fsmap 6 up:standby 2024-09-15T23:12:16.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:16 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T23:12:16.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:16 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:16.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:16 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:16.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:16 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:16.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:16 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:16.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:16 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:16.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:16 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:16.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:16 smithi002 ceph-mon[31019]: Deploying daemon mds.c on smithi145 2024-09-15T23:12:16.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:16 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.145:6834/91315913,v1:172.21.15.145:6835/91315913] up:boot 2024-09-15T23:12:16.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:16 smithi002 ceph-mon[31019]: fsmap 6 up:standby 2024-09-15T23:12:16.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:16 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T23:12:17.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:12:17.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:17 smithi145 ceph-mon[34901]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:17.554 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:17.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:17 smithi002 ceph-mon[31019]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:17.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:17 smithi112 ceph-mon[34367]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:18.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.056+0000 7fa5cd46d640 1 -- 172.21.15.2:0/4173140280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5c8100a80 msgr2=0x7fa5c8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.056+0000 7fa5cd46d640 1 --2- 172.21.15.2:0/4173140280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5c8100a80 0x7fa5c8100ee0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009930 tx=0x7fa5b002a420 comp rx=0 tx=0).stop 2024-09-15T23:12:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.056+0000 7fa5cd46d640 1 -- 172.21.15.2:0/4173140280 shutdown_connections 2024-09-15T23:12:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.056+0000 7fa5cd46d640 1 --2- 172.21.15.2:0/4173140280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c8101420 0x7fa5c810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.056+0000 7fa5cd46d640 1 --2- 172.21.15.2:0/4173140280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5c8100a80 0x7fa5c8100ee0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.056+0000 7fa5cd46d640 1 --2- 172.21.15.2:0/4173140280 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5c8106a80 0x7fa5c8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.056+0000 7fa5cd46d640 1 -- 172.21.15.2:0/4173140280 >> 172.21.15.2:0/4173140280 conn(0x7fa5c80fc7a0 msgr2=0x7fa5c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.056+0000 7fa5cd46d640 1 -- 172.21.15.2:0/4173140280 shutdown_connections 2024-09-15T23:12:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.056+0000 7fa5cd46d640 1 -- 172.21.15.2:0/4173140280 wait complete. 2024-09-15T23:12:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.056+0000 7fa5cd46d640 1 Processor -- start 2024-09-15T23:12:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5cd46d640 1 -- start start 2024-09-15T23:12:18.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5cd46d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5c8100a80 0x7fa5c810e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:18.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5cd46d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c8101420 0x7fa5c810e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:18.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5cd46d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5c8106a80 0x7fa5c810ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:18.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5cd46d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c8111e90 con 0x7fa5c8100a80 2024-09-15T23:12:18.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5cd46d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c8111d10 con 0x7fa5c8101420 2024-09-15T23:12:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5cd46d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c8112010 con 0x7fa5c8106a80 2024-09-15T23:12:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5c8100a80 0x7fa5c810e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5c8100a80 0x7fa5c810e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43372/0 (socket says 172.21.15.2:43372) 2024-09-15T23:12:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5c6ffd640 1 -- 172.21.15.2:0/3392327693 learned_addr learned my addr 172.21.15.2:0/3392327693 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5bffff640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c8101420 0x7fa5c810e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5c77fe640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5c8106a80 0x7fa5c810ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5c6ffd640 1 -- 172.21.15.2:0/3392327693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5c8106a80 msgr2=0x7fa5c810ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5c6ffd640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5c8106a80 0x7fa5c810ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5c6ffd640 1 -- 172.21.15.2:0/3392327693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c8101420 msgr2=0x7fa5c810e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5c6ffd640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c8101420 0x7fa5c810e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5c6ffd640 1 -- 172.21.15.2:0/3392327693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c81a68d0 con 0x7fa5c8100a80 2024-09-15T23:12:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.057+0000 7fa5c6ffd640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5c8100a80 0x7fa5c810e3e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800e9f0 tx=0x7fa5b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:18.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.058+0000 7fa5c4ff9640 1 -- 172.21.15.2:0/3392327693 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800cd80 con 0x7fa5c8100a80 2024-09-15T23:12:18.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.058+0000 7fa5cd46d640 1 -- 172.21.15.2:0/3392327693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c81a6bc0 con 0x7fa5c8100a80 2024-09-15T23:12:18.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.058+0000 7fa5c4ff9640 1 -- 172.21.15.2:0/3392327693 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5b80054d0 con 0x7fa5c8100a80 2024-09-15T23:12:18.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.058+0000 7fa5c4ff9640 1 -- 172.21.15.2:0/3392327693 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8010490 con 0x7fa5c8100a80 2024-09-15T23:12:18.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.058+0000 7fa5cd46d640 1 -- 172.21.15.2:0/3392327693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c81a7080 con 0x7fa5c8100a80 2024-09-15T23:12:18.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.059+0000 7fa5cd46d640 1 -- 172.21.15.2:0/3392327693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c8100ee0 con 0x7fa5c8100a80 2024-09-15T23:12:18.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.060+0000 7fa5c4ff9640 1 -- 172.21.15.2:0/3392327693 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa5b8005020 con 0x7fa5c8100a80 2024-09-15T23:12:18.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.060+0000 7fa5c4ff9640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa5b40a3240 0x7fa5b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:18.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.061+0000 7fa5bffff640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa5b40a3240 0x7fa5b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:18.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.061+0000 7fa5c4ff9640 1 -- 172.21.15.2:0/3392327693 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fa5b80cf7f0 con 0x7fa5c8100a80 2024-09-15T23:12:18.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.061+0000 7fa5bffff640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa5b40a3240 0x7fa5b40a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0031440 tx=0x7fa5b0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.065+0000 7fa5c4ff9640 1 -- 172.21.15.2:0/3392327693 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5b809c9b0 con 0x7fa5c8100a80 2024-09-15T23:12:18.207 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 15 23:12:17 smithi145 systemd[1]: Started Ceph mds.c for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:12:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.276+0000 7fa5cd46d640 1 -- 172.21.15.2:0/3392327693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5c8108ff0 con 0x7fa5c8100a80 2024-09-15T23:12:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.276+0000 7fa5c4ff9640 1 -- 172.21.15.2:0/3392327693 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5560 (secure 0 0 0) 0x7fa5b8096e20 con 0x7fa5c8100a80 2024-09-15T23:12:18.278 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:12:18.278 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"btime":"2024-09-15T23:12:16:019226+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/91315913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":91315913},{"type":"v1","addr":"172.21.15.145:6835","nonce":91315913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-15T23:12:18.278 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-09-15T23:12:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.278+0000 7fa5cd46d640 1 -- 172.21.15.2:0/3392327693 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa5b40a3240 msgr2=0x7fa5b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.278+0000 7fa5cd46d640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa5b40a3240 0x7fa5b40a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0031440 tx=0x7fa5b0005a20 comp rx=0 tx=0).stop 2024-09-15T23:12:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.278+0000 7fa5cd46d640 1 -- 172.21.15.2:0/3392327693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5c8100a80 msgr2=0x7fa5c810e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.278+0000 7fa5cd46d640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5c8100a80 0x7fa5c810e3e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800e9f0 tx=0x7fa5b800edf0 comp rx=0 tx=0).stop 2024-09-15T23:12:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.278+0000 7fa5cd46d640 1 -- 172.21.15.2:0/3392327693 shutdown_connections 2024-09-15T23:12:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.278+0000 7fa5cd46d640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa5b40a3240 0x7fa5b40a5700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.278+0000 7fa5cd46d640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa5c8106a80 0x7fa5c810ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.278+0000 7fa5cd46d640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5c8101420 0x7fa5c810e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.278+0000 7fa5cd46d640 1 --2- 172.21.15.2:0/3392327693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5c8100a80 0x7fa5c810e3e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.278+0000 7fa5cd46d640 1 -- 172.21.15.2:0/3392327693 >> 172.21.15.2:0/3392327693 conn(0x7fa5c80fc7a0 msgr2=0x7fa5c80fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.278+0000 7fa5cd46d640 1 -- 172.21.15.2:0/3392327693 shutdown_connections 2024-09-15T23:12:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:18.278+0000 7fa5cd46d640 1 -- 172.21.15.2:0/3392327693 wait complete. 2024-09-15T23:12:19.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:18 smithi112 ceph-mon[34367]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:19.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:18 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:19.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:18 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:19.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:18 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:19.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:18 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:19.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:18 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:19.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:18 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:19.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:18 smithi112 ceph-mon[34367]: Deploying daemon mds.h on smithi112 2024-09-15T23:12:19.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:18 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3392327693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:19.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:18 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.145:6836/1066293931,v1:172.21.15.145:6837/1066293931] up:boot 2024-09-15T23:12:19.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:18 smithi112 ceph-mon[34367]: fsmap 7 up:standby 2024-09-15T23:12:19.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:18 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T23:12:19.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:18 smithi002 ceph-mon[31019]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:19.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:18 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:19.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:18 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:19.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:18 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:19.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:18 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:19.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:18 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:19.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:18 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:19.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:18 smithi002 ceph-mon[31019]: Deploying daemon mds.h on smithi112 2024-09-15T23:12:19.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:18 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3392327693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:19.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:18 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.145:6836/1066293931,v1:172.21.15.145:6837/1066293931] up:boot 2024-09-15T23:12:19.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:18 smithi002 ceph-mon[31019]: fsmap 7 up:standby 2024-09-15T23:12:19.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:18 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T23:12:19.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:18 smithi145 ceph-mon[34901]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:19.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:18 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:19.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:18 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:19.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:18 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:19.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:18 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:19.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:18 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:19.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:18 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:19.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:18 smithi145 ceph-mon[34901]: Deploying daemon mds.h on smithi112 2024-09-15T23:12:19.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:18 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3392327693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:19.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:18 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.145:6836/1066293931,v1:172.21.15.145:6837/1066293931] up:boot 2024-09-15T23:12:19.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:18 smithi145 ceph-mon[34901]: fsmap 7 up:standby 2024-09-15T23:12:19.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:18 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T23:12:20.246 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:12:20 smithi112 systemd[1]: Starting Ceph mds.h for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:12:20.536 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:12:20 smithi112 podman[64235]: 2024-09-15 23:12:20.157748498 +0000 UTC m=+0.016027665 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:12:20.536 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:12:20 smithi112 podman[64235]: 2024-09-15 23:12:20.274966013 +0000 UTC m=+0.133245181 container create 5d49d742211b81ea0a0f8ed618277363d8917c2b2ea3fdf4e2cdccebbc6a1471 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-h, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:12:20.536 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:12:20 smithi112 podman[64235]: 2024-09-15 23:12:20.536092549 +0000 UTC m=+0.394371718 container init 5d49d742211b81ea0a0f8ed618277363d8917c2b2ea3fdf4e2cdccebbc6a1471 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-h, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-15T23:12:20.983 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:12:20 smithi112 podman[64235]: 2024-09-15 23:12:20.538974753 +0000 UTC m=+0.397253922 container start 5d49d742211b81ea0a0f8ed618277363d8917c2b2ea3fdf4e2cdccebbc6a1471 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-15T23:12:20.983 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:12:20 smithi112 ceph-mds[64254]: -- 172.21.15.112:0/3289005055 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a9f168d860 con 0x55a9f166b000 2024-09-15T23:12:20.983 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:12:20 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-h[64250]: starting mds.h at 2024-09-15T23:12:20.983 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:12:20 smithi112 bash[64235]: 5d49d742211b81ea0a0f8ed618277363d8917c2b2ea3fdf4e2cdccebbc6a1471 2024-09-15T23:12:20.983 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:12:20 smithi112 systemd[1]: Started Ceph mds.h for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:12:20.983 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:12:21.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:20 smithi112 ceph-mon[34367]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:21.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:20 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:21.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:20 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:21.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:20 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:21.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:20 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:21.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:20 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:21.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:20 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:21.251 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:20 smithi002 ceph-mon[31019]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:20 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:20 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:20 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:20 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:20 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:20 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:21.317 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:20 smithi145 ceph-mon[34901]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:21.317 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:20 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:21.317 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:20 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:21.317 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:20 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:21.317 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:20 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:21.317 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:20 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:21.317 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:20 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:21.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.728+0000 7fb2e0875640 1 -- 172.21.15.2:0/161647915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc1037a0 msgr2=0x7fb2dc10bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.728+0000 7fb2e0875640 1 --2- 172.21.15.2:0/161647915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc1037a0 0x7fb2dc10bc00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009900 tx=0x7fb2d002a410 comp rx=0 tx=0).stop 2024-09-15T23:12:21.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.728+0000 7fb2e0875640 1 -- 172.21.15.2:0/161647915 shutdown_connections 2024-09-15T23:12:21.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.728+0000 7fb2e0875640 1 --2- 172.21.15.2:0/161647915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2dc10c2f0 0x7fb2dc10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.728+0000 7fb2e0875640 1 --2- 172.21.15.2:0/161647915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc1037a0 0x7fb2dc10bc00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.728+0000 7fb2e0875640 1 --2- 172.21.15.2:0/161647915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2dc102df0 0x7fb2dc1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.728+0000 7fb2e0875640 1 -- 172.21.15.2:0/161647915 >> 172.21.15.2:0/161647915 conn(0x7fb2dc0fc7d0 msgr2=0x7fb2dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:21.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.728+0000 7fb2e0875640 1 -- 172.21.15.2:0/161647915 shutdown_connections 2024-09-15T23:12:21.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.728+0000 7fb2e0875640 1 -- 172.21.15.2:0/161647915 wait complete. 2024-09-15T23:12:21.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2e0875640 1 Processor -- start 2024-09-15T23:12:21.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2e0875640 1 -- start start 2024-09-15T23:12:21.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2e0875640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2dc102df0 0x7fb2dc1a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2e0875640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc1037a0 0x7fb2dc1a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2e0875640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2dc10c2f0 0x7fb2dc19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2e0875640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc111f80 con 0x7fb2dc1037a0 2024-09-15T23:12:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2e0875640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc111e00 con 0x7fb2dc10c2f0 2024-09-15T23:12:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2e0875640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb2dc112100 con 0x7fb2dc102df0 2024-09-15T23:12:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2d9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc1037a0 0x7fb2dc1a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2d9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc1037a0 0x7fb2dc1a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43390/0 (socket says 172.21.15.2:43390) 2024-09-15T23:12:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2d9d9b640 1 -- 172.21.15.2:0/681301717 learned_addr learned my addr 172.21.15.2:0/681301717 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2da59c640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2dc102df0 0x7fb2dc1a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2dad9d640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2dc10c2f0 0x7fb2dc19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2d9d9b640 1 -- 172.21.15.2:0/681301717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2dc102df0 msgr2=0x7fb2dc1a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.729+0000 7fb2d9d9b640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2dc102df0 0x7fb2dc1a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.730+0000 7fb2d9d9b640 1 -- 172.21.15.2:0/681301717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2dc10c2f0 msgr2=0x7fb2dc19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.730+0000 7fb2d9d9b640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2dc10c2f0 0x7fb2dc19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.730+0000 7fb2d9d9b640 1 -- 172.21.15.2:0/681301717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2dc19ad00 con 0x7fb2dc1037a0 2024-09-15T23:12:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.730+0000 7fb2d9d9b640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc1037a0 0x7fb2dc1a0950 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb2d002a930 tx=0x7fb2d0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:21.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.730+0000 7fb2cb7fe640 1 -- 172.21.15.2:0/681301717 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d003f030 con 0x7fb2dc1037a0 2024-09-15T23:12:21.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.730+0000 7fb2cb7fe640 1 -- 172.21.15.2:0/681301717 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2d0003aa0 con 0x7fb2dc1037a0 2024-09-15T23:12:21.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.730+0000 7fb2e0875640 1 -- 172.21.15.2:0/681301717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2dc19af90 con 0x7fb2dc1037a0 2024-09-15T23:12:21.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.730+0000 7fb2cb7fe640 1 -- 172.21.15.2:0/681301717 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0035070 con 0x7fb2dc1037a0 2024-09-15T23:12:21.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.730+0000 7fb2e0875640 1 -- 172.21.15.2:0/681301717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2dc1a72e0 con 0x7fb2dc1037a0 2024-09-15T23:12:21.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.731+0000 7fb2e0875640 1 -- 172.21.15.2:0/681301717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2dc1031d0 con 0x7fb2dc1037a0 2024-09-15T23:12:21.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.732+0000 7fb2cb7fe640 1 -- 172.21.15.2:0/681301717 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fb2d0042030 con 0x7fb2dc1037a0 2024-09-15T23:12:21.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.733+0000 7fb2cb7fe640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fb2c40a3240 0x7fb2c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.733+0000 7fb2da59c640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fb2c40a3240 0x7fb2c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.733+0000 7fb2cb7fe640 1 -- 172.21.15.2:0/681301717 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fb2d00efc90 con 0x7fb2dc1037a0 2024-09-15T23:12:21.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.733+0000 7fb2da59c640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fb2c40a3240 0x7fb2c40a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009bd0 tx=0x7fb2cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:21.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.737+0000 7fb2cb7fe640 1 -- 172.21.15.2:0/681301717 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb2d00bc760 con 0x7fb2dc1037a0 2024-09-15T23:12:21.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.949+0000 7fb2e0875640 1 -- 172.21.15.2:0/681301717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2dc1096c0 con 0x7fb2dc1037a0 2024-09-15T23:12:21.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.949+0000 7fb2cb7fe640 1 -- 172.21.15.2:0/681301717 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7213 (secure 0 0 0) 0x7fb2d00c0a60 con 0x7fb2dc1037a0 2024-09-15T23:12:21.951 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:12:21.951 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"btime":"2024-09-15T23:12:20:976844+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/91315913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":91315913},{"type":"v1","addr":"172.21.15.145:6835","nonce":91315913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1066293931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":1066293931},{"type":"v1","addr":"172.21.15.145:6837","nonce":1066293931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/418078184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":418078184},{"type":"v1","addr":"172.21.15.112:6837","nonce":418078184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-15T23:12:21.951 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-09-15T23:12:21.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.951+0000 7fb2e0875640 1 -- 172.21.15.2:0/681301717 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fb2c40a3240 msgr2=0x7fb2c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.951+0000 7fb2e0875640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fb2c40a3240 0x7fb2c40a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009bd0 tx=0x7fb2cc005f90 comp rx=0 tx=0).stop 2024-09-15T23:12:21.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.951+0000 7fb2e0875640 1 -- 172.21.15.2:0/681301717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc1037a0 msgr2=0x7fb2dc1a0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.951+0000 7fb2e0875640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc1037a0 0x7fb2dc1a0950 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb2d002a930 tx=0x7fb2d0004040 comp rx=0 tx=0).stop 2024-09-15T23:12:21.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.952+0000 7fb2e0875640 1 -- 172.21.15.2:0/681301717 shutdown_connections 2024-09-15T23:12:21.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.952+0000 7fb2e0875640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fb2c40a3240 0x7fb2c40a5700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.952+0000 7fb2e0875640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2dc10c2f0 0x7fb2dc19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.952+0000 7fb2e0875640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2dc1037a0 0x7fb2dc1a0950 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.952+0000 7fb2e0875640 1 --2- 172.21.15.2:0/681301717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2dc102df0 0x7fb2dc1a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.952+0000 7fb2e0875640 1 -- 172.21.15.2:0/681301717 >> 172.21.15.2:0/681301717 conn(0x7fb2dc0fc7d0 msgr2=0x7fb2dc1011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:21.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.952+0000 7fb2e0875640 1 -- 172.21.15.2:0/681301717 shutdown_connections 2024-09-15T23:12:21.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:21.952+0000 7fb2e0875640 1 -- 172.21.15.2:0/681301717 wait complete. 2024-09-15T23:12:22.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:21 smithi112 ceph-mon[34367]: Deploying daemon mds.i on smithi145 2024-09-15T23:12:22.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:21 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.112:6836/418078184,v1:172.21.15.112:6837/418078184] up:boot 2024-09-15T23:12:22.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:21 smithi112 ceph-mon[34367]: fsmap 8 up:standby 2024-09-15T23:12:22.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:21 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T23:12:22.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:21 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/681301717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:22.299 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:21 smithi145 ceph-mon[34901]: Deploying daemon mds.i on smithi145 2024-09-15T23:12:22.299 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:21 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.112:6836/418078184,v1:172.21.15.112:6837/418078184] up:boot 2024-09-15T23:12:22.299 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:21 smithi145 ceph-mon[34901]: fsmap 8 up:standby 2024-09-15T23:12:22.299 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:21 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T23:12:22.299 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:21 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/681301717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:22.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:21 smithi002 ceph-mon[31019]: Deploying daemon mds.i on smithi145 2024-09-15T23:12:22.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:21 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.112:6836/418078184,v1:172.21.15.112:6837/418078184] up:boot 2024-09-15T23:12:22.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:21 smithi002 ceph-mon[31019]: fsmap 8 up:standby 2024-09-15T23:12:22.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:21 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T23:12:22.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:21 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/681301717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:22.958 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:12:22 smithi145 podman[64859]: 2024-09-15 23:12:22.902119786 +0000 UTC m=+0.135035406 container create f9d47912584784ff41886c2d3c69028b955a07083e3804a0c31b9136b18b1b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-i, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-09-15T23:12:23.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:22 smithi112 ceph-mon[34367]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:22 smithi002 ceph-mon[31019]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:23.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:22 smithi145 ceph-mon[34901]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:23.457 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:12:23 smithi145 podman[64859]: 2024-09-15 23:12:23.121599931 +0000 UTC m=+0.354515501 container init f9d47912584784ff41886c2d3c69028b955a07083e3804a0c31b9136b18b1b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:12:23.458 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:12:23 smithi145 podman[64859]: 2024-09-15 23:12:23.124662978 +0000 UTC m=+0.357578543 container start f9d47912584784ff41886c2d3c69028b955a07083e3804a0c31b9136b18b1b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-15T23:12:23.458 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:12:23 smithi145 ceph-mds[64878]: -- 172.21.15.145:0/725395075 <== mon.1 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d560e3860 con 0x562d560c1400 2024-09-15T23:12:23.458 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:12:23 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-i[64874]: starting mds.i at 2024-09-15T23:12:23.458 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:12:23 smithi145 bash[64859]: f9d47912584784ff41886c2d3c69028b955a07083e3804a0c31b9136b18b1b57 2024-09-15T23:12:23.458 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:12:23 smithi145 systemd[1]: Started Ceph mds.i for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:12:24.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:24 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:24.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:24 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:24.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:24 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:24.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:24 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:24.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:24 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:24.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:24 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:24.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:24 smithi002 ceph-mon[31019]: Deploying daemon mds.g on smithi002 2024-09-15T23:12:24.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:24 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.145:6838/3930825714,v1:172.21.15.145:6839/3930825714] up:boot 2024-09-15T23:12:24.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:24 smithi002 ceph-mon[31019]: fsmap 9 up:standby 2024-09-15T23:12:24.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:24 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:12:24.677 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:12:24.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:24 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:24.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:24 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:24.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:24 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:24.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:24 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:24.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:24 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:24.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:24 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:24.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:24 smithi145 ceph-mon[34901]: Deploying daemon mds.g on smithi002 2024-09-15T23:12:24.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:24 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.145:6838/3930825714,v1:172.21.15.145:6839/3930825714] up:boot 2024-09-15T23:12:24.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:24 smithi145 ceph-mon[34901]: fsmap 9 up:standby 2024-09-15T23:12:24.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:24 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:12:24.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:24 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:24.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:24 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:24.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:24 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:24.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:24 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:24.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:24 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:24.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:24 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:24.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:24 smithi112 ceph-mon[34367]: Deploying daemon mds.g on smithi002 2024-09-15T23:12:24.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:24 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.145:6838/3930825714,v1:172.21.15.145:6839/3930825714] up:boot 2024-09-15T23:12:24.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:24 smithi112 ceph-mon[34367]: fsmap 9 up:standby 2024-09-15T23:12:24.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:24 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:12:24.960 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:25.432 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:25 smithi002 ceph-mon[31019]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.514+0000 7f0c601e3640 1 -- 172.21.15.2:0/891078309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58106f10 msgr2=0x7f0c5810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.514+0000 7f0c601e3640 1 --2- 172.21.15.2:0/891078309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58106f10 0x7f0c5810ea90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009ca0 tx=0x7f0c5002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.514+0000 7f0c601e3640 1 -- 172.21.15.2:0/891078309 shutdown_connections 2024-09-15T23:12:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.514+0000 7f0c601e3640 1 --2- 172.21.15.2:0/891078309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58106f10 0x7f0c5810ea90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.514+0000 7f0c601e3640 1 --2- 172.21.15.2:0/891078309 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c58102790 0x7f0c581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.514+0000 7f0c601e3640 1 --2- 172.21.15.2:0/891078309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c58101de0 0x7f0c581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.514+0000 7f0c601e3640 1 -- 172.21.15.2:0/891078309 >> 172.21.15.2:0/891078309 conn(0x7f0c580fd8c0 msgr2=0x7f0c580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.514+0000 7f0c601e3640 1 -- 172.21.15.2:0/891078309 shutdown_connections 2024-09-15T23:12:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.514+0000 7f0c601e3640 1 -- 172.21.15.2:0/891078309 wait complete. 2024-09-15T23:12:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.515+0000 7f0c601e3640 1 Processor -- start 2024-09-15T23:12:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.515+0000 7f0c601e3640 1 -- start start 2024-09-15T23:12:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.515+0000 7f0c601e3640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c58101de0 0x7f0c580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.515+0000 7f0c601e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58102790 0x7f0c58074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.515+0000 7f0c601e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c58106f10 0x7f0c58074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.515+0000 7f0c601e3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c58111e70 con 0x7f0c58102790 2024-09-15T23:12:25.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.515+0000 7f0c601e3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0c58111cf0 con 0x7f0c58106f10 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.515+0000 7f0c601e3640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0c58111ff0 con 0x7f0c58101de0 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.515+0000 7f0c5d77e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58102790 0x7f0c58074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.515+0000 7f0c5d77e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58102790 0x7f0c58074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43414/0 (socket says 172.21.15.2:43414) 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.515+0000 7f0c5d77e640 1 -- 172.21.15.2:0/562081796 learned_addr learned my addr 172.21.15.2:0/562081796 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.515+0000 7f0c5e780640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c58106f10 0x7f0c58074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.515+0000 7f0c5df7f640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c58101de0 0x7f0c580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.516+0000 7f0c5d77e640 1 -- 172.21.15.2:0/562081796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c58101de0 msgr2=0x7f0c580744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.516+0000 7f0c5d77e640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c58101de0 0x7f0c580744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.516+0000 7f0c5d77e640 1 -- 172.21.15.2:0/562081796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c58106f10 msgr2=0x7f0c58074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.516+0000 7f0c5d77e640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c58106f10 0x7f0c58074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.516+0000 7f0c5d77e640 1 -- 172.21.15.2:0/562081796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c581a67d0 con 0x7f0c58102790 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.516+0000 7f0c5df7f640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c58101de0 0x7f0c580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.516+0000 7f0c5d77e640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58102790 0x7f0c58074a30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800d950 tx=0x7f0c4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:25.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.516+0000 7f0c4effd640 1 -- 172.21.15.2:0/562081796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48017030 con 0x7f0c58102790 2024-09-15T23:12:25.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.516+0000 7f0c4effd640 1 -- 172.21.15.2:0/562081796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c48004020 con 0x7f0c58102790 2024-09-15T23:12:25.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.516+0000 7f0c4effd640 1 -- 172.21.15.2:0/562081796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480047a0 con 0x7f0c58102790 2024-09-15T23:12:25.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.516+0000 7f0c601e3640 1 -- 172.21.15.2:0/562081796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c581a6ac0 con 0x7f0c58102790 2024-09-15T23:12:25.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.516+0000 7f0c601e3640 1 -- 172.21.15.2:0/562081796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c581a7050 con 0x7f0c58102790 2024-09-15T23:12:25.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.517+0000 7f0c601e3640 1 -- 172.21.15.2:0/562081796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c581021c0 con 0x7f0c58102790 2024-09-15T23:12:25.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.518+0000 7f0c4effd640 1 -- 172.21.15.2:0/562081796 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0c480041d0 con 0x7f0c58102790 2024-09-15T23:12:25.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.519+0000 7f0c4effd640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0c440a32c0 0x7f0c440a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.519+0000 7f0c5df7f640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0c440a32c0 0x7f0c440a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.519+0000 7f0c4effd640 1 -- 172.21.15.2:0/562081796 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f0c480cee20 con 0x7f0c58102790 2024-09-15T23:12:25.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.519+0000 7f0c5df7f640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0c440a32c0 0x7f0c440a5780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009c20 tx=0x7f0c54005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:25.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.523+0000 7f0c4effd640 1 -- 172.21.15.2:0/562081796 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0c4809bfe0 con 0x7f0c58102790 2024-09-15T23:12:25.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:25 smithi145 ceph-mon[34901]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:25.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:25 smithi112 ceph-mon[34367]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:25.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.751+0000 7f0c601e3640 1 -- 172.21.15.2:0/562081796 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c58109bc0 con 0x7f0c58102790 2024-09-15T23:12:25.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.752+0000 7f0c4effd640 1 -- 172.21.15.2:0/562081796 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8043 (secure 0 0 0) 0x7f0c4809b8e0 con 0x7f0c58102790 2024-09-15T23:12:25.753 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:12:25.753 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"btime":"2024-09-15T23:12:23:988983+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/91315913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":91315913},{"type":"v1","addr":"172.21.15.145:6835","nonce":91315913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1066293931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":1066293931},{"type":"v1","addr":"172.21.15.145:6837","nonce":1066293931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/418078184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":418078184},{"type":"v1","addr":"172.21.15.112:6837","nonce":418078184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6839/3930825714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3930825714},{"type":"v1","addr":"172.21.15.145:6839","nonce":3930825714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-15T23:12:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 10 2024-09-15T23:12:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.754+0000 7f0c601e3640 1 -- 172.21.15.2:0/562081796 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0c440a32c0 msgr2=0x7f0c440a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.754+0000 7f0c601e3640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0c440a32c0 0x7f0c440a5780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009c20 tx=0x7f0c54005f90 comp rx=0 tx=0).stop 2024-09-15T23:12:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.754+0000 7f0c601e3640 1 -- 172.21.15.2:0/562081796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58102790 msgr2=0x7f0c58074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.754+0000 7f0c601e3640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58102790 0x7f0c58074a30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800d950 tx=0x7f0c4800de10 comp rx=0 tx=0).stop 2024-09-15T23:12:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.754+0000 7f0c601e3640 1 -- 172.21.15.2:0/562081796 shutdown_connections 2024-09-15T23:12:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.754+0000 7f0c601e3640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f0c440a32c0 0x7f0c440a5780 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.754+0000 7f0c601e3640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c58106f10 0x7f0c58074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.754+0000 7f0c601e3640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c58102790 0x7f0c58074a30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.754+0000 7f0c601e3640 1 --2- 172.21.15.2:0/562081796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c58101de0 0x7f0c580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.754+0000 7f0c601e3640 1 -- 172.21.15.2:0/562081796 >> 172.21.15.2:0/562081796 conn(0x7f0c580fd8c0 msgr2=0x7f0c580fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.754+0000 7f0c601e3640 1 -- 172.21.15.2:0/562081796 shutdown_connections 2024-09-15T23:12:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:25.754+0000 7f0c601e3640 1 -- 172.21.15.2:0/562081796 wait complete. 2024-09-15T23:12:26.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:26 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/562081796' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:26.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:26 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/562081796' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:26.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:26 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/562081796' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:27 smithi002 ceph-mon[31019]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:27 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.2:6838/1051460220,v1:172.21.15.2:6839/1051460220] up:boot 2024-09-15T23:12:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:27 smithi002 ceph-mon[31019]: fsmap 10 up:standby 2024-09-15T23:12:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:27 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T23:12:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:27 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:27.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:27 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:27.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:27 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:27.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:27 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:27.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:27 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:27.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:27 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:27.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:27 smithi002 ceph-mon[31019]: Deploying daemon mds.a on smithi002 2024-09-15T23:12:27.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:27 smithi145 ceph-mon[34901]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:27.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:27 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.2:6838/1051460220,v1:172.21.15.2:6839/1051460220] up:boot 2024-09-15T23:12:27.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:27 smithi145 ceph-mon[34901]: fsmap 10 up:standby 2024-09-15T23:12:27.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:27 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T23:12:27.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:27 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:27.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:27 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:27.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:27 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:27.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:27 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:27.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:27 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:27.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:27 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:27.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:27 smithi145 ceph-mon[34901]: Deploying daemon mds.a on smithi002 2024-09-15T23:12:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:27 smithi112 ceph-mon[34367]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:27 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.2:6838/1051460220,v1:172.21.15.2:6839/1051460220] up:boot 2024-09-15T23:12:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:27 smithi112 ceph-mon[34367]: fsmap 10 up:standby 2024-09-15T23:12:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:27 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T23:12:27.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:27 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:27.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:27 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:27.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:27 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:27.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:27 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:27.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:27 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:27.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:27 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:27.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:27 smithi112 ceph-mon[34367]: Deploying daemon mds.a on smithi002 2024-09-15T23:12:28.700 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:12:28 smithi002 podman[69435]: 2024-09-15 23:12:28.700042539 +0000 UTC m=+0.129479557 container create 6352e2a1cb3bb5c9cb9091e1aa6083eafc14a8990e0b5b5a393871a5d7a641bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:12:28.769 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:12:28.965 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:12:28 smithi002 podman[69435]: 2024-09-15 23:12:28.935883856 +0000 UTC m=+0.365320870 container init 6352e2a1cb3bb5c9cb9091e1aa6083eafc14a8990e0b5b5a393871a5d7a641bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:12:28.965 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:12:28 smithi002 podman[69435]: 2024-09-15 23:12:28.939403361 +0000 UTC m=+0.368840373 container start 6352e2a1cb3bb5c9cb9091e1aa6083eafc14a8990e0b5b5a393871a5d7a641bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-15T23:12:29.122 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:29.244 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:12:28 smithi002 ceph-mds[69472]: -- 172.21.15.2:0/259082174 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55edbfa15860 con 0x55edbf9f3000 2024-09-15T23:12:29.244 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:12:28 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-a[69468]: starting mds.a at 2024-09-15T23:12:29.244 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:12:29 smithi002 bash[69435]: 6352e2a1cb3bb5c9cb9091e1aa6083eafc14a8990e0b5b5a393871a5d7a641bb 2024-09-15T23:12:29.244 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:12:29 smithi002 systemd[1]: Started Ceph mds.a for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:12:29.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:29 smithi002 ceph-mon[31019]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:29.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:29 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:29.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:29 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:29.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:29 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:29.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:29 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:29.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:29 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:29.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:29 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:29.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.604+0000 7f9156397640 1 -- 172.21.15.2:0/100918324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9150101420 msgr2=0x7f915010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:29.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.604+0000 7f9156397640 1 --2- 172.21.15.2:0/100918324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9150101420 0x7f915010d950 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9148009cd0 tx=0x7f914802a8e0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.604+0000 7f9156397640 1 -- 172.21.15.2:0/100918324 shutdown_connections 2024-09-15T23:12:29.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.604+0000 7f9156397640 1 --2- 172.21.15.2:0/100918324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9150101420 0x7f915010d950 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.604+0000 7f9156397640 1 --2- 172.21.15.2:0/100918324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9150100a80 0x7f9150100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.604+0000 7f9156397640 1 --2- 172.21.15.2:0/100918324 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9150106a80 0x7f9150106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.604+0000 7f9156397640 1 -- 172.21.15.2:0/100918324 >> 172.21.15.2:0/100918324 conn(0x7f91500fc7a0 msgr2=0x7f91500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.604+0000 7f9156397640 1 -- 172.21.15.2:0/100918324 shutdown_connections 2024-09-15T23:12:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.604+0000 7f9156397640 1 -- 172.21.15.2:0/100918324 wait complete. 2024-09-15T23:12:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.605+0000 7f9156397640 1 Processor -- start 2024-09-15T23:12:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.605+0000 7f9156397640 1 -- start start 2024-09-15T23:12:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.605+0000 7f9156397640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9150100a80 0x7f91501982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.605+0000 7f9156397640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9150101420 0x7f9150198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.605+0000 7f9156397640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9150106a80 0x7f915019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:29.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.605+0000 7f9156397640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9150110d30 con 0x7f9150106a80 2024-09-15T23:12:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.605+0000 7f9156397640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9150110bb0 con 0x7f9150101420 2024-09-15T23:12:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.605+0000 7f9156397640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9150110eb0 con 0x7f9150100a80 2024-09-15T23:12:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.605+0000 7f9154934640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9150106a80 0x7f915019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f9154934640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9150106a80 0x7f915019cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36420/0 (socket says 172.21.15.2:36420) 2024-09-15T23:12:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f9154934640 1 -- 172.21.15.2:0/2907851432 learned_addr learned my addr 172.21.15.2:0/2907851432 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f914f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9150101420 0x7f9150198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f914ffff640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9150100a80 0x7f91501982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f914f7fe640 1 -- 172.21.15.2:0/2907851432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9150100a80 msgr2=0x7f91501982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f914f7fe640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9150100a80 0x7f91501982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f914f7fe640 1 -- 172.21.15.2:0/2907851432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9150106a80 msgr2=0x7f915019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f914f7fe640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9150106a80 0x7f915019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f914f7fe640 1 -- 172.21.15.2:0/2907851432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915019d290 con 0x7f9150101420 2024-09-15T23:12:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f9154934640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9150106a80 0x7f915019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f914f7fe640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9150101420 0x7f9150198820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f914400d6d0 tx=0x7f914400dad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f914d7fa640 1 -- 172.21.15.2:0/2907851432 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144017070 con 0x7f9150101420 2024-09-15T23:12:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f9156397640 1 -- 172.21.15.2:0/2907851432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915019d580 con 0x7f9150101420 2024-09-15T23:12:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f914d7fa640 1 -- 172.21.15.2:0/2907851432 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f91440047a0 con 0x7f9150101420 2024-09-15T23:12:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f914d7fa640 1 -- 172.21.15.2:0/2907851432 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144009b50 con 0x7f9150101420 2024-09-15T23:12:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.606+0000 7f9156397640 1 -- 172.21.15.2:0/2907851432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91501a4e60 con 0x7f9150101420 2024-09-15T23:12:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.607+0000 7f9156397640 1 -- 172.21.15.2:0/2907851432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9150100ee0 con 0x7f9150101420 2024-09-15T23:12:29.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.608+0000 7f914d7fa640 1 -- 172.21.15.2:0/2907851432 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9144009cf0 con 0x7f9150101420 2024-09-15T23:12:29.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.609+0000 7f914d7fa640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f91380a32c0 0x7f91380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:29.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.609+0000 7f914ffff640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f91380a32c0 0x7f91380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:29.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.609+0000 7f914d7fa640 1 -- 172.21.15.2:0/2907851432 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f91440ced30 con 0x7f9150101420 2024-09-15T23:12:29.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.610+0000 7f914ffff640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f91380a32c0 0x7f91380a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f914000ab60 tx=0x7f914000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:29.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.612+0000 7f914d7fa640 1 -- 172.21.15.2:0/2907851432 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f914409bed0 con 0x7f9150101420 2024-09-15T23:12:29.667 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:29 smithi112 ceph-mon[34367]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:29.667 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:29 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:29.667 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:29 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:29.668 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:29 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:29.668 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:29 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:29.668 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:29 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:29.668 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:29 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:29 smithi145 ceph-mon[34901]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:29 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:29.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:29 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:29.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:29 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:29.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:29 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:12:29.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:29 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:12:29.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:29 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.823+0000 7f9156397640 1 -- 172.21.15.2:0/2907851432 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91501a50f0 con 0x7f9150101420 2024-09-15T23:12:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.824+0000 7f914d7fa640 1 -- 172.21.15.2:0/2907851432 <== mon.2 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9689 (secure 0 0 0) 0x7f914409b7d0 con 0x7f9150101420 2024-09-15T23:12:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:12:29.826 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":12,"btime":"2024-09-15T23:12:29:316376+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1051460220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1051460220},{"type":"v1","addr":"172.21.15.2:6839","nonce":1051460220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/1583533983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":1583533983},{"type":"v1","addr":"172.21.15.2:6841","nonce":1583533983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/91315913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":91315913},{"type":"v1","addr":"172.21.15.145:6835","nonce":91315913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1066293931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":1066293931},{"type":"v1","addr":"172.21.15.145:6837","nonce":1066293931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/418078184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":418078184},{"type":"v1","addr":"172.21.15.112:6837","nonce":418078184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6839/3930825714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3930825714},{"type":"v1","addr":"172.21.15.145:6839","nonce":3930825714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-15T23:12:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 12 2024-09-15T23:12:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.826+0000 7f9156397640 1 -- 172.21.15.2:0/2907851432 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f91380a32c0 msgr2=0x7f91380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.826+0000 7f9156397640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f91380a32c0 0x7f91380a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f914000ab60 tx=0x7f914000a2d0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.826+0000 7f9156397640 1 -- 172.21.15.2:0/2907851432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9150101420 msgr2=0x7f9150198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.826+0000 7f9156397640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9150101420 0x7f9150198820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f914400d6d0 tx=0x7f914400dad0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.827+0000 7f9156397640 1 -- 172.21.15.2:0/2907851432 shutdown_connections 2024-09-15T23:12:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.827+0000 7f9156397640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f91380a32c0 0x7f91380a5780 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.827+0000 7f9156397640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9150106a80 0x7f915019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.827+0000 7f9156397640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9150101420 0x7f9150198820 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.827+0000 7f9156397640 1 --2- 172.21.15.2:0/2907851432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9150100a80 0x7f91501982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.827+0000 7f9156397640 1 -- 172.21.15.2:0/2907851432 >> 172.21.15.2:0/2907851432 conn(0x7f91500fc7a0 msgr2=0x7f915006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.827+0000 7f9156397640 1 -- 172.21.15.2:0/2907851432 shutdown_connections 2024-09-15T23:12:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:29.827+0000 7f9156397640 1 -- 172.21.15.2:0/2907851432 wait complete. 2024-09-15T23:12:30.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:30 smithi002 ceph-mon[31019]: Deploying daemon mds.b on smithi112 2024-09-15T23:12:30.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:30 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.2:6840/1583533983,v1:172.21.15.2:6841/1583533983] up:boot 2024-09-15T23:12:30.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:30 smithi002 ceph-mon[31019]: fsmap 11 up:standby 2024-09-15T23:12:30.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:30 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T23:12:30.470 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:30 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2907851432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:30.654 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:30 smithi112 ceph-mon[34367]: Deploying daemon mds.b on smithi112 2024-09-15T23:12:30.654 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:30 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.2:6840/1583533983,v1:172.21.15.2:6841/1583533983] up:boot 2024-09-15T23:12:30.654 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:30 smithi112 ceph-mon[34367]: fsmap 11 up:standby 2024-09-15T23:12:30.654 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:30 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T23:12:30.655 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:30 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2907851432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:30.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:30 smithi145 ceph-mon[34901]: Deploying daemon mds.b on smithi112 2024-09-15T23:12:30.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:30 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.2:6840/1583533983,v1:172.21.15.2:6841/1583533983] up:boot 2024-09-15T23:12:30.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:30 smithi145 ceph-mon[34901]: fsmap 11 up:standby 2024-09-15T23:12:30.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:30 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T23:12:30.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:30 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2907851432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:31.246 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:12:31 smithi112 systemd[1]: Starting Ceph mds.b for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:12:31.626 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:31 smithi112 ceph-mon[34367]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:31.626 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:12:31 smithi112 podman[64549]: 2024-09-15 23:12:31.227900695 +0000 UTC m=+0.015628605 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:12:31.626 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:12:31 smithi112 podman[64549]: 2024-09-15 23:12:31.356502531 +0000 UTC m=+0.144230445 container create ac2a7a3734e99d8fea723300704ddd4af28cae5a7557591d64ce32f906a349a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-15T23:12:31.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:31 smithi145 ceph-mon[34901]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:31.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:31 smithi002 ceph-mon[31019]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:31.996 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:12:31 smithi112 podman[64549]: 2024-09-15 23:12:31.625824999 +0000 UTC m=+0.413552909 container init ac2a7a3734e99d8fea723300704ddd4af28cae5a7557591d64ce32f906a349a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-15T23:12:31.997 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:12:31 smithi112 podman[64549]: 2024-09-15 23:12:31.628760143 +0000 UTC m=+0.416488057 container start ac2a7a3734e99d8fea723300704ddd4af28cae5a7557591d64ce32f906a349a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-15T23:12:31.997 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:12:31 smithi112 ceph-mds[64568]: -- 172.21.15.112:0/3966704081 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562bd78c7c20 con 0x562bd78a4800 2024-09-15T23:12:31.997 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:12:31 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b[64564]: starting mds.b at 2024-09-15T23:12:31.997 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:12:31 smithi112 bash[64549]: ac2a7a3734e99d8fea723300704ddd4af28cae5a7557591d64ce32f906a349a7 2024-09-15T23:12:31.997 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:12:31 smithi112 systemd[1]: Started Ceph mds.b for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:12:32.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:12:32.797 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:32 smithi112 ceph-mon[34367]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:32.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:32 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:32.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:32 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:32.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:32 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:32.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:32 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:32.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:32 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:32.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:32 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:12:32.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:32 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] up:boot 2024-09-15T23:12:32.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:32 smithi112 ceph-mon[34367]: fsmap 12 up:standby 2024-09-15T23:12:32.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:32 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:12:32.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:32 smithi002 ceph-mon[31019]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:32.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:32 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:32.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:32 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:32.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:32 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:32.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:32 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:32.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:32 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:32.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:32 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:12:32.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:32 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] up:boot 2024-09-15T23:12:32.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:32 smithi002 ceph-mon[31019]: fsmap 12 up:standby 2024-09-15T23:12:32.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:32 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:12:33.105 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:33.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:32 smithi145 ceph-mon[34901]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:33.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:32 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:33.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:32 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:33.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:32 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:33.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:32 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:33.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:32 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:33.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:32 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:12:33.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:32 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] up:boot 2024-09-15T23:12:33.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:32 smithi145 ceph-mon[34901]: fsmap 12 up:standby 2024-09-15T23:12:33.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:32 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:12:33.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.592+0000 7f75e11d4640 1 -- 172.21.15.2:0/3120987909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75dc101420 msgr2=0x7f75dc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:33.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.592+0000 7f75e11d4640 1 --2- 172.21.15.2:0/3120987909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75dc101420 0x7f75dc10d950 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009cd0 tx=0x7f75d402a8e0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.592+0000 7f75e11d4640 1 -- 172.21.15.2:0/3120987909 shutdown_connections 2024-09-15T23:12:33.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.592+0000 7f75e11d4640 1 --2- 172.21.15.2:0/3120987909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75dc101420 0x7f75dc10d950 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.592+0000 7f75e11d4640 1 --2- 172.21.15.2:0/3120987909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75dc100a80 0x7f75dc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.592+0000 7f75e11d4640 1 --2- 172.21.15.2:0/3120987909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75dc106a80 0x7f75dc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.592+0000 7f75e11d4640 1 -- 172.21.15.2:0/3120987909 >> 172.21.15.2:0/3120987909 conn(0x7f75dc0fc7a0 msgr2=0x7f75dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:33.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.592+0000 7f75e11d4640 1 -- 172.21.15.2:0/3120987909 shutdown_connections 2024-09-15T23:12:33.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.592+0000 7f75e11d4640 1 -- 172.21.15.2:0/3120987909 wait complete. 2024-09-15T23:12:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.592+0000 7f75e11d4640 1 Processor -- start 2024-09-15T23:12:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75e11d4640 1 -- start start 2024-09-15T23:12:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75e11d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75dc100a80 0x7f75dc102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75e11d4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75dc101420 0x7f75dc102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75e11d4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75dc106a80 0x7f75dc1030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75e11d4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc110d30 con 0x7f75dc100a80 2024-09-15T23:12:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75e11d4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc110bb0 con 0x7f75dc106a80 2024-09-15T23:12:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75e11d4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc110eb0 con 0x7f75dc101420 2024-09-15T23:12:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75dad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75dc100a80 0x7f75dc102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75dad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75dc100a80 0x7f75dc102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36442/0 (socket says 172.21.15.2:36442) 2024-09-15T23:12:33.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75dad9d640 1 -- 172.21.15.2:0/1171112880 learned_addr learned my addr 172.21.15.2:0/1171112880 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:33.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75da59c640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75dc101420 0x7f75dc102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:33.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75db59e640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75dc106a80 0x7f75dc1030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:33.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75dad9d640 1 -- 172.21.15.2:0/1171112880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75dc101420 msgr2=0x7f75dc102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:33.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75dad9d640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75dc101420 0x7f75dc102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75dad9d640 1 -- 172.21.15.2:0/1171112880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75dc106a80 msgr2=0x7f75dc1030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:33.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75dad9d640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75dc106a80 0x7f75dc1030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.593+0000 7f75dad9d640 1 -- 172.21.15.2:0/1171112880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75dc1a67f0 con 0x7f75dc100a80 2024-09-15T23:12:33.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.594+0000 7f75dad9d640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75dc100a80 0x7f75dc102650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00d770 tx=0x7f75cc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:33.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.594+0000 7f75c3fff640 1 -- 172.21.15.2:0/1171112880 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc017070 con 0x7f75dc100a80 2024-09-15T23:12:33.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.594+0000 7f75e11d4640 1 -- 172.21.15.2:0/1171112880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75dc1a6ae0 con 0x7f75dc100a80 2024-09-15T23:12:33.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.594+0000 7f75c3fff640 1 -- 172.21.15.2:0/1171112880 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75cc0054d0 con 0x7f75dc100a80 2024-09-15T23:12:33.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.594+0000 7f75c3fff640 1 -- 172.21.15.2:0/1171112880 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc004cf0 con 0x7f75dc100a80 2024-09-15T23:12:33.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.594+0000 7f75e11d4640 1 -- 172.21.15.2:0/1171112880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75dc1a7020 con 0x7f75dc100a80 2024-09-15T23:12:33.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.595+0000 7f75e11d4640 1 -- 172.21.15.2:0/1171112880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75dc100ee0 con 0x7f75dc100a80 2024-09-15T23:12:33.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.596+0000 7f75c3fff640 1 -- 172.21.15.2:0/1171112880 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f75cc004e90 con 0x7f75dc100a80 2024-09-15T23:12:33.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.597+0000 7f75c3fff640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f75c40a3240 0x7f75c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:33.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.597+0000 7f75da59c640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f75c40a3240 0x7f75c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:33.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.597+0000 7f75c3fff640 1 -- 172.21.15.2:0/1171112880 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f75cc0cee40 con 0x7f75dc100a80 2024-09-15T23:12:33.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.597+0000 7f75da59c640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f75c40a3240 0x7f75c40a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f75dc1040e0 tx=0x7f75d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:33.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.601+0000 7f75c3fff640 1 -- 172.21.15.2:0/1171112880 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75cc09c000 con 0x7f75dc100a80 2024-09-15T23:12:33.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.827+0000 7f75e11d4640 1 -- 172.21.15.2:0/1171112880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75dc1a71f0 con 0x7f75dc100a80 2024-09-15T23:12:33.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.828+0000 7f75c3fff640 1 -- 172.21.15.2:0/1171112880 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10518 (secure 0 0 0) 0x7f75cc0afe20 con 0x7f75dc100a80 2024-09-15T23:12:33.830 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:12:33.830 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":13,"btime":"2024-09-15T23:12:32:328495+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1051460220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1051460220},{"type":"v1","addr":"172.21.15.2:6839","nonce":1051460220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/1583533983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":1583533983},{"type":"v1","addr":"172.21.15.2:6841","nonce":1583533983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/91315913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":91315913},{"type":"v1","addr":"172.21.15.145:6835","nonce":91315913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1066293931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":1066293931},{"type":"v1","addr":"172.21.15.145:6837","nonce":1066293931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/418078184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":418078184},{"type":"v1","addr":"172.21.15.112:6837","nonce":418078184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6839/3930825714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3930825714},{"type":"v1","addr":"172.21.15.145:6839","nonce":3930825714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/1380244119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1380244119},{"type":"v1","addr":"172.21.15.112:6839","nonce":1380244119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-15T23:12:33.830 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 13 2024-09-15T23:12:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.830+0000 7f75e11d4640 1 -- 172.21.15.2:0/1171112880 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f75c40a3240 msgr2=0x7f75c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:33.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.830+0000 7f75e11d4640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f75c40a3240 0x7f75c40a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f75dc1040e0 tx=0x7f75d000b390 comp rx=0 tx=0).stop 2024-09-15T23:12:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.830+0000 7f75e11d4640 1 -- 172.21.15.2:0/1171112880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75dc100a80 msgr2=0x7f75dc102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.830+0000 7f75e11d4640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75dc100a80 0x7f75dc102650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00d770 tx=0x7f75cc00dc30 comp rx=0 tx=0).stop 2024-09-15T23:12:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.830+0000 7f75e11d4640 1 -- 172.21.15.2:0/1171112880 shutdown_connections 2024-09-15T23:12:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.830+0000 7f75e11d4640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f75c40a3240 0x7f75c40a5700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.830+0000 7f75e11d4640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75dc106a80 0x7f75dc1030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.830+0000 7f75e11d4640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75dc101420 0x7f75dc102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.830+0000 7f75e11d4640 1 --2- 172.21.15.2:0/1171112880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75dc100a80 0x7f75dc102650 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.830+0000 7f75e11d4640 1 -- 172.21.15.2:0/1171112880 >> 172.21.15.2:0/1171112880 conn(0x7f75dc0fc7a0 msgr2=0x7f75dc1048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:33.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.831+0000 7f75e11d4640 1 -- 172.21.15.2:0/1171112880 shutdown_connections 2024-09-15T23:12:33.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:33.831+0000 7f75e11d4640 1 -- 172.21.15.2:0/1171112880 wait complete. 2024-09-15T23:12:34.525 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:34 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:34.525 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:34 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:34.525 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:34 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:34.525 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:34 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:34.525 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:34 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1171112880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:34.558 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-15T23:12:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:34 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:34 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:34 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:34 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:34 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1171112880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:34.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:34 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:34.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:34 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:34.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:34 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:34.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:34 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:34.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:34 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1171112880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:12:34.825 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:35.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.333+0000 7f31b1e9a640 1 -- 172.21.15.2:0/964511558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac101240 msgr2=0x7f31ac101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.333+0000 7f31b1e9a640 1 --2- 172.21.15.2:0/964511558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac101240 0x7f31ac101680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3194009900 tx=0x7f319402a410 comp rx=0 tx=0).stop 2024-09-15T23:12:35.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.334+0000 7f31b1e9a640 1 -- 172.21.15.2:0/964511558 shutdown_connections 2024-09-15T23:12:35.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.334+0000 7f31b1e9a640 1 --2- 172.21.15.2:0/964511558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31ac101bc0 0x7f31ac10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.334+0000 7f31b1e9a640 1 --2- 172.21.15.2:0/964511558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac101240 0x7f31ac101680 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.334+0000 7f31b1e9a640 1 --2- 172.21.15.2:0/964511558 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31ac105a90 0x7f31ac105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.334+0000 7f31b1e9a640 1 -- 172.21.15.2:0/964511558 >> 172.21.15.2:0/964511558 conn(0x7f31ac077210 msgr2=0x7f31ac0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:35.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.334+0000 7f31b1e9a640 1 -- 172.21.15.2:0/964511558 shutdown_connections 2024-09-15T23:12:35.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.334+0000 7f31b1e9a640 1 -- 172.21.15.2:0/964511558 wait complete. 2024-09-15T23:12:35.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.334+0000 7f31b1e9a640 1 Processor -- start 2024-09-15T23:12:35.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.334+0000 7f31b1e9a640 1 -- start start 2024-09-15T23:12:35.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.334+0000 7f31b1e9a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31ac101240 0x7f31ac10e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.334+0000 7f31b1e9a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31ac101bc0 0x7f31ac10e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31b1e9a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac105a90 0x7f31ac10eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31b1e9a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31ac111f40 con 0x7f31ac105a90 2024-09-15T23:12:35.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31b1e9a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f31ac111dc0 con 0x7f31ac101bc0 2024-09-15T23:12:35.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31b1e9a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f31ac1120c0 con 0x7f31ac101240 2024-09-15T23:12:35.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31abfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac105a90 0x7f31ac10eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31ab7fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31ac101240 0x7f31ac10e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31abfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac105a90 0x7f31ac10eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36468/0 (socket says 172.21.15.2:36468) 2024-09-15T23:12:35.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31abfff640 1 -- 172.21.15.2:0/3694862208 learned_addr learned my addr 172.21.15.2:0/3694862208 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:35.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31a3fff640 1 --2- 172.21.15.2:0/3694862208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31ac101bc0 0x7f31ac10e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31abfff640 1 -- 172.21.15.2:0/3694862208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31ac101240 msgr2=0x7f31ac10e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31abfff640 1 --2- 172.21.15.2:0/3694862208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31ac101240 0x7f31ac10e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31abfff640 1 -- 172.21.15.2:0/3694862208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31ac101bc0 msgr2=0x7f31ac10e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31abfff640 1 --2- 172.21.15.2:0/3694862208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31ac101bc0 0x7f31ac10e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31abfff640 1 -- 172.21.15.2:0/3694862208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ac1a6920 con 0x7f31ac105a90 2024-09-15T23:12:35.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31abfff640 1 --2- 172.21.15.2:0/3694862208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac105a90 0x7f31ac10eea0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f31a400eb10 tx=0x7f31a400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:35.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31a97fa640 1 -- 172.21.15.2:0/3694862208 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a4004b20 con 0x7f31ac105a90 2024-09-15T23:12:35.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31a97fa640 1 -- 172.21.15.2:0/3694862208 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31a4004cc0 con 0x7f31ac105a90 2024-09-15T23:12:35.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31b1e9a640 1 -- 172.21.15.2:0/3694862208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ac1a6c10 con 0x7f31ac105a90 2024-09-15T23:12:35.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31a97fa640 1 -- 172.21.15.2:0/3694862208 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a4010690 con 0x7f31ac105a90 2024-09-15T23:12:35.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.335+0000 7f31b1e9a640 1 -- 172.21.15.2:0/3694862208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ac1a7120 con 0x7f31ac105a90 2024-09-15T23:12:35.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.336+0000 7f31b1e9a640 1 -- 172.21.15.2:0/3694862208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31ac101680 con 0x7f31ac105a90 2024-09-15T23:12:35.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.337+0000 7f31a97fa640 1 -- 172.21.15.2:0/3694862208 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f31a4005020 con 0x7f31ac105a90 2024-09-15T23:12:35.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.338+0000 7f31a97fa640 1 --2- 172.21.15.2:0/3694862208 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f31980a3240 0x7f31980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.338+0000 7f31ab7fe640 1 --2- 172.21.15.2:0/3694862208 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f31980a3240 0x7f31980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.338+0000 7f31a97fa640 1 -- 172.21.15.2:0/3694862208 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f31a40cfb10 con 0x7f31ac105a90 2024-09-15T23:12:35.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.339+0000 7f31ab7fe640 1 --2- 172.21.15.2:0/3694862208 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f31980a3240 0x7f31980a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f319c009b50 tx=0x7f319c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:35.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.342+0000 7f31a97fa640 1 -- 172.21.15.2:0/3694862208 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31a409ccd0 con 0x7f31ac105a90 2024-09-15T23:12:35.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.532+0000 7f31b1e9a640 1 -- 172.21.15.2:0/3694862208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f31ac108fb0 con 0x7f31ac105a90 2024-09-15T23:12:35.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:35 smithi002 ceph-mon[31019]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:35.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:35.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:35.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:35.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:12:35.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:35.534 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:35 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:12:35.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.532+0000 7f31a97fa640 1 -- 172.21.15.2:0/3694862208 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7f31a409c5d0 con 0x7f31ac105a90 2024-09-15T23:12:35.534 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:12:35.534 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-09-15T23:12:35.535 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:12:35.535 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-09-15T23:12:35.535 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-09-15T23:12:35.535 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:12:35.535 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-09-15T23:12:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.534+0000 7f31b1e9a640 1 -- 172.21.15.2:0/3694862208 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f31980a3240 msgr2=0x7f31980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.534+0000 7f31b1e9a640 1 --2- 172.21.15.2:0/3694862208 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f31980a3240 0x7f31980a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f319c009b50 tx=0x7f319c005f90 comp rx=0 tx=0).stop 2024-09-15T23:12:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.534+0000 7f31b1e9a640 1 -- 172.21.15.2:0/3694862208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac105a90 msgr2=0x7f31ac10eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.534+0000 7f31b1e9a640 1 --2- 172.21.15.2:0/3694862208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac105a90 0x7f31ac10eea0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f31a400eb10 tx=0x7f31a400c2d0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.534+0000 7f31b1e9a640 1 -- 172.21.15.2:0/3694862208 shutdown_connections 2024-09-15T23:12:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.534+0000 7f31b1e9a640 1 --2- 172.21.15.2:0/3694862208 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f31980a3240 0x7f31980a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.534+0000 7f31b1e9a640 1 --2- 172.21.15.2:0/3694862208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac105a90 0x7f31ac10eea0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.534+0000 7f31b1e9a640 1 --2- 172.21.15.2:0/3694862208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31ac101bc0 0x7f31ac10e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.534+0000 7f31b1e9a640 1 --2- 172.21.15.2:0/3694862208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31ac101240 0x7f31ac10e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.534+0000 7f31b1e9a640 1 -- 172.21.15.2:0/3694862208 >> 172.21.15.2:0/3694862208 conn(0x7f31ac077210 msgr2=0x7f31ac1042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.535+0000 7f31b1e9a640 1 -- 172.21.15.2:0/3694862208 shutdown_connections 2024-09-15T23:12:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:35.535+0000 7f31b1e9a640 1 -- 172.21.15.2:0/3694862208 wait complete. 2024-09-15T23:12:35.571 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:35 smithi145 ceph-mon[34901]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:35.571 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:35.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:35.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:35.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:12:35.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:35.572 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:35 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:12:35.585 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:35 smithi112 ceph-mon[34367]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:35.585 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:35.585 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:35.585 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:35.585 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:12:35.585 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:35.585 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:35 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:12:36.513 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:12:36.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:12:36.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:36 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3694862208' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T23:12:36.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:36 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:36.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:36 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3694862208' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T23:12:36.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:36.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:36.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:36.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:36 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:36.906 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:36.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:36 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3694862208' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T23:12:36.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:36.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:36.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:36.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:36 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:37.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.444+0000 7f5475728640 1 -- 172.21.15.2:0/917063948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5470103700 msgr2=0x7f547010bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.444+0000 7f5475728640 1 --2- 172.21.15.2:0/917063948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5470103700 0x7f547010bbf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5458009900 tx=0x7f545802a480 comp rx=0 tx=0).stop 2024-09-15T23:12:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.444+0000 7f5475728640 1 -- 172.21.15.2:0/917063948 shutdown_connections 2024-09-15T23:12:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.444+0000 7f5475728640 1 --2- 172.21.15.2:0/917063948 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f547010c180 0x7f547010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.444+0000 7f5475728640 1 --2- 172.21.15.2:0/917063948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5470103700 0x7f547010bbf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.444+0000 7f5475728640 1 --2- 172.21.15.2:0/917063948 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5470102de0 0x7f54701031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.444+0000 7f5475728640 1 -- 172.21.15.2:0/917063948 >> 172.21.15.2:0/917063948 conn(0x7f54700fc7a0 msgr2=0x7f54700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.444+0000 7f5475728640 1 -- 172.21.15.2:0/917063948 shutdown_connections 2024-09-15T23:12:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.444+0000 7f5475728640 1 -- 172.21.15.2:0/917063948 wait complete. 2024-09-15T23:12:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.445+0000 7f5475728640 1 Processor -- start 2024-09-15T23:12:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.445+0000 7f5475728640 1 -- start start 2024-09-15T23:12:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.445+0000 7f5475728640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5470102de0 0x7f54701983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.445+0000 7f5475728640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5470103700 0x7f54701988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.445+0000 7f5475728640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f547010c180 0x7f547019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.445+0000 7f5475728640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5470111e20 con 0x7f547010c180 2024-09-15T23:12:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.445+0000 7f5475728640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5470111ca0 con 0x7f5470102de0 2024-09-15T23:12:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.445+0000 7f5475728640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5470111fa0 con 0x7f5470103700 2024-09-15T23:12:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.445+0000 7f546f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f547010c180 0x7f547019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.445+0000 7f546f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f547010c180 0x7f547019cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44502/0 (socket says 172.21.15.2:44502) 2024-09-15T23:12:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.445+0000 7f546f7fe640 1 -- 172.21.15.2:0/839190559 learned_addr learned my addr 172.21.15.2:0/839190559 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.445+0000 7f546effd640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5470102de0 0x7f54701983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.446+0000 7f5467fff640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5470103700 0x7f54701988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.446+0000 7f546f7fe640 1 -- 172.21.15.2:0/839190559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5470103700 msgr2=0x7f54701988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.446+0000 7f546f7fe640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5470103700 0x7f54701988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.446+0000 7f546f7fe640 1 -- 172.21.15.2:0/839190559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5470102de0 msgr2=0x7f54701983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.446+0000 7f546f7fe640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5470102de0 0x7f54701983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.446+0000 7f546f7fe640 1 -- 172.21.15.2:0/839190559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547019d350 con 0x7f547010c180 2024-09-15T23:12:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.446+0000 7f5467fff640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5470103700 0x7f54701988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.446+0000 7f546f7fe640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f547010c180 0x7f547019cc70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5468009fd0 tx=0x7f546800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.446+0000 7f546cff9640 1 -- 172.21.15.2:0/839190559 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468017070 con 0x7f547010c180 2024-09-15T23:12:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.446+0000 7f5475728640 1 -- 172.21.15.2:0/839190559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547019d640 con 0x7f547010c180 2024-09-15T23:12:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.446+0000 7f546cff9640 1 -- 172.21.15.2:0/839190559 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5468003e20 con 0x7f547010c180 2024-09-15T23:12:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.446+0000 7f546cff9640 1 -- 172.21.15.2:0/839190559 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468010460 con 0x7f547010c180 2024-09-15T23:12:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.446+0000 7f5475728640 1 -- 172.21.15.2:0/839190559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54701a4f20 con 0x7f547010c180 2024-09-15T23:12:37.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.447+0000 7f5475728640 1 -- 172.21.15.2:0/839190559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54701031c0 con 0x7f547010c180 2024-09-15T23:12:37.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.448+0000 7f546cff9640 1 -- 172.21.15.2:0/839190559 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5468003970 con 0x7f547010c180 2024-09-15T23:12:37.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.449+0000 7f546cff9640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f545c0a3240 0x7f545c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:37.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.449+0000 7f546effd640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f545c0a3240 0x7f545c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:37.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.449+0000 7f546cff9640 1 -- 172.21.15.2:0/839190559 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f54680cf3c0 con 0x7f547010c180 2024-09-15T23:12:37.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.450+0000 7f546effd640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f545c0a3240 0x7f545c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5460009b60 tx=0x7f5460005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:37.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.453+0000 7f546cff9640 1 -- 172.21.15.2:0/839190559 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f546809c4e0 con 0x7f547010c180 2024-09-15T23:12:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:37.652+0000 7f5475728640 1 -- 172.21.15.2:0/839190559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f547002d7c0 con 0x7f547010c180 2024-09-15T23:12:37.654 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:37 smithi002 ceph-mon[31019]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:37.654 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:37 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:37.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:37 smithi112 ceph-mon[34367]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:37.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:37 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:37.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:37 smithi145 ceph-mon[34901]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:37.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:37 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:38.465+0000 7f546cff9640 1 -- 172.21.15.2:0/839190559 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7f546809bde0 con 0x7f547010c180 2024-09-15T23:12:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-09-15T23:12:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:38.468+0000 7f5475728640 1 -- 172.21.15.2:0/839190559 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f545c0a3240 msgr2=0x7f545c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:38.468+0000 7f5475728640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f545c0a3240 0x7f545c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5460009b60 tx=0x7f5460005f90 comp rx=0 tx=0).stop 2024-09-15T23:12:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:38.468+0000 7f5475728640 1 -- 172.21.15.2:0/839190559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f547010c180 msgr2=0x7f547019cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:38.468+0000 7f5475728640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f547010c180 0x7f547019cc70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5468009fd0 tx=0x7f546800b260 comp rx=0 tx=0).stop 2024-09-15T23:12:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:38.468+0000 7f5475728640 1 -- 172.21.15.2:0/839190559 shutdown_connections 2024-09-15T23:12:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:38.468+0000 7f5475728640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f545c0a3240 0x7f545c0a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:38.468+0000 7f5475728640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f547010c180 0x7f547019cc70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:38.468+0000 7f5475728640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5470103700 0x7f54701988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:38.468+0000 7f5475728640 1 --2- 172.21.15.2:0/839190559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5470102de0 0x7f54701983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:38.468+0000 7f5475728640 1 -- 172.21.15.2:0/839190559 >> 172.21.15.2:0/839190559 conn(0x7f54700fc7a0 msgr2=0x7f54700fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:38.468+0000 7f5475728640 1 -- 172.21.15.2:0/839190559 shutdown_connections 2024-09-15T23:12:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:38.468+0000 7f5475728640 1 -- 172.21.15.2:0/839190559 wait complete. 2024-09-15T23:12:38.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:38 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/839190559' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T23:12:38.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:38 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:38.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:38 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:38.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:38 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:38.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:38 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:12:38.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:38 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:38.786 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:38 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/839190559' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T23:12:38.786 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:38 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:38.786 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:38 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:38.786 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:38 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:38.787 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:38 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:12:38.787 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:38 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:38.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:38 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/839190559' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T23:12:38.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:38 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:38.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:38 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:38.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:38 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:12:38.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:38 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:12:38.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:38 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:12:39.148 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:12:39.413 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:39.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:39 smithi112 ceph-mon[34367]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:39.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:39 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/839190559' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T23:12:39.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:39 smithi112 ceph-mon[34367]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T23:12:39.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:39 smithi002 ceph-mon[31019]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:39.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:39 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/839190559' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T23:12:39.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:39 smithi002 ceph-mon[31019]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T23:12:39.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:39 smithi145 ceph-mon[34901]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:39.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:39 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/839190559' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T23:12:39.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:39 smithi145 ceph-mon[34901]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T23:12:40.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.095+0000 7f858870f640 1 -- 172.21.15.2:0/51314574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8580101420 msgr2=0x7f858010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.095+0000 7f858870f640 1 --2- 172.21.15.2:0/51314574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8580101420 0x7f858010d950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8578009cd0 tx=0x7f857802a8e0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.095+0000 7f858870f640 1 -- 172.21.15.2:0/51314574 shutdown_connections 2024-09-15T23:12:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.095+0000 7f858870f640 1 --2- 172.21.15.2:0/51314574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8580101420 0x7f858010d950 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.095+0000 7f858870f640 1 --2- 172.21.15.2:0/51314574 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8580100a80 0x7f8580100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.095+0000 7f858870f640 1 --2- 172.21.15.2:0/51314574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8580106a80 0x7f8580106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.095+0000 7f858870f640 1 -- 172.21.15.2:0/51314574 >> 172.21.15.2:0/51314574 conn(0x7f85800fc7a0 msgr2=0x7f85800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.095+0000 7f858870f640 1 -- 172.21.15.2:0/51314574 shutdown_connections 2024-09-15T23:12:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.095+0000 7f858870f640 1 -- 172.21.15.2:0/51314574 wait complete. 2024-09-15T23:12:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.096+0000 7f858870f640 1 Processor -- start 2024-09-15T23:12:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.096+0000 7f858870f640 1 -- start start 2024-09-15T23:12:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.096+0000 7f858870f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8580100a80 0x7f8580198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.096+0000 7f858870f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8580101420 0x7f85801988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.096+0000 7f858870f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8580106a80 0x7f858019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.096+0000 7f858870f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8580111e50 con 0x7f8580101420 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.096+0000 7f858870f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8580111cd0 con 0x7f8580106a80 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.096+0000 7f858870f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8580111fd0 con 0x7f8580100a80 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.096+0000 7f8585caa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8580101420 0x7f85801988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f8585caa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8580101420 0x7f85801988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44522/0 (socket says 172.21.15.2:44522) 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f8585caa640 1 -- 172.21.15.2:0/1939152480 learned_addr learned my addr 172.21.15.2:0/1939152480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f85864ab640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8580100a80 0x7f8580198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f8586cac640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8580106a80 0x7f858019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f8585caa640 1 -- 172.21.15.2:0/1939152480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8580100a80 msgr2=0x7f8580198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f8585caa640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8580100a80 0x7f8580198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f8585caa640 1 -- 172.21.15.2:0/1939152480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8580106a80 msgr2=0x7f858019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f8585caa640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8580106a80 0x7f858019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f8585caa640 1 -- 172.21.15.2:0/1939152480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858019d320 con 0x7f8580101420 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f8586cac640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8580106a80 0x7f858019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f8585caa640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8580101420 0x7f85801988b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f857000b4a0 tx=0x7f857000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f85777fe640 1 -- 172.21.15.2:0/1939152480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570015020 con 0x7f8580101420 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f85777fe640 1 -- 172.21.15.2:0/1939152480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8570011ce0 con 0x7f8580101420 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f85777fe640 1 -- 172.21.15.2:0/1939152480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570010dc0 con 0x7f8580101420 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f858870f640 1 -- 172.21.15.2:0/1939152480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858019d610 con 0x7f8580101420 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.097+0000 7f858870f640 1 -- 172.21.15.2:0/1939152480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85801a4ef0 con 0x7f8580101420 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.098+0000 7f858870f640 1 -- 172.21.15.2:0/1939152480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8580100ee0 con 0x7f8580101420 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.099+0000 7f85777fe640 1 -- 172.21.15.2:0/1939152480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8570018020 con 0x7f8580101420 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.100+0000 7f85777fe640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f856c0a3390 0x7f856c0a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.100+0000 7f85864ab640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f856c0a3390 0x7f856c0a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.100+0000 7f85777fe640 1 -- 172.21.15.2:0/1939152480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7f85700cf390 con 0x7f8580101420 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.101+0000 7f85864ab640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f856c0a3390 0x7f856c0a5850 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f857c00abe0 tx=0x7f857c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:40.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.103+0000 7f85777fe640 1 -- 172.21.15.2:0/1939152480 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f857001f020 con 0x7f8580101420 2024-09-15T23:12:40.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.283+0000 7f858870f640 1 -- 172.21.15.2:0/1939152480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f85801996d0 con 0x7f8580101420 2024-09-15T23:12:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.721+0000 7f85777fe640 1 -- 172.21.15.2:0/1939152480 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7f85801996d0 con 0x7f8580101420 2024-09-15T23:12:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-09-15T23:12:40.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.723+0000 7f858870f640 1 -- 172.21.15.2:0/1939152480 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f856c0a3390 msgr2=0x7f856c0a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.723+0000 7f858870f640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f856c0a3390 0x7f856c0a5850 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f857c00abe0 tx=0x7f857c00a2d0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.723+0000 7f858870f640 1 -- 172.21.15.2:0/1939152480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8580101420 msgr2=0x7f85801988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.723+0000 7f858870f640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8580101420 0x7f85801988b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f857000b4a0 tx=0x7f857000b8a0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.723+0000 7f858870f640 1 -- 172.21.15.2:0/1939152480 shutdown_connections 2024-09-15T23:12:40.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.723+0000 7f858870f640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f856c0a3390 0x7f856c0a5850 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.723+0000 7f858870f640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8580106a80 0x7f858019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.723+0000 7f858870f640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8580101420 0x7f85801988b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.723+0000 7f858870f640 1 --2- 172.21.15.2:0/1939152480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8580100a80 0x7f8580198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.723+0000 7f858870f640 1 -- 172.21.15.2:0/1939152480 >> 172.21.15.2:0/1939152480 conn(0x7f85800fc7a0 msgr2=0x7f85800fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:40.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.723+0000 7f858870f640 1 -- 172.21.15.2:0/1939152480 shutdown_connections 2024-09-15T23:12:40.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:40.724+0000 7f858870f640 1 -- 172.21.15.2:0/1939152480 wait complete. 2024-09-15T23:12:40.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:40 smithi112 ceph-mon[34367]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T23:12:41.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:40 smithi002 ceph-mon[31019]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T23:12:41.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:40 smithi145 ceph-mon[34901]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T23:12:41.449 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:12:41.709 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:41.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:41 smithi002 ceph-mon[31019]: pgmap v277: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:41.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:41 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1939152480' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T23:12:41.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:41 smithi002 ceph-mon[31019]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T23:12:41.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:41 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1939152480' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T23:12:41.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:41 smithi002 ceph-mon[31019]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T23:12:41.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:41 smithi112 ceph-mon[34367]: pgmap v277: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:41.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:41 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1939152480' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T23:12:41.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:41 smithi112 ceph-mon[34367]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T23:12:41.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:41 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1939152480' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T23:12:41.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:41 smithi112 ceph-mon[34367]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T23:12:42.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:41 smithi145 ceph-mon[34901]: pgmap v277: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:42.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:41 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1939152480' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T23:12:42.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:41 smithi145 ceph-mon[34901]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T23:12:42.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:41 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1939152480' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T23:12:42.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:41 smithi145 ceph-mon[34901]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T23:12:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.210+0000 7fbd22e21640 1 -- 172.21.15.2:0/132064204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1c100a80 msgr2=0x7fbd1c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.210+0000 7fbd22e21640 1 --2- 172.21.15.2:0/132064204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1c100a80 0x7fbd1c100ee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009930 tx=0x7fbd0802a420 comp rx=0 tx=0).stop 2024-09-15T23:12:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.210+0000 7fbd22e21640 1 -- 172.21.15.2:0/132064204 shutdown_connections 2024-09-15T23:12:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.210+0000 7fbd22e21640 1 --2- 172.21.15.2:0/132064204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c101420 0x7fbd1c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.210+0000 7fbd22e21640 1 --2- 172.21.15.2:0/132064204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1c100a80 0x7fbd1c100ee0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.210+0000 7fbd22e21640 1 --2- 172.21.15.2:0/132064204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd1c106a80 0x7fbd1c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.210+0000 7fbd22e21640 1 -- 172.21.15.2:0/132064204 >> 172.21.15.2:0/132064204 conn(0x7fbd1c0fc7a0 msgr2=0x7fbd1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.210+0000 7fbd22e21640 1 -- 172.21.15.2:0/132064204 shutdown_connections 2024-09-15T23:12:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.210+0000 7fbd22e21640 1 -- 172.21.15.2:0/132064204 wait complete. 2024-09-15T23:12:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd22e21640 1 Processor -- start 2024-09-15T23:12:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd22e21640 1 -- start start 2024-09-15T23:12:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd22e21640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd1c100a80 0x7fbd1c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd22e21640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c101420 0x7fbd1c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd22e21640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1c106a80 0x7fbd1c1a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd22e21640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c110d50 con 0x7fbd1c106a80 2024-09-15T23:12:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd22e21640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c110bd0 con 0x7fbd1c101420 2024-09-15T23:12:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd22e21640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c110ed0 con 0x7fbd1c100a80 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd213be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1c106a80 0x7fbd1c1a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd213be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1c106a80 0x7fbd1c1a42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44542/0 (socket says 172.21.15.2:44542) 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd213be640 1 -- 172.21.15.2:0/4037738835 learned_addr learned my addr 172.21.15.2:0/4037738835 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd20bbd640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd1c100a80 0x7fbd1c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd1bfff640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c101420 0x7fbd1c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd213be640 1 -- 172.21.15.2:0/4037738835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd1c100a80 msgr2=0x7fbd1c199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd213be640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd1c100a80 0x7fbd1c199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd213be640 1 -- 172.21.15.2:0/4037738835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c101420 msgr2=0x7fbd1c1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd213be640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c101420 0x7fbd1c1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.211+0000 7fbd213be640 1 -- 172.21.15.2:0/4037738835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1c1a4820 con 0x7fbd1c106a80 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.212+0000 7fbd213be640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1c106a80 0x7fbd1c1a42e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400eaa0 tx=0x7fbd1400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.212+0000 7fbd19ffb640 1 -- 172.21.15.2:0/4037738835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14004d20 con 0x7fbd1c106a80 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.212+0000 7fbd22e21640 1 -- 172.21.15.2:0/4037738835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1c1a49f0 con 0x7fbd1c106a80 2024-09-15T23:12:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.212+0000 7fbd19ffb640 1 -- 172.21.15.2:0/4037738835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd14005020 con 0x7fbd1c106a80 2024-09-15T23:12:42.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.212+0000 7fbd19ffb640 1 -- 172.21.15.2:0/4037738835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd140116b0 con 0x7fbd1c106a80 2024-09-15T23:12:42.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.212+0000 7fbd22e21640 1 -- 172.21.15.2:0/4037738835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1c1a4f00 con 0x7fbd1c106a80 2024-09-15T23:12:42.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.213+0000 7fbd22e21640 1 -- 172.21.15.2:0/4037738835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd1c100ee0 con 0x7fbd1c106a80 2024-09-15T23:12:42.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.214+0000 7fbd19ffb640 1 -- 172.21.15.2:0/4037738835 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fbd140051d0 con 0x7fbd1c106a80 2024-09-15T23:12:42.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.215+0000 7fbd19ffb640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbd0c0a3240 0x7fbd0c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:42.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.215+0000 7fbd20bbd640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbd0c0a3240 0x7fbd0c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:42.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.215+0000 7fbd19ffb640 1 -- 172.21.15.2:0/4037738835 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7fbd140cf920 con 0x7fbd1c106a80 2024-09-15T23:12:42.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.216+0000 7fbd20bbd640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbd0c0a3240 0x7fbd0c0a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009990 tx=0x7fbd10009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:42.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.220+0000 7fbd19ffb640 1 -- 172.21.15.2:0/4037738835 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd14016030 con 0x7fbd1c106a80 2024-09-15T23:12:42.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.432+0000 7fbd22e21640 1 -- 172.21.15.2:0/4037738835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbd1c109010 con 0x7fbd1c106a80 2024-09-15T23:12:42.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.728+0000 7fbd19ffb640 1 -- 172.21.15.2:0/4037738835 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fbd1409c7f0 con 0x7fbd1c106a80 2024-09-15T23:12:42.730 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T23:12:42.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.731+0000 7fbd22e21640 1 -- 172.21.15.2:0/4037738835 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbd0c0a3240 msgr2=0x7fbd0c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:42.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.731+0000 7fbd22e21640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbd0c0a3240 0x7fbd0c0a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009990 tx=0x7fbd10009110 comp rx=0 tx=0).stop 2024-09-15T23:12:42.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.731+0000 7fbd22e21640 1 -- 172.21.15.2:0/4037738835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1c106a80 msgr2=0x7fbd1c1a42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:42.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.731+0000 7fbd22e21640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1c106a80 0x7fbd1c1a42e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400eaa0 tx=0x7fbd1400eea0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.731+0000 7fbd22e21640 1 -- 172.21.15.2:0/4037738835 shutdown_connections 2024-09-15T23:12:42.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.731+0000 7fbd22e21640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbd0c0a3240 0x7fbd0c0a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.731+0000 7fbd22e21640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1c106a80 0x7fbd1c1a42e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.731+0000 7fbd22e21640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbd1c101420 0x7fbd1c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.731+0000 7fbd22e21640 1 --2- 172.21.15.2:0/4037738835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbd1c100a80 0x7fbd1c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.731+0000 7fbd22e21640 1 -- 172.21.15.2:0/4037738835 >> 172.21.15.2:0/4037738835 conn(0x7fbd1c0fc7a0 msgr2=0x7fbd1c0fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:42.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.731+0000 7fbd22e21640 1 -- 172.21.15.2:0/4037738835 shutdown_connections 2024-09-15T23:12:42.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:42.731+0000 7fbd22e21640 1 -- 172.21.15.2:0/4037738835 wait complete. 2024-09-15T23:12:42.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:42 smithi112 ceph-mon[34367]: pgmap v279: 97 pgs: 28 creating+peering, 51 unknown, 18 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:42.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:42 smithi112 ceph-mon[34367]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T23:12:42.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:42 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/4037738835' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T23:12:42.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:42 smithi112 ceph-mon[34367]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T23:12:43.053 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:42 smithi002 ceph-mon[31019]: pgmap v279: 97 pgs: 28 creating+peering, 51 unknown, 18 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:43.053 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:42 smithi002 ceph-mon[31019]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T23:12:43.053 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:42 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/4037738835' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T23:12:43.053 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:42 smithi002 ceph-mon[31019]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T23:12:43.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:42 smithi145 ceph-mon[34901]: pgmap v279: 97 pgs: 28 creating+peering, 51 unknown, 18 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:12:43.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:42 smithi145 ceph-mon[34901]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T23:12:43.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:42 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/4037738835' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T23:12:43.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:42 smithi145 ceph-mon[34901]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T23:12:43.440 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:12:43.705 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:43.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:43 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/4037738835' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T23:12:43.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:43 smithi002 ceph-mon[31019]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T23:12:43.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:43 smithi002 ceph-mon[31019]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T23:12:43.995 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:43 smithi002 ceph-mon[31019]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T23:12:43.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:43 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/4037738835' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T23:12:43.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:43 smithi112 ceph-mon[34367]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T23:12:43.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:43 smithi112 ceph-mon[34367]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T23:12:43.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:43 smithi112 ceph-mon[34367]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T23:12:44.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:43 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/4037738835' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T23:12:44.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:43 smithi145 ceph-mon[34901]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T23:12:44.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:43 smithi145 ceph-mon[34901]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T23:12:44.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:43 smithi145 ceph-mon[34901]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T23:12:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.214+0000 7f15fa37e640 1 -- 172.21.15.2:0/929136153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15f4106f10 msgr2=0x7f15f410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.214+0000 7f15fa37e640 1 --2- 172.21.15.2:0/929136153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15f4106f10 0x7f15f410ea90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009ca0 tx=0x7f15ec02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.214+0000 7f15fa37e640 1 -- 172.21.15.2:0/929136153 shutdown_connections 2024-09-15T23:12:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.214+0000 7f15fa37e640 1 --2- 172.21.15.2:0/929136153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15f4106f10 0x7f15f410ea90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.214+0000 7f15fa37e640 1 --2- 172.21.15.2:0/929136153 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f4102790 0x7f15f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.214+0000 7f15fa37e640 1 --2- 172.21.15.2:0/929136153 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15f4101de0 0x7f15f41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.214+0000 7f15fa37e640 1 -- 172.21.15.2:0/929136153 >> 172.21.15.2:0/929136153 conn(0x7f15f40fd8c0 msgr2=0x7f15f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.214+0000 7f15fa37e640 1 -- 172.21.15.2:0/929136153 shutdown_connections 2024-09-15T23:12:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.214+0000 7f15fa37e640 1 -- 172.21.15.2:0/929136153 wait complete. 2024-09-15T23:12:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15fa37e640 1 Processor -- start 2024-09-15T23:12:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15fa37e640 1 -- start start 2024-09-15T23:12:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15fa37e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15f4101de0 0x7f15f4198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15fa37e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15f4102790 0x7f15f4198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15fa37e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f4106f10 0x7f15f419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15fa37e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f15f4111e40 con 0x7f15f4102790 2024-09-15T23:12:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15fa37e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f15f4111cc0 con 0x7f15f4106f10 2024-09-15T23:12:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15fa37e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f15f4111fc0 con 0x7f15f4101de0 2024-09-15T23:12:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15f37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15f4102790 0x7f15f4198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15f37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15f4102790 0x7f15f4198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44562/0 (socket says 172.21.15.2:44562) 2024-09-15T23:12:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15f37fe640 1 -- 172.21.15.2:0/2064550913 learned_addr learned my addr 172.21.15.2:0/2064550913 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15f3fff640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15f4101de0 0x7f15f4198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15f891b640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f4106f10 0x7f15f419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15f37fe640 1 -- 172.21.15.2:0/2064550913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15f4101de0 msgr2=0x7f15f4198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15f37fe640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15f4101de0 0x7f15f4198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15f37fe640 1 -- 172.21.15.2:0/2064550913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f4106f10 msgr2=0x7f15f419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.215+0000 7f15f37fe640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f4106f10 0x7f15f419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.216+0000 7f15f37fe640 1 -- 172.21.15.2:0/2064550913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f419d2d0 con 0x7f15f4102790 2024-09-15T23:12:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.216+0000 7f15f891b640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f4106f10 0x7f15f419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.216+0000 7f15f37fe640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15f4102790 0x7f15f4198860 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f15e800c920 tx=0x7f15e800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.216+0000 7f15f17fa640 1 -- 172.21.15.2:0/2064550913 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e8007c70 con 0x7f15f4102790 2024-09-15T23:12:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.216+0000 7f15fa37e640 1 -- 172.21.15.2:0/2064550913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f419d5c0 con 0x7f15f4102790 2024-09-15T23:12:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.216+0000 7f15f17fa640 1 -- 172.21.15.2:0/2064550913 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f15e8007e10 con 0x7f15f4102790 2024-09-15T23:12:44.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.216+0000 7f15f17fa640 1 -- 172.21.15.2:0/2064550913 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e8018820 con 0x7f15f4102790 2024-09-15T23:12:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.216+0000 7f15fa37e640 1 -- 172.21.15.2:0/2064550913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f41a4ea0 con 0x7f15f4102790 2024-09-15T23:12:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.217+0000 7f15fa37e640 1 -- 172.21.15.2:0/2064550913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f41021c0 con 0x7f15f4102790 2024-09-15T23:12:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.218+0000 7f15f17fa640 1 -- 172.21.15.2:0/2064550913 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f15e80189c0 con 0x7f15f4102790 2024-09-15T23:12:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.219+0000 7f15f17fa640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f15dc0a3240 0x7f15dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.219+0000 7f15f3fff640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f15dc0a3240 0x7f15dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.219+0000 7f15f17fa640 1 -- 172.21.15.2:0/2064550913 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f15e80cfc70 con 0x7f15f4102790 2024-09-15T23:12:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.219+0000 7f15f3fff640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f15dc0a3240 0x7f15dc0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009890 tx=0x7f15e4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.222+0000 7f15f17fa640 1 -- 172.21.15.2:0/2064550913 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f15e8014030 con 0x7f15f4102790 2024-09-15T23:12:44.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.399+0000 7f15fa37e640 1 -- 172.21.15.2:0/2064550913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15f4109b60 con 0x7f15f4102790 2024-09-15T23:12:44.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.401+0000 7f15f17fa640 1 -- 172.21.15.2:0/2064550913 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22195 (secure 0 0 0) 0x7f15e809cb70 con 0x7f15f4102790 2024-09-15T23:12:44.402 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:12:44.402 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","created":"2024-09-15T23:04:45.101432+0000","modified":"2024-09-15T23:12:42.434365+0000","last_up_change":"2024-09-15T23:11:49.566858+0000","last_in_change":"2024-09-15T23:11:25.723093+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:07:57.919291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:38.100522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:40.716254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40ff4fd9-3904-4178-a9cb-51f4647be540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6803","nonce":280991401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6805","nonce":280991401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6809","nonce":280991401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6807","nonce":280991401}]},"public_addr":"172.21.15.2:6803/280991401","cluster_addr":"172.21.15.2:6805/280991401","heartbeat_back_addr":"172.21.15.2:6809/280991401","heartbeat_front_addr":"172.21.15.2:6807/280991401","state":["exists","up"]},{"osd":1,"uuid":"af5e265d-fe45-4d9c-a34c-6f0b103d75d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6801","nonce":2649210970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6803","nonce":2649210970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6807","nonce":2649210970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6805","nonce":2649210970}]},"public_addr":"172.21.15.112:6801/2649210970","cluster_addr":"172.21.15.112:6803/2649210970","heartbeat_back_addr":"172.21.15.112:6807/2649210970","heartbeat_front_addr":"172.21.15.112:6805/2649210970","state":["exists","up"]},{"osd":2,"uuid":"8df9e644-fc51-4626-a1a7-6ac4448a5b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6801","nonce":3485615437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6803","nonce":3485615437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6807","nonce":3485615437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6805","nonce":3485615437}]},"public_addr":"172.21.15.145:6801/3485615437","cluster_addr":"172.21.15.145:6803/3485615437","heartbeat_back_addr":"172.21.15.145:6807/3485615437","heartbeat_front_addr":"172.21.15.145:6805/3485615437","state":["exists","up"]},{"osd":3,"uuid":"dbab372a-8fdd-4b0c-bee3-16cd75b35ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6811","nonce":113061968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6813","nonce":113061968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6817","nonce":113061968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6815","nonce":113061968}]},"public_addr":"172.21.15.2:6811/113061968","cluster_addr":"172.21.15.2:6813/113061968","heartbeat_back_addr":"172.21.15.2:6817/113061968","heartbeat_front_addr":"172.21.15.2:6815/113061968","state":["exists","up"]},{"osd":4,"uuid":"73bab8af-3973-4beb-a034-d00bcf0c572f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6809","nonce":2519162767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6811","nonce":2519162767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6815","nonce":2519162767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6813","nonce":2519162767}]},"public_addr":"172.21.15.112:6809/2519162767","cluster_addr":"172.21.15.112:6811/2519162767","heartbeat_back_addr":"172.21.15.112:6815/2519162767","heartbeat_front_addr":"172.21.15.112:6813/2519162767","state":["exists","up"]},{"osd":5,"uuid":"2d163e61-5891-46c1-b1c2-39d50a3b6f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6809","nonce":712427242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6811","nonce":712427242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6815","nonce":712427242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6813","nonce":712427242}]},"public_addr":"172.21.15.145:6809/712427242","cluster_addr":"172.21.15.145:6811/712427242","heartbeat_back_addr":"172.21.15.145:6815/712427242","heartbeat_front_addr":"172.21.15.145:6813/712427242","state":["exists","up"]},{"osd":6,"uuid":"bca02c96-10de-4953-96e9-42fc9ddf7c1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6819","nonce":2930673197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6821","nonce":2930673197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6825","nonce":2930673197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6823","nonce":2930673197}]},"public_addr":"172.21.15.2:6819/2930673197","cluster_addr":"172.21.15.2:6821/2930673197","heartbeat_back_addr":"172.21.15.2:6825/2930673197","heartbeat_front_addr":"172.21.15.2:6823/2930673197","state":["exists","up"]},{"osd":7,"uuid":"4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6817","nonce":830628191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6819","nonce":830628191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6823","nonce":830628191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6821","nonce":830628191}]},"public_addr":"172.21.15.112:6817/830628191","cluster_addr":"172.21.15.112:6819/830628191","heartbeat_back_addr":"172.21.15.112:6823/830628191","heartbeat_front_addr":"172.21.15.112:6821/830628191","state":["exists","up"]},{"osd":8,"uuid":"2733f9dd-3872-4bec-9c22-bcdb64828ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6817","nonce":3634470540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6819","nonce":3634470540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6823","nonce":3634470540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6821","nonce":3634470540}]},"public_addr":"172.21.15.145:6817/3634470540","cluster_addr":"172.21.15.145:6819/3634470540","heartbeat_back_addr":"172.21.15.145:6823/3634470540","heartbeat_front_addr":"172.21.15.145:6821/3634470540","state":["exists","up"]},{"osd":9,"uuid":"bd1f4a4a-547c-43a9-859a-75b37b06905f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6827","nonce":1417377702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6829","nonce":1417377702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6833","nonce":1417377702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6831","nonce":1417377702}]},"public_addr":"172.21.15.2:6827/1417377702","cluster_addr":"172.21.15.2:6829/1417377702","heartbeat_back_addr":"172.21.15.2:6833/1417377702","heartbeat_front_addr":"172.21.15.2:6831/1417377702","state":["exists","up"]},{"osd":10,"uuid":"f8b895e8-39f5-4753-9343-03f96da12246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6825","nonce":105615908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6827","nonce":105615908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6831","nonce":105615908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6829","nonce":105615908}]},"public_addr":"172.21.15.112:6825/105615908","cluster_addr":"172.21.15.112:6827/105615908","heartbeat_back_addr":"172.21.15.112:6831/105615908","heartbeat_front_addr":"172.21.15.112:6829/105615908","state":["exists","up"]},{"osd":11,"uuid":"dc018bfc-bc13-4ef2-a712-5cd406a56cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6825","nonce":430484289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6827","nonce":430484289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6831","nonce":430484289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6829","nonce":430484289}]},"public_addr":"172.21.15.145:6825/430484289","cluster_addr":"172.21.15.145:6827/430484289","heartbeat_back_addr":"172.21.15.145:6831/430484289","heartbeat_front_addr":"172.21.15.145:6829/430484289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:03.938207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:29.814740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:54.853802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:20.802021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:47.028090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:13.226130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:39.003023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:04.465156+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:29.321331+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:55.992585+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:21.623406+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:48.269840+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/2956732837":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6800/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/896502743":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/3802152324":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/1891095221":"2024-09-16T23:05:17.756048+0000","172.21.15.2:6800/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/236781836":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/2404111366":"2024-09-16T23:05:17.756048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:44.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.403+0000 7f15fa37e640 1 -- 172.21.15.2:0/2064550913 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f15dc0a3240 msgr2=0x7f15dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:44.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.403+0000 7f15fa37e640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f15dc0a3240 0x7f15dc0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009890 tx=0x7f15e4008040 comp rx=0 tx=0).stop 2024-09-15T23:12:44.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.403+0000 7f15fa37e640 1 -- 172.21.15.2:0/2064550913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15f4102790 msgr2=0x7f15f4198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.403+0000 7f15fa37e640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15f4102790 0x7f15f4198860 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f15e800c920 tx=0x7f15e800cde0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.403+0000 7f15fa37e640 1 -- 172.21.15.2:0/2064550913 shutdown_connections 2024-09-15T23:12:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.403+0000 7f15fa37e640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f15dc0a3240 0x7f15dc0a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.403+0000 7f15fa37e640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f15f4106f10 0x7f15f419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.403+0000 7f15fa37e640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15f4102790 0x7f15f4198860 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.403+0000 7f15fa37e640 1 --2- 172.21.15.2:0/2064550913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f15f4101de0 0x7f15f4198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.403+0000 7f15fa37e640 1 -- 172.21.15.2:0/2064550913 >> 172.21.15.2:0/2064550913 conn(0x7f15f40fd8c0 msgr2=0x7f15f40fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.403+0000 7f15fa37e640 1 -- 172.21.15.2:0/2064550913 shutdown_connections 2024-09-15T23:12:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:44.403+0000 7f15fa37e640 1 -- 172.21.15.2:0/2064550913 wait complete. 2024-09-15T23:12:44.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:44 smithi112 ceph-mon[34367]: pgmap v282: 97 pgs: 28 creating+peering, 20 unknown, 49 active+clean; 578 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 762 B/s wr, 1 op/s 2024-09-15T23:12:44.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:44 smithi112 ceph-mon[34367]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T23:12:44.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:44 smithi112 ceph-mon[34367]: Cluster is now healthy 2024-09-15T23:12:44.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:44 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] up:active 2024-09-15T23:12:44.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:44 smithi112 ceph-mon[34367]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T23:12:44.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:44 smithi112 ceph-mon[34367]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T23:12:44.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:44 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2064550913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:12:45.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:44 smithi002 ceph-mon[31019]: pgmap v282: 97 pgs: 28 creating+peering, 20 unknown, 49 active+clean; 578 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 762 B/s wr, 1 op/s 2024-09-15T23:12:45.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:44 smithi002 ceph-mon[31019]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T23:12:45.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:44 smithi002 ceph-mon[31019]: Cluster is now healthy 2024-09-15T23:12:45.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:44 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] up:active 2024-09-15T23:12:45.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:44 smithi002 ceph-mon[31019]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T23:12:45.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:44 smithi002 ceph-mon[31019]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T23:12:45.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:44 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2064550913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:12:45.081 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:12:45.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:44 smithi145 ceph-mon[34901]: pgmap v282: 97 pgs: 28 creating+peering, 20 unknown, 49 active+clean; 578 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 762 B/s wr, 1 op/s 2024-09-15T23:12:45.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:44 smithi145 ceph-mon[34901]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T23:12:45.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:44 smithi145 ceph-mon[34901]: Cluster is now healthy 2024-09-15T23:12:45.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:44 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] up:active 2024-09-15T23:12:45.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:44 smithi145 ceph-mon[34901]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T23:12:45.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:44 smithi145 ceph-mon[34901]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T23:12:45.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:44 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2064550913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:12:45.343 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.830+0000 7f65b41ed640 1 -- 172.21.15.2:0/3940416170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac101e30 msgr2=0x7f65ac105750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.830+0000 7f65b41ed640 1 --2- 172.21.15.2:0/3940416170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac101e30 0x7f65ac105750 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009900 tx=0x7f65a002a410 comp rx=0 tx=0).stop 2024-09-15T23:12:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.830+0000 7f65b41ed640 1 -- 172.21.15.2:0/3940416170 shutdown_connections 2024-09-15T23:12:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.830+0000 7f65b41ed640 1 --2- 172.21.15.2:0/3940416170 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65ac105e80 0x7f65ac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.830+0000 7f65b41ed640 1 --2- 172.21.15.2:0/3940416170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac101e30 0x7f65ac105750 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.830+0000 7f65b41ed640 1 --2- 172.21.15.2:0/3940416170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65ac101480 0x7f65ac101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.830+0000 7f65b41ed640 1 -- 172.21.15.2:0/3940416170 >> 172.21.15.2:0/3940416170 conn(0x7f65ac077210 msgr2=0x7f65ac0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.830+0000 7f65b41ed640 1 -- 172.21.15.2:0/3940416170 shutdown_connections 2024-09-15T23:12:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.830+0000 7f65b41ed640 1 -- 172.21.15.2:0/3940416170 wait complete. 2024-09-15T23:12:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.831+0000 7f65b41ed640 1 Processor -- start 2024-09-15T23:12:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.831+0000 7f65b41ed640 1 -- start start 2024-09-15T23:12:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.831+0000 7f65b41ed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65ac101480 0x7f65ac199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b41ed640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65ac101e30 0x7f65ac1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b41ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac105e80 0x7f65ac1a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b41ed640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac110dd0 con 0x7f65ac105e80 2024-09-15T23:12:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b41ed640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac110c50 con 0x7f65ac101480 2024-09-15T23:12:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b41ed640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac110f50 con 0x7f65ac101e30 2024-09-15T23:12:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b278a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac105e80 0x7f65ac1a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b278a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac105e80 0x7f65ac1a42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44580/0 (socket says 172.21.15.2:44580) 2024-09-15T23:12:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b278a640 1 -- 172.21.15.2:0/3491129106 learned_addr learned my addr 172.21.15.2:0/3491129106 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b1f89640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65ac101480 0x7f65ac199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b1788640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65ac101e30 0x7f65ac1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b278a640 1 -- 172.21.15.2:0/3491129106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65ac101e30 msgr2=0x7f65ac1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b278a640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65ac101e30 0x7f65ac1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b278a640 1 -- 172.21.15.2:0/3491129106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65ac101480 msgr2=0x7f65ac199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b278a640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65ac101480 0x7f65ac199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b278a640 1 -- 172.21.15.2:0/3491129106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ac1a4820 con 0x7f65ac105e80 2024-09-15T23:12:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b1788640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65ac101e30 0x7f65ac1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b278a640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac105e80 0x7f65ac1a42e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f65a400cce0 tx=0x7f65a400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65aaffd640 1 -- 172.21.15.2:0/3491129106 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a400f450 con 0x7f65ac105e80 2024-09-15T23:12:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65aaffd640 1 -- 172.21.15.2:0/3491129106 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65a400faa0 con 0x7f65ac105e80 2024-09-15T23:12:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b41ed640 1 -- 172.21.15.2:0/3491129106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65ac1a49f0 con 0x7f65ac105e80 2024-09-15T23:12:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65aaffd640 1 -- 172.21.15.2:0/3491129106 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4018b70 con 0x7f65ac105e80 2024-09-15T23:12:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.832+0000 7f65b41ed640 1 -- 172.21.15.2:0/3491129106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65ac1a4eb0 con 0x7f65ac105e80 2024-09-15T23:12:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.833+0000 7f65b41ed640 1 -- 172.21.15.2:0/3491129106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65ac101860 con 0x7f65ac105e80 2024-09-15T23:12:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.834+0000 7f65aaffd640 1 -- 172.21.15.2:0/3491129106 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f65a4018d10 con 0x7f65ac105e80 2024-09-15T23:12:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.835+0000 7f65aaffd640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f65940a32c0 0x7f65940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.835+0000 7f65b1f89640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f65940a32c0 0x7f65940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.835+0000 7f65aaffd640 1 -- 172.21.15.2:0/3491129106 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f65a40cfbb0 con 0x7f65ac105e80 2024-09-15T23:12:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.836+0000 7f65b1f89640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f65940a32c0 0x7f65940a5780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f659c00bbe0 tx=0x7f659c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:45.839+0000 7f65aaffd640 1 -- 172.21.15.2:0/3491129106 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f65a4014030 con 0x7f65ac105e80 2024-09-15T23:12:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.016+0000 7f65b41ed640 1 -- 172.21.15.2:0/3491129106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65ac109100 con 0x7f65ac105e80 2024-09-15T23:12:46.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.017+0000 7f65aaffd640 1 -- 172.21.15.2:0/3491129106 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22195 (secure 0 0 0) 0x7f65a409c980 con 0x7f65ac105e80 2024-09-15T23:12:46.019 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:12:46.019 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","created":"2024-09-15T23:04:45.101432+0000","modified":"2024-09-15T23:12:42.434365+0000","last_up_change":"2024-09-15T23:11:49.566858+0000","last_in_change":"2024-09-15T23:11:25.723093+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:07:57.919291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:38.100522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:40.716254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40ff4fd9-3904-4178-a9cb-51f4647be540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6803","nonce":280991401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6805","nonce":280991401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6809","nonce":280991401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6807","nonce":280991401}]},"public_addr":"172.21.15.2:6803/280991401","cluster_addr":"172.21.15.2:6805/280991401","heartbeat_back_addr":"172.21.15.2:6809/280991401","heartbeat_front_addr":"172.21.15.2:6807/280991401","state":["exists","up"]},{"osd":1,"uuid":"af5e265d-fe45-4d9c-a34c-6f0b103d75d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6801","nonce":2649210970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6803","nonce":2649210970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6807","nonce":2649210970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6805","nonce":2649210970}]},"public_addr":"172.21.15.112:6801/2649210970","cluster_addr":"172.21.15.112:6803/2649210970","heartbeat_back_addr":"172.21.15.112:6807/2649210970","heartbeat_front_addr":"172.21.15.112:6805/2649210970","state":["exists","up"]},{"osd":2,"uuid":"8df9e644-fc51-4626-a1a7-6ac4448a5b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6801","nonce":3485615437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6803","nonce":3485615437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6807","nonce":3485615437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6805","nonce":3485615437}]},"public_addr":"172.21.15.145:6801/3485615437","cluster_addr":"172.21.15.145:6803/3485615437","heartbeat_back_addr":"172.21.15.145:6807/3485615437","heartbeat_front_addr":"172.21.15.145:6805/3485615437","state":["exists","up"]},{"osd":3,"uuid":"dbab372a-8fdd-4b0c-bee3-16cd75b35ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6811","nonce":113061968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6813","nonce":113061968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6817","nonce":113061968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6815","nonce":113061968}]},"public_addr":"172.21.15.2:6811/113061968","cluster_addr":"172.21.15.2:6813/113061968","heartbeat_back_addr":"172.21.15.2:6817/113061968","heartbeat_front_addr":"172.21.15.2:6815/113061968","state":["exists","up"]},{"osd":4,"uuid":"73bab8af-3973-4beb-a034-d00bcf0c572f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6809","nonce":2519162767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6811","nonce":2519162767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6815","nonce":2519162767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6813","nonce":2519162767}]},"public_addr":"172.21.15.112:6809/2519162767","cluster_addr":"172.21.15.112:6811/2519162767","heartbeat_back_addr":"172.21.15.112:6815/2519162767","heartbeat_front_addr":"172.21.15.112:6813/2519162767","state":["exists","up"]},{"osd":5,"uuid":"2d163e61-5891-46c1-b1c2-39d50a3b6f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6809","nonce":712427242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6811","nonce":712427242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6815","nonce":712427242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6813","nonce":712427242}]},"public_addr":"172.21.15.145:6809/712427242","cluster_addr":"172.21.15.145:6811/712427242","heartbeat_back_addr":"172.21.15.145:6815/712427242","heartbeat_front_addr":"172.21.15.145:6813/712427242","state":["exists","up"]},{"osd":6,"uuid":"bca02c96-10de-4953-96e9-42fc9ddf7c1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6819","nonce":2930673197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6821","nonce":2930673197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6825","nonce":2930673197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6823","nonce":2930673197}]},"public_addr":"172.21.15.2:6819/2930673197","cluster_addr":"172.21.15.2:6821/2930673197","heartbeat_back_addr":"172.21.15.2:6825/2930673197","heartbeat_front_addr":"172.21.15.2:6823/2930673197","state":["exists","up"]},{"osd":7,"uuid":"4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6817","nonce":830628191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6819","nonce":830628191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6823","nonce":830628191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6821","nonce":830628191}]},"public_addr":"172.21.15.112:6817/830628191","cluster_addr":"172.21.15.112:6819/830628191","heartbeat_back_addr":"172.21.15.112:6823/830628191","heartbeat_front_addr":"172.21.15.112:6821/830628191","state":["exists","up"]},{"osd":8,"uuid":"2733f9dd-3872-4bec-9c22-bcdb64828ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6817","nonce":3634470540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6819","nonce":3634470540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6823","nonce":3634470540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6821","nonce":3634470540}]},"public_addr":"172.21.15.145:6817/3634470540","cluster_addr":"172.21.15.145:6819/3634470540","heartbeat_back_addr":"172.21.15.145:6823/3634470540","heartbeat_front_addr":"172.21.15.145:6821/3634470540","state":["exists","up"]},{"osd":9,"uuid":"bd1f4a4a-547c-43a9-859a-75b37b06905f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6827","nonce":1417377702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6829","nonce":1417377702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6833","nonce":1417377702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6831","nonce":1417377702}]},"public_addr":"172.21.15.2:6827/1417377702","cluster_addr":"172.21.15.2:6829/1417377702","heartbeat_back_addr":"172.21.15.2:6833/1417377702","heartbeat_front_addr":"172.21.15.2:6831/1417377702","state":["exists","up"]},{"osd":10,"uuid":"f8b895e8-39f5-4753-9343-03f96da12246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6825","nonce":105615908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6827","nonce":105615908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6831","nonce":105615908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6829","nonce":105615908}]},"public_addr":"172.21.15.112:6825/105615908","cluster_addr":"172.21.15.112:6827/105615908","heartbeat_back_addr":"172.21.15.112:6831/105615908","heartbeat_front_addr":"172.21.15.112:6829/105615908","state":["exists","up"]},{"osd":11,"uuid":"dc018bfc-bc13-4ef2-a712-5cd406a56cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6825","nonce":430484289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6827","nonce":430484289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6831","nonce":430484289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6829","nonce":430484289}]},"public_addr":"172.21.15.145:6825/430484289","cluster_addr":"172.21.15.145:6827/430484289","heartbeat_back_addr":"172.21.15.145:6831/430484289","heartbeat_front_addr":"172.21.15.145:6829/430484289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:03.938207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:29.814740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:54.853802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:20.802021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:47.028090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:13.226130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:39.003023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:04.465156+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:29.321331+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:55.992585+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:21.623406+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:48.269840+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/2956732837":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6800/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/896502743":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/3802152324":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/1891095221":"2024-09-16T23:05:17.756048+0000","172.21.15.2:6800/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/236781836":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/2404111366":"2024-09-16T23:05:17.756048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:46.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.019+0000 7f65b41ed640 1 -- 172.21.15.2:0/3491129106 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f65940a32c0 msgr2=0x7f65940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.019+0000 7f65b41ed640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f65940a32c0 0x7f65940a5780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f659c00bbe0 tx=0x7f659c00b390 comp rx=0 tx=0).stop 2024-09-15T23:12:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.019+0000 7f65b41ed640 1 -- 172.21.15.2:0/3491129106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac105e80 msgr2=0x7f65ac1a42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.019+0000 7f65b41ed640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac105e80 0x7f65ac1a42e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f65a400cce0 tx=0x7f65a400a620 comp rx=0 tx=0).stop 2024-09-15T23:12:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.019+0000 7f65b41ed640 1 -- 172.21.15.2:0/3491129106 shutdown_connections 2024-09-15T23:12:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.019+0000 7f65b41ed640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f65940a32c0 0x7f65940a5780 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.019+0000 7f65b41ed640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac105e80 0x7f65ac1a42e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.019+0000 7f65b41ed640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65ac101e30 0x7f65ac1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.019+0000 7f65b41ed640 1 --2- 172.21.15.2:0/3491129106 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f65ac101480 0x7f65ac199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.019+0000 7f65b41ed640 1 -- 172.21.15.2:0/3491129106 >> 172.21.15.2:0/3491129106 conn(0x7f65ac077210 msgr2=0x7f65ac104760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.019+0000 7f65b41ed640 1 -- 172.21.15.2:0/3491129106 shutdown_connections 2024-09-15T23:12:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:46.020+0000 7f65b41ed640 1 -- 172.21.15.2:0/3491129106 wait complete. 2024-09-15T23:12:46.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:12:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:46.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:46 smithi112 ceph-mon[34367]: pgmap v283: 97 pgs: 22 creating+peering, 11 unknown, 64 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 2 op/s 2024-09-15T23:12:46.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:46 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3491129106' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:12:47.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:46 smithi002 ceph-mon[31019]: pgmap v283: 97 pgs: 22 creating+peering, 11 unknown, 64 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 2 op/s 2024-09-15T23:12:47.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:46 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3491129106' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:12:47.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:46 smithi145 ceph-mon[34901]: pgmap v283: 97 pgs: 22 creating+peering, 11 unknown, 64 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 2 op/s 2024-09-15T23:12:47.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:46 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3491129106' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:12:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.475+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1932246908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c106a80 msgr2=0x7f3c0c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.475+0000 7f3c11bdd640 1 --2- 172.21.15.2:0/1932246908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c106a80 0x7f3c0c106e60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009930 tx=0x7f3bfc02a420 comp rx=0 tx=0).stop 2024-09-15T23:12:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.475+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1932246908 shutdown_connections 2024-09-15T23:12:47.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.475+0000 7f3c11bdd640 1 --2- 172.21.15.2:0/1932246908 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c101420 0x7f3c0c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.475+0000 7f3c11bdd640 1 --2- 172.21.15.2:0/1932246908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c0c100a80 0x7f3c0c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.475+0000 7f3c11bdd640 1 --2- 172.21.15.2:0/1932246908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c106a80 0x7f3c0c106e60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.475+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1932246908 >> 172.21.15.2:0/1932246908 conn(0x7f3c0c0fc7a0 msgr2=0x7f3c0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.475+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1932246908 shutdown_connections 2024-09-15T23:12:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.475+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1932246908 wait complete. 2024-09-15T23:12:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c11bdd640 1 Processor -- start 2024-09-15T23:12:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c11bdd640 1 -- start start 2024-09-15T23:12:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c11bdd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c100a80 0x7f3c0c1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c11bdd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c101420 0x7f3c0c1977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c11bdd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c0c106a80 0x7f3c0c19bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c11bdd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c110cf0 con 0x7f3c0c100a80 2024-09-15T23:12:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c11bdd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c110b70 con 0x7f3c0c101420 2024-09-15T23:12:47.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c11bdd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c110e70 con 0x7f3c0c106a80 2024-09-15T23:12:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c0b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c100a80 0x7f3c0c1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c0b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c100a80 0x7f3c0c1972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50444/0 (socket says 172.21.15.2:50444) 2024-09-15T23:12:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c0b7fe640 1 -- 172.21.15.2:0/1935359985 learned_addr learned my addr 172.21.15.2:0/1935359985 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c0bfff640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c0c106a80 0x7f3c0c19bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c0affd640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c101420 0x7f3c0c1977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c0b7fe640 1 -- 172.21.15.2:0/1935359985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c0c106a80 msgr2=0x7f3c0c19bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c0b7fe640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c0c106a80 0x7f3c0c19bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c0b7fe640 1 -- 172.21.15.2:0/1935359985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c101420 msgr2=0x7f3c0c1977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c0b7fe640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c101420 0x7f3c0c1977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.476+0000 7f3c0b7fe640 1 -- 172.21.15.2:0/1935359985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c19c260 con 0x7f3c0c100a80 2024-09-15T23:12:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.477+0000 7f3c0affd640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c101420 0x7f3c0c1977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.477+0000 7f3c0b7fe640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c100a80 0x7f3c0c1972b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc004770 tx=0x7f3bfc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.477+0000 7f3c08ff9640 1 -- 172.21.15.2:0/1935359985 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc03f070 con 0x7f3c0c100a80 2024-09-15T23:12:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.477+0000 7f3c08ff9640 1 -- 172.21.15.2:0/1935359985 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3bfc03b460 con 0x7f3c0c100a80 2024-09-15T23:12:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.477+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1935359985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0c19c4f0 con 0x7f3c0c100a80 2024-09-15T23:12:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.477+0000 7f3c08ff9640 1 -- 172.21.15.2:0/1935359985 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc035070 con 0x7f3c0c100a80 2024-09-15T23:12:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.477+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1935359985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c0c1a3e30 con 0x7f3c0c100a80 2024-09-15T23:12:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.478+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1935359985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c0c1021c0 con 0x7f3c0c100a80 2024-09-15T23:12:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.479+0000 7f3c08ff9640 1 -- 172.21.15.2:0/1935359985 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f3bfc03b610 con 0x7f3c0c100a80 2024-09-15T23:12:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.480+0000 7f3c08ff9640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3bf80a3240 0x7f3bf80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.480+0000 7f3c0affd640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3bf80a3240 0x7f3bf80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.480+0000 7f3c08ff9640 1 -- 172.21.15.2:0/1935359985 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f3bfc0efb80 con 0x7f3c0c100a80 2024-09-15T23:12:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.481+0000 7f3c0affd640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3bf80a3240 0x7f3bf80a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0feed0 tx=0x7f3bf40082f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:47.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.485+0000 7f3c08ff9640 1 -- 172.21.15.2:0/1935359985 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3bfc0bc9f0 con 0x7f3c0c100a80 2024-09-15T23:12:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.701+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1935359985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3c0c02d7c0 con 0x7f3c0c100a80 2024-09-15T23:12:47.746 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:12:47 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b[64564]: 2024-09-15T23:12:47.338+0000 7fc0b2fe0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:12:47.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.748+0000 7f3c08ff9640 1 -- 172.21.15.2:0/1935359985 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f3bfc0bc2f0 con 0x7f3c0c100a80 2024-09-15T23:12:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.750+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1935359985 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3bf80a3240 msgr2=0x7f3bf80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.750+0000 7f3c11bdd640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3bf80a3240 0x7f3bf80a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0feed0 tx=0x7f3bf40082f0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.750+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1935359985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c100a80 msgr2=0x7f3c0c1972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.750+0000 7f3c11bdd640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c100a80 0x7f3c0c1972b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc004770 tx=0x7f3bfc0042f0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.751+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1935359985 shutdown_connections 2024-09-15T23:12:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.751+0000 7f3c11bdd640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3bf80a3240 0x7f3bf80a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.751+0000 7f3c11bdd640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c0c106a80 0x7f3c0c19bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.751+0000 7f3c11bdd640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c0c101420 0x7f3c0c1977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.751+0000 7f3c11bdd640 1 --2- 172.21.15.2:0/1935359985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c100a80 0x7f3c0c1972b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.751+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1935359985 >> 172.21.15.2:0/1935359985 conn(0x7f3c0c0fc7a0 msgr2=0x7f3c0c0fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.751+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1935359985 shutdown_connections 2024-09-15T23:12:47.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:47.751+0000 7f3c11bdd640 1 -- 172.21.15.2:0/1935359985 wait complete. 2024-09-15T23:12:48.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:47 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1935359985' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T23:12:48.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:47 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1935359985' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T23:12:48.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:47 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1935359985' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T23:12:48.452 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-15T23:12:48.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-15T23:12:48.711 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:49.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:48 smithi002 ceph-mon[31019]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-15T23:12:49.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:48 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1935359985' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T23:12:49.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:48 smithi002 ceph-mon[31019]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T23:12:49.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:48 smithi145 ceph-mon[34901]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-15T23:12:49.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:48 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1935359985' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T23:12:49.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:48 smithi145 ceph-mon[34901]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T23:12:49.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.217+0000 7f7e78ea9640 1 -- 172.21.15.2:0/3906175855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e7410c170 msgr2=0x7f7e7410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.217+0000 7f7e78ea9640 1 --2- 172.21.15.2:0/3906175855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e7410c170 0x7f7e7410e610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009ca0 tx=0x7f7e6c02a950 comp rx=0 tx=0).stop 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.217+0000 7f7e78ea9640 1 -- 172.21.15.2:0/3906175855 shutdown_connections 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.217+0000 7f7e78ea9640 1 --2- 172.21.15.2:0/3906175855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e7410c170 0x7f7e7410e610 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.217+0000 7f7e78ea9640 1 --2- 172.21.15.2:0/3906175855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e74103660 0x7f7e7410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.217+0000 7f7e78ea9640 1 --2- 172.21.15.2:0/3906175855 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e74102d40 0x7f7e74103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.217+0000 7f7e78ea9640 1 -- 172.21.15.2:0/3906175855 >> 172.21.15.2:0/3906175855 conn(0x7f7e740fc7a0 msgr2=0x7f7e740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.217+0000 7f7e78ea9640 1 -- 172.21.15.2:0/3906175855 shutdown_connections 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.217+0000 7f7e78ea9640 1 -- 172.21.15.2:0/3906175855 wait complete. 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e78ea9640 1 Processor -- start 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e78ea9640 1 -- start start 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e78ea9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e74102d40 0x7f7e74198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e78ea9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e74103660 0x7f7e741988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e78ea9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7410c170 0x7f7e7419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e78ea9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7e74111e60 con 0x7f7e74103660 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e78ea9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7e74111ce0 con 0x7f7e7410c170 2024-09-15T23:12:49.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e78ea9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7e74111fe0 con 0x7f7e74102d40 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e69d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e74103660 0x7f7e741988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e69d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e74103660 0x7f7e741988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50450/0 (socket says 172.21.15.2:50450) 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e69d9b640 1 -- 172.21.15.2:0/2959338217 learned_addr learned my addr 172.21.15.2:0/2959338217 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e72d9d640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7410c170 0x7f7e7419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e7259c640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e74102d40 0x7f7e74198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e69d9b640 1 -- 172.21.15.2:0/2959338217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e74102d40 msgr2=0x7f7e74198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e69d9b640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e74102d40 0x7f7e74198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e69d9b640 1 -- 172.21.15.2:0/2959338217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7410c170 msgr2=0x7f7e7419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e69d9b640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7410c170 0x7f7e7419cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.218+0000 7f7e69d9b640 1 -- 172.21.15.2:0/2959338217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7419d330 con 0x7f7e74103660 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.219+0000 7f7e69d9b640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e74103660 0x7f7e741988c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00b3f0 tx=0x7f7e5c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.219+0000 7f7e6bfff640 1 -- 172.21.15.2:0/2959338217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c015020 con 0x7f7e74103660 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.219+0000 7f7e78ea9640 1 -- 172.21.15.2:0/2959338217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7419d620 con 0x7f7e74103660 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.219+0000 7f7e6bfff640 1 -- 172.21.15.2:0/2959338217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7e5c011ce0 con 0x7f7e74103660 2024-09-15T23:12:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.219+0000 7f7e6bfff640 1 -- 172.21.15.2:0/2959338217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c010d80 con 0x7f7e74103660 2024-09-15T23:12:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.219+0000 7f7e78ea9640 1 -- 172.21.15.2:0/2959338217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e741a4f00 con 0x7f7e74103660 2024-09-15T23:12:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.220+0000 7f7e78ea9640 1 -- 172.21.15.2:0/2959338217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e74103120 con 0x7f7e74103660 2024-09-15T23:12:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.221+0000 7f7e6bfff640 1 -- 172.21.15.2:0/2959338217 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f7e5c018020 con 0x7f7e74103660 2024-09-15T23:12:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.222+0000 7f7e6bfff640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7e600a3240 0x7f7e600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.222+0000 7f7e6bfff640 1 -- 172.21.15.2:0/2959338217 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f7e5c0cf110 con 0x7f7e74103660 2024-09-15T23:12:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.222+0000 7f7e7259c640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7e600a3240 0x7f7e600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.222+0000 7f7e7259c640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7e600a3240 0x7f7e600a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e64005fd0 tx=0x7f7e64005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.226+0000 7f7e6bfff640 1 -- 172.21.15.2:0/2959338217 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e5c01f020 con 0x7f7e74103660 2024-09-15T23:12:49.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:48 smithi112 ceph-mon[34367]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-15T23:12:49.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:48 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1935359985' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T23:12:49.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:48 smithi112 ceph-mon[34367]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T23:12:49.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.438+0000 7f7e78ea9640 1 -- 172.21.15.2:0/2959338217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f7e7402d7c0 con 0x7f7e74103660 2024-09-15T23:12:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.755+0000 7f7e6bfff640 1 -- 172.21.15.2:0/2959338217 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f7e5c09bf80 con 0x7f7e74103660 2024-09-15T23:12:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.758+0000 7f7e78ea9640 1 -- 172.21.15.2:0/2959338217 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7e600a3240 msgr2=0x7f7e600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.758+0000 7f7e78ea9640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7e600a3240 0x7f7e600a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e64005fd0 tx=0x7f7e64005850 comp rx=0 tx=0).stop 2024-09-15T23:12:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.758+0000 7f7e78ea9640 1 -- 172.21.15.2:0/2959338217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e74103660 msgr2=0x7f7e741988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.758+0000 7f7e78ea9640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e74103660 0x7f7e741988c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00b3f0 tx=0x7f7e5c00b8b0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.758+0000 7f7e78ea9640 1 -- 172.21.15.2:0/2959338217 shutdown_connections 2024-09-15T23:12:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.758+0000 7f7e78ea9640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7e600a3240 0x7f7e600a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.758+0000 7f7e78ea9640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7e7410c170 0x7f7e7419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.758+0000 7f7e78ea9640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e74103660 0x7f7e741988c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.758+0000 7f7e78ea9640 1 --2- 172.21.15.2:0/2959338217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e74102d40 0x7f7e74198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.758+0000 7f7e78ea9640 1 -- 172.21.15.2:0/2959338217 >> 172.21.15.2:0/2959338217 conn(0x7f7e740fc7a0 msgr2=0x7f7e740fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.758+0000 7f7e78ea9640 1 -- 172.21.15.2:0/2959338217 shutdown_connections 2024-09-15T23:12:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:49.759+0000 7f7e78ea9640 1 -- 172.21.15.2:0/2959338217 wait complete. 2024-09-15T23:12:50.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:49 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2959338217' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T23:12:50.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:49 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2959338217' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T23:12:50.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:49 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2959338217' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T23:12:50.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-15T23:12:50.720 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:51.009 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:50 smithi002 ceph-mon[31019]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-15T23:12:51.009 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:50 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2959338217' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T23:12:51.009 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:50 smithi002 ceph-mon[31019]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T23:12:51.009 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:50 smithi002 ceph-mon[31019]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T23:12:51.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:50 smithi145 ceph-mon[34901]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-15T23:12:51.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:50 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2959338217' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T23:12:51.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:50 smithi145 ceph-mon[34901]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T23:12:51.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:50 smithi145 ceph-mon[34901]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T23:12:51.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.233+0000 7f1409eed640 1 -- 172.21.15.2:0/2617001549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1404101420 msgr2=0x7f140410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:51.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.233+0000 7f1409eed640 1 --2- 172.21.15.2:0/2617001549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1404101420 0x7f140410d950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009cd0 tx=0x7f13fc02a8e0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.233+0000 7f1409eed640 1 -- 172.21.15.2:0/2617001549 shutdown_connections 2024-09-15T23:12:51.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.233+0000 7f1409eed640 1 --2- 172.21.15.2:0/2617001549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1404101420 0x7f140410d950 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.233+0000 7f1409eed640 1 --2- 172.21.15.2:0/2617001549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1404100a80 0x7f1404100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.233+0000 7f1409eed640 1 --2- 172.21.15.2:0/2617001549 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1404106a80 0x7f1404106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.233+0000 7f1409eed640 1 -- 172.21.15.2:0/2617001549 >> 172.21.15.2:0/2617001549 conn(0x7f14040fc7a0 msgr2=0x7f14040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:51.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.233+0000 7f1409eed640 1 -- 172.21.15.2:0/2617001549 shutdown_connections 2024-09-15T23:12:51.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.233+0000 7f1409eed640 1 -- 172.21.15.2:0/2617001549 wait complete. 2024-09-15T23:12:51.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.233+0000 7f1409eed640 1 Processor -- start 2024-09-15T23:12:51.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1409eed640 1 -- start start 2024-09-15T23:12:51.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1409eed640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1404100a80 0x7f1404198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:51.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1409eed640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1404101420 0x7f14041988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:51.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1409eed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1404106a80 0x7f140419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:51.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1409eed640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1404111e50 con 0x7f1404106a80 2024-09-15T23:12:51.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1409eed640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1404111cd0 con 0x7f1404101420 2024-09-15T23:12:51.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1409eed640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1404111fd0 con 0x7f1404100a80 2024-09-15T23:12:51.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1403fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1404106a80 0x7f140419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:51.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1403fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1404106a80 0x7f140419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50476/0 (socket says 172.21.15.2:50476) 2024-09-15T23:12:51.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1403fff640 1 -- 172.21.15.2:0/607665307 learned_addr learned my addr 172.21.15.2:0/607665307 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:51.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1402ffd640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1404101420 0x7f14041988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:51.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f14037fe640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1404100a80 0x7f1404198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:51.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1403fff640 1 -- 172.21.15.2:0/607665307 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1404100a80 msgr2=0x7f1404198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:51.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1403fff640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1404100a80 0x7f1404198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1403fff640 1 -- 172.21.15.2:0/607665307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1404101420 msgr2=0x7f14041988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:51.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1403fff640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1404101420 0x7f14041988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.234+0000 7f1403fff640 1 -- 172.21.15.2:0/607665307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140419d340 con 0x7f1404106a80 2024-09-15T23:12:51.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.235+0000 7f1403fff640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1404106a80 0x7f140419cc60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f13fc005cc0 tx=0x7f13fc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:51.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.235+0000 7f1400ff9640 1 -- 172.21.15.2:0/607665307 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc004240 con 0x7f1404106a80 2024-09-15T23:12:51.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.235+0000 7f1400ff9640 1 -- 172.21.15.2:0/607665307 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f13fc0305a0 con 0x7f1404106a80 2024-09-15T23:12:51.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.235+0000 7f1409eed640 1 -- 172.21.15.2:0/607665307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140419d5d0 con 0x7f1404106a80 2024-09-15T23:12:51.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.235+0000 7f1400ff9640 1 -- 172.21.15.2:0/607665307 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0466c0 con 0x7f1404106a80 2024-09-15T23:12:51.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.235+0000 7f1409eed640 1 -- 172.21.15.2:0/607665307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14041a4f10 con 0x7f1404106a80 2024-09-15T23:12:51.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.236+0000 7f1409eed640 1 -- 172.21.15.2:0/607665307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1404100ee0 con 0x7f1404106a80 2024-09-15T23:12:51.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.237+0000 7f1400ff9640 1 -- 172.21.15.2:0/607665307 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f13fc030ac0 con 0x7f1404106a80 2024-09-15T23:12:51.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.238+0000 7f1400ff9640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f13ec0a32c0 0x7f13ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:51.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.238+0000 7f14037fe640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f13ec0a32c0 0x7f13ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:51.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.238+0000 7f1400ff9640 1 -- 172.21.15.2:0/607665307 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f13fc02e030 con 0x7f1404106a80 2024-09-15T23:12:51.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.238+0000 7f14037fe640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f13ec0a32c0 0x7f13ec0a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f13f40058c0 tx=0x7f13f400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:51.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.243+0000 7f1400ff9640 1 -- 172.21.15.2:0/607665307 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13fc04b060 con 0x7f1404106a80 2024-09-15T23:12:51.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:50 smithi112 ceph-mon[34367]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-15T23:12:51.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:50 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2959338217' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T23:12:51.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:50 smithi112 ceph-mon[34367]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T23:12:51.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:50 smithi112 ceph-mon[34367]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T23:12:51.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.455+0000 7f1409eed640 1 -- 172.21.15.2:0/607665307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f1404109070 con 0x7f1404106a80 2024-09-15T23:12:51.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.762+0000 7f1400ff9640 1 -- 172.21.15.2:0/607665307 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f13fc0bdae0 con 0x7f1404106a80 2024-09-15T23:12:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.765+0000 7f1409eed640 1 -- 172.21.15.2:0/607665307 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f13ec0a32c0 msgr2=0x7f13ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.765+0000 7f1409eed640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f13ec0a32c0 0x7f13ec0a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f13f40058c0 tx=0x7f13f400a2d0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.765+0000 7f1409eed640 1 -- 172.21.15.2:0/607665307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1404106a80 msgr2=0x7f140419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.765+0000 7f1409eed640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1404106a80 0x7f140419cc60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f13fc005cc0 tx=0x7f13fc003ba0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.765+0000 7f1409eed640 1 -- 172.21.15.2:0/607665307 shutdown_connections 2024-09-15T23:12:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.765+0000 7f1409eed640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f13ec0a32c0 0x7f13ec0a5780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.765+0000 7f1409eed640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1404106a80 0x7f140419cc60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.765+0000 7f1409eed640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1404101420 0x7f14041988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.765+0000 7f1409eed640 1 --2- 172.21.15.2:0/607665307 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1404100a80 0x7f1404198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.765+0000 7f1409eed640 1 -- 172.21.15.2:0/607665307 >> 172.21.15.2:0/607665307 conn(0x7f14040fc7a0 msgr2=0x7f14040fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:51.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.766+0000 7f1409eed640 1 -- 172.21.15.2:0/607665307 shutdown_connections 2024-09-15T23:12:51.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:51.766+0000 7f1409eed640 1 -- 172.21.15.2:0/607665307 wait complete. 2024-09-15T23:12:52.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:51 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/607665307' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T23:12:52.109 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:51 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/607665307' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T23:12:52.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:51 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/607665307' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T23:12:52.420 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-15T23:12:52.420 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-15T23:12:52.689 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:52 smithi002 ceph-mon[31019]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 419 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-15T23:12:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:52 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/607665307' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T23:12:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:52 smithi002 ceph-mon[31019]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T23:12:53.148 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:52 smithi112 ceph-mon[34367]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 419 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-15T23:12:53.148 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:52 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/607665307' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T23:12:53.148 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:52 smithi112 ceph-mon[34367]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T23:12:53.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.182+0000 7f26a5c37640 1 -- 172.21.15.2:0/1935306797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26a0101df0 msgr2=0x7f26a0105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.182+0000 7f26a5c37640 1 --2- 172.21.15.2:0/1935306797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26a0101df0 0x7f26a0105920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2694009900 tx=0x7f269402a410 comp rx=0 tx=0).stop 2024-09-15T23:12:53.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.182+0000 7f26a5c37640 1 -- 172.21.15.2:0/1935306797 shutdown_connections 2024-09-15T23:12:53.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.182+0000 7f26a5c37640 1 --2- 172.21.15.2:0/1935306797 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26a0106050 0x7f26a010dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.182+0000 7f26a5c37640 1 --2- 172.21.15.2:0/1935306797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26a0101df0 0x7f26a0105920 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.182+0000 7f26a5c37640 1 --2- 172.21.15.2:0/1935306797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26a0101440 0x7f26a0101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.182+0000 7f26a5c37640 1 -- 172.21.15.2:0/1935306797 >> 172.21.15.2:0/1935306797 conn(0x7f26a0077210 msgr2=0x7f26a00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:53.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.182+0000 7f26a5c37640 1 -- 172.21.15.2:0/1935306797 shutdown_connections 2024-09-15T23:12:53.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.182+0000 7f26a5c37640 1 -- 172.21.15.2:0/1935306797 wait complete. 2024-09-15T23:12:53.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.182+0000 7f26a5c37640 1 Processor -- start 2024-09-15T23:12:53.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f26a5c37640 1 -- start start 2024-09-15T23:12:53.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f26a5c37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26a0101440 0x7f26a01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f26a5c37640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26a0101df0 0x7f26a0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f26a5c37640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26a0106050 0x7f26a019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f26a5c37640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f26a0110f50 con 0x7f26a0101df0 2024-09-15T23:12:53.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f26a5c37640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f26a0110dd0 con 0x7f26a0101440 2024-09-15T23:12:53.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f26a5c37640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f26a01110d0 con 0x7f26a0106050 2024-09-15T23:12:53.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f269effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26a0101df0 0x7f26a0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f269effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26a0101df0 0x7f26a0198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50488/0 (socket says 172.21.15.2:50488) 2024-09-15T23:12:53.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f269effd640 1 -- 172.21.15.2:0/1297478511 learned_addr learned my addr 172.21.15.2:0/1297478511 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:53.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f269ffff640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26a0106050 0x7f26a019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f269f7fe640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26a0101440 0x7f26a01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f269effd640 1 -- 172.21.15.2:0/1297478511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26a0106050 msgr2=0x7f26a019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f269effd640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26a0106050 0x7f26a019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f269effd640 1 -- 172.21.15.2:0/1297478511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26a0101440 msgr2=0x7f26a01985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f269effd640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26a0101440 0x7f26a01985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f269effd640 1 -- 172.21.15.2:0/1297478511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a019d560 con 0x7f26a0101df0 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.183+0000 7f269f7fe640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26a0101440 0x7f26a01985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.184+0000 7f269effd640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26a0101df0 0x7f26a0198af0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2694005ab0 tx=0x7f2694003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.184+0000 7f269cff9640 1 -- 172.21.15.2:0/1297478511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269403f070 con 0x7f26a0101df0 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.184+0000 7f269cff9640 1 -- 172.21.15.2:0/1297478511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2694031d60 con 0x7f26a0101df0 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.184+0000 7f26a5c37640 1 -- 172.21.15.2:0/1297478511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a019d7f0 con 0x7f26a0101df0 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.184+0000 7f269cff9640 1 -- 172.21.15.2:0/1297478511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694035030 con 0x7f26a0101df0 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.184+0000 7f26a5c37640 1 -- 172.21.15.2:0/1297478511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a01a5130 con 0x7f26a0101df0 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.185+0000 7f26a5c37640 1 -- 172.21.15.2:0/1297478511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26a0102490 con 0x7f26a0101df0 2024-09-15T23:12:53.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.186+0000 7f269cff9640 1 -- 172.21.15.2:0/1297478511 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2694042070 con 0x7f26a0101df0 2024-09-15T23:12:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.187+0000 7f269cff9640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f26880a3240 0x7f26880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.187+0000 7f269f7fe640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f26880a3240 0x7f26880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.187+0000 7f269cff9640 1 -- 172.21.15.2:0/1297478511 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f26940f0020 con 0x7f26a0101df0 2024-09-15T23:12:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.187+0000 7f269f7fe640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f26880a3240 0x7f26880a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f26900058c0 tx=0x7f2690005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.191+0000 7f269cff9640 1 -- 172.21.15.2:0/1297478511 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26940bce90 con 0x7f26a0101df0 2024-09-15T23:12:53.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:52 smithi145 ceph-mon[34901]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 419 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-15T23:12:53.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:52 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/607665307' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T23:12:53.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:52 smithi145 ceph-mon[34901]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T23:12:53.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.390+0000 7f26a5c37640 1 -- 172.21.15.2:0/1297478511 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f26a006a570 con 0x7f26880a3240 2024-09-15T23:12:53.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.408+0000 7f269cff9640 1 -- 172.21.15.2:0/1297478511 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f26a006a570 con 0x7f26880a3240 2024-09-15T23:12:53.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.410+0000 7f26a5c37640 1 -- 172.21.15.2:0/1297478511 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f26880a3240 msgr2=0x7f26880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.410+0000 7f26a5c37640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f26880a3240 0x7f26880a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f26900058c0 tx=0x7f2690005850 comp rx=0 tx=0).stop 2024-09-15T23:12:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.410+0000 7f26a5c37640 1 -- 172.21.15.2:0/1297478511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26a0101df0 msgr2=0x7f26a0198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.410+0000 7f26a5c37640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26a0101df0 0x7f26a0198af0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2694005ab0 tx=0x7f2694003c80 comp rx=0 tx=0).stop 2024-09-15T23:12:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.410+0000 7f26a5c37640 1 -- 172.21.15.2:0/1297478511 shutdown_connections 2024-09-15T23:12:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.410+0000 7f26a5c37640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f26880a3240 0x7f26880a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.410+0000 7f26a5c37640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f26a0106050 0x7f26a019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.410+0000 7f26a5c37640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26a0101df0 0x7f26a0198af0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.410+0000 7f26a5c37640 1 --2- 172.21.15.2:0/1297478511 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26a0101440 0x7f26a01985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.410+0000 7f26a5c37640 1 -- 172.21.15.2:0/1297478511 >> 172.21.15.2:0/1297478511 conn(0x7f26a0077210 msgr2=0x7f26a01003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.411+0000 7f26a5c37640 1 -- 172.21.15.2:0/1297478511 shutdown_connections 2024-09-15T23:12:53.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:53.411+0000 7f26a5c37640 1 -- 172.21.15.2:0/1297478511 wait complete. 2024-09-15T23:12:53.771 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:12:53 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:12:53.395+0000 7f1574370640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:12:53.771 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:12:53 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:12:53.395+0000 7f1574370640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:12:53.771 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:12:53 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:12:53.395+0000 7f1574370640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:12:53.771 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:12:53 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:12:53.395+0000 7f1574370640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:12:53.771 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:12:53 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:12:53.395+0000 7f1574370640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:12:54.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:53 smithi002 ceph-mon[31019]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:12:54.167 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:53 smithi112 ceph-mon[34367]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:12:54.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:53 smithi145 ceph-mon[34901]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:12:54.238 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-15T23:12:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:54.908 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:54 smithi002 ceph-mon[31019]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-15T23:12:54.908 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:54 smithi002 ceph-mon[31019]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T23:12:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.995+0000 7f336193a640 1 -- 172.21.15.2:0/311154891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c101de0 msgr2=0x7f335c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.995+0000 7f336193a640 1 --2- 172.21.15.2:0/311154891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c101de0 0x7f335c1021c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f334c009900 tx=0x7f334c02a410 comp rx=0 tx=0).stop 2024-09-15T23:12:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.995+0000 7f336193a640 1 -- 172.21.15.2:0/311154891 shutdown_connections 2024-09-15T23:12:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.995+0000 7f336193a640 1 --2- 172.21.15.2:0/311154891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c106f10 0x7f335c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.995+0000 7f336193a640 1 --2- 172.21.15.2:0/311154891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f335c102790 0x7f335c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.995+0000 7f336193a640 1 --2- 172.21.15.2:0/311154891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c101de0 0x7f335c1021c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.995+0000 7f336193a640 1 -- 172.21.15.2:0/311154891 >> 172.21.15.2:0/311154891 conn(0x7f335c0fd8c0 msgr2=0x7f335c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.995+0000 7f336193a640 1 -- 172.21.15.2:0/311154891 shutdown_connections 2024-09-15T23:12:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.995+0000 7f336193a640 1 -- 172.21.15.2:0/311154891 wait complete. 2024-09-15T23:12:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.996+0000 7f336193a640 1 Processor -- start 2024-09-15T23:12:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.996+0000 7f336193a640 1 -- start start 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.996+0000 7f336193a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c101de0 0x7f335c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.996+0000 7f336193a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f335c102790 0x7f335c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.996+0000 7f336193a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c106f10 0x7f335c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.996+0000 7f336193a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f335c111de0 con 0x7f335c106f10 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.996+0000 7f336193a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f335c111c60 con 0x7f335c101de0 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.996+0000 7f336193a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f335c111f60 con 0x7f335c102790 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.996+0000 7f335b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c106f10 0x7f335c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.996+0000 7f335b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c106f10 0x7f335c19cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50524/0 (socket says 172.21.15.2:50524) 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.996+0000 7f335b7fe640 1 -- 172.21.15.2:0/2193694174 learned_addr learned my addr 172.21.15.2:0/2193694174 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.996+0000 7f335affd640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c101de0 0x7f335c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.997+0000 7f335b7fe640 1 -- 172.21.15.2:0/2193694174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f335c102790 msgr2=0x7f335c1988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.997+0000 7f335b7fe640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f335c102790 0x7f335c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.997+0000 7f335b7fe640 1 -- 172.21.15.2:0/2193694174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c101de0 msgr2=0x7f335c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.997+0000 7f335b7fe640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c101de0 0x7f335c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.997+0000 7f335b7fe640 1 -- 172.21.15.2:0/2193694174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335c19d330 con 0x7f335c106f10 2024-09-15T23:12:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.997+0000 7f335affd640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c101de0 0x7f335c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.997+0000 7f335b7fe640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c106f10 0x7f335c19cc50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f335400eb10 tx=0x7f335400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.997+0000 7f3360938640 1 -- 172.21.15.2:0/2193694174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3354004b20 con 0x7f335c106f10 2024-09-15T23:12:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.997+0000 7f336193a640 1 -- 172.21.15.2:0/2193694174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335c19d620 con 0x7f335c106f10 2024-09-15T23:12:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.997+0000 7f3360938640 1 -- 172.21.15.2:0/2193694174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3354004cc0 con 0x7f335c106f10 2024-09-15T23:12:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.997+0000 7f3360938640 1 -- 172.21.15.2:0/2193694174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3354010690 con 0x7f335c106f10 2024-09-15T23:12:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.997+0000 7f336193a640 1 -- 172.21.15.2:0/2193694174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f335c1a4f00 con 0x7f335c106f10 2024-09-15T23:12:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.998+0000 7f336193a640 1 -- 172.21.15.2:0/2193694174 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f335c1021c0 con 0x7f335c106f10 2024-09-15T23:12:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:54.999+0000 7f3360938640 1 -- 172.21.15.2:0/2193694174 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3354005020 con 0x7f335c106f10 2024-09-15T23:12:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.000+0000 7f3360938640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f33480a32d0 0x7f33480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.000+0000 7f335affd640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f33480a32d0 0x7f33480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.000+0000 7f3360938640 1 -- 172.21.15.2:0/2193694174 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f33540cffa0 con 0x7f335c106f10 2024-09-15T23:12:55.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.001+0000 7f335affd640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f33480a32d0 0x7f33480a5790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f334c031440 tx=0x7f334c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:55.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.004+0000 7f3360938640 1 -- 172.21.15.2:0/2193694174 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f335409cd10 con 0x7f335c106f10 2024-09-15T23:12:55.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:54 smithi145 ceph-mon[34901]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-15T23:12:55.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:54 smithi145 ceph-mon[34901]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T23:12:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.206+0000 7f336193a640 1 -- 172.21.15.2:0/2193694174 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f335c062630 con 0x7f33480a32d0 2024-09-15T23:12:55.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.228+0000 7f3360938640 1 -- 172.21.15.2:0/2193694174 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f335c062630 con 0x7f33480a32d0 2024-09-15T23:12:55.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.230+0000 7f336193a640 1 -- 172.21.15.2:0/2193694174 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f33480a32d0 msgr2=0x7f33480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.230+0000 7f336193a640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f33480a32d0 0x7f33480a5790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f334c031440 tx=0x7f334c005a20 comp rx=0 tx=0).stop 2024-09-15T23:12:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.230+0000 7f336193a640 1 -- 172.21.15.2:0/2193694174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c106f10 msgr2=0x7f335c19cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.230+0000 7f336193a640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c106f10 0x7f335c19cc50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f335400eb10 tx=0x7f335400c2d0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.230+0000 7f336193a640 1 -- 172.21.15.2:0/2193694174 shutdown_connections 2024-09-15T23:12:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.230+0000 7f336193a640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f33480a32d0 0x7f33480a5790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.230+0000 7f336193a640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c106f10 0x7f335c19cc50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.230+0000 7f336193a640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f335c102790 0x7f335c1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.230+0000 7f336193a640 1 --2- 172.21.15.2:0/2193694174 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f335c101de0 0x7f335c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.230+0000 7f336193a640 1 -- 172.21.15.2:0/2193694174 >> 172.21.15.2:0/2193694174 conn(0x7f335c0fd8c0 msgr2=0x7f335c0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.230+0000 7f336193a640 1 -- 172.21.15.2:0/2193694174 shutdown_connections 2024-09-15T23:12:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:55.230+0000 7f336193a640 1 -- 172.21.15.2:0/2193694174 wait complete. 2024-09-15T23:12:55.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:54 smithi112 ceph-mon[34367]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-15T23:12:55.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:54 smithi112 ceph-mon[34367]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T23:12:56.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:55 smithi002 ceph-mon[31019]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:12:56.072 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-15T23:12:56.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:55 smithi145 ceph-mon[34901]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:12:56.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:55 smithi112 ceph-mon[34367]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:12:56.334 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.795+0000 7f47638a9640 1 -- 172.21.15.2:0/3355047415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f475c102d90 msgr2=0x7f475c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.795+0000 7f47638a9640 1 --2- 172.21.15.2:0/3355047415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f475c102d90 0x7f475c103170 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4758009930 tx=0x7f475802a420 comp rx=0 tx=0).stop 2024-09-15T23:12:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.795+0000 7f47638a9640 1 -- 172.21.15.2:0/3355047415 shutdown_connections 2024-09-15T23:12:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.795+0000 7f47638a9640 1 --2- 172.21.15.2:0/3355047415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475c108290 0x7f475c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.795+0000 7f47638a9640 1 --2- 172.21.15.2:0/3355047415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f475c103740 0x7f475c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.795+0000 7f47638a9640 1 --2- 172.21.15.2:0/3355047415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f475c102d90 0x7f475c103170 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.795+0000 7f47638a9640 1 -- 172.21.15.2:0/3355047415 >> 172.21.15.2:0/3355047415 conn(0x7f475c0fc7d0 msgr2=0x7f475c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.795+0000 7f47638a9640 1 -- 172.21.15.2:0/3355047415 shutdown_connections 2024-09-15T23:12:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.795+0000 7f47638a9640 1 -- 172.21.15.2:0/3355047415 wait complete. 2024-09-15T23:12:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f47638a9640 1 Processor -- start 2024-09-15T23:12:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f47638a9640 1 -- start start 2024-09-15T23:12:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f47638a9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f475c102d90 0x7f475c1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f47638a9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475c103740 0x7f475c100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f47638a9640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f475c108290 0x7f475c101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f47638a9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f475c111f40 con 0x7f475c102d90 2024-09-15T23:12:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f47638a9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f475c111dc0 con 0x7f475c103740 2024-09-15T23:12:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f47638a9640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f475c1120c0 con 0x7f475c108290 2024-09-15T23:12:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f4761645640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f475c102d90 0x7f475c1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f4761645640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f475c102d90 0x7f475c1009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48284/0 (socket says 172.21.15.2:48284) 2024-09-15T23:12:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f4761645640 1 -- 172.21.15.2:0/3557539725 learned_addr learned my addr 172.21.15.2:0/3557539725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f4761e46640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f475c108290 0x7f475c101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f4760e44640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475c103740 0x7f475c100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f4761645640 1 -- 172.21.15.2:0/3557539725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f475c108290 msgr2=0x7f475c101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f4761645640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f475c108290 0x7f475c101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f4761645640 1 -- 172.21.15.2:0/3557539725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475c103740 msgr2=0x7f475c100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f4761645640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475c103740 0x7f475c100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.796+0000 7f4761645640 1 -- 172.21.15.2:0/3557539725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c1a68b0 con 0x7f475c102d90 2024-09-15T23:12:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.797+0000 7f4760e44640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475c103740 0x7f475c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.797+0000 7f4761645640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f475c102d90 0x7f475c1009f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4758005940 tx=0x7f47580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.797+0000 7f47527fc640 1 -- 172.21.15.2:0/3557539725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475803f030 con 0x7f475c102d90 2024-09-15T23:12:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.797+0000 7f47527fc640 1 -- 172.21.15.2:0/3557539725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4758003cb0 con 0x7f475c102d90 2024-09-15T23:12:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.797+0000 7f47638a9640 1 -- 172.21.15.2:0/3557539725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475c1a6b40 con 0x7f475c102d90 2024-09-15T23:12:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.797+0000 7f47527fc640 1 -- 172.21.15.2:0/3557539725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4758035070 con 0x7f475c102d90 2024-09-15T23:12:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.797+0000 7f47638a9640 1 -- 172.21.15.2:0/3557539725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f475c1a7070 con 0x7f475c102d90 2024-09-15T23:12:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.798+0000 7f47638a9640 1 -- 172.21.15.2:0/3557539725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f475c06a7f0 con 0x7f475c102d90 2024-09-15T23:12:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.799+0000 7f47527fc640 1 -- 172.21.15.2:0/3557539725 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4758042030 con 0x7f475c102d90 2024-09-15T23:12:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.800+0000 7f47527fc640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f47480a3350 0x7f47480a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.800+0000 7f4760e44640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f47480a3350 0x7f47480a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.800+0000 7f47527fc640 1 -- 172.21.15.2:0/3557539725 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f47580f0050 con 0x7f475c102d90 2024-09-15T23:12:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.800+0000 7f4760e44640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f47480a3350 0x7f47480a5810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f475c102480 tx=0x7f474c005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:56.803+0000 7f47527fc640 1 -- 172.21.15.2:0/3557539725 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47580bcdc0 con 0x7f475c102d90 2024-09-15T23:12:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.005+0000 7f47638a9640 1 -- 172.21.15.2:0/3557539725 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f475c10a310 con 0x7f47480a3350 2024-09-15T23:12:57.007 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:56 smithi002 ceph-mon[31019]: pgmap v288: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1023 B/s wr, 4 op/s 2024-09-15T23:12:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.010+0000 7f47527fc640 1 -- 172.21.15.2:0/3557539725 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f474c00da50 con 0x7f47480a3350 2024-09-15T23:12:57.011 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_0/feb3a3b8-51fb-4030-9ca4-6f5bffc6040f 2024-09-15T23:12:57.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.012+0000 7f47638a9640 1 -- 172.21.15.2:0/3557539725 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f47480a3350 msgr2=0x7f47480a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.012+0000 7f47638a9640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f47480a3350 0x7f47480a5810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f475c102480 tx=0x7f474c005d90 comp rx=0 tx=0).stop 2024-09-15T23:12:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.012+0000 7f47638a9640 1 -- 172.21.15.2:0/3557539725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f475c102d90 msgr2=0x7f475c1009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.012+0000 7f47638a9640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f475c102d90 0x7f475c1009f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4758005940 tx=0x7f47580042f0 comp rx=0 tx=0).stop 2024-09-15T23:12:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.012+0000 7f47638a9640 1 -- 172.21.15.2:0/3557539725 shutdown_connections 2024-09-15T23:12:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.012+0000 7f47638a9640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f47480a3350 0x7f47480a5810 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.012+0000 7f47638a9640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f475c108290 0x7f475c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.012+0000 7f47638a9640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f475c103740 0x7f475c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.012+0000 7f47638a9640 1 --2- 172.21.15.2:0/3557539725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f475c102d90 0x7f475c1009f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.012+0000 7f47638a9640 1 -- 172.21.15.2:0/3557539725 >> 172.21.15.2:0/3557539725 conn(0x7f475c0fc7d0 msgr2=0x7f475c106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.012+0000 7f47638a9640 1 -- 172.21.15.2:0/3557539725 shutdown_connections 2024-09-15T23:12:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:57.012+0000 7f47638a9640 1 -- 172.21.15.2:0/3557539725 wait complete. 2024-09-15T23:12:57.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:56 smithi145 ceph-mon[34901]: pgmap v288: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1023 B/s wr, 4 op/s 2024-09-15T23:12:57.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:56 smithi112 ceph-mon[34367]: pgmap v288: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1023 B/s wr, 4 op/s 2024-09-15T23:12:57.801 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-15T23:12:58.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:57 smithi002 ceph-mon[31019]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:12:58.062 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:12:58.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:57 smithi145 ceph-mon[34901]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:12:58.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:57 smithi112 ceph-mon[34367]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:12:58.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.534+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/681525903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d48103740 msgr2=0x7f4d48107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:58.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.534+0000 7f4d4fa4b640 1 --2- 172.21.15.2:0/681525903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d48103740 0x7f4d48107b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009930 tx=0x7f4d3802a420 comp rx=0 tx=0).stop 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.534+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/681525903 shutdown_connections 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.534+0000 7f4d4fa4b640 1 --2- 172.21.15.2:0/681525903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d48108290 0x7f4d4810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.534+0000 7f4d4fa4b640 1 --2- 172.21.15.2:0/681525903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d48103740 0x7f4d48107b80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.534+0000 7f4d4fa4b640 1 --2- 172.21.15.2:0/681525903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d48102d90 0x7f4d48103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.534+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/681525903 >> 172.21.15.2:0/681525903 conn(0x7f4d480fc7d0 msgr2=0x7f4d480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.535+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/681525903 shutdown_connections 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.535+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/681525903 wait complete. 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.535+0000 7f4d4fa4b640 1 Processor -- start 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.535+0000 7f4d4fa4b640 1 -- start start 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.535+0000 7f4d4fa4b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d48102d90 0x7f4d481009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.535+0000 7f4d4fa4b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d48103740 0x7f4d48100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.535+0000 7f4d4fa4b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d48108290 0x7f4d48101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.535+0000 7f4d4fa4b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d48111f40 con 0x7f4d48103740 2024-09-15T23:12:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.535+0000 7f4d4fa4b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4d48111dc0 con 0x7f4d48108290 2024-09-15T23:12:58.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.535+0000 7f4d4fa4b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481120c0 con 0x7f4d48102d90 2024-09-15T23:12:58.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.535+0000 7f4d4cfe6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d48103740 0x7f4d48100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:58.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.535+0000 7f4d4cfe6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d48103740 0x7f4d48100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48300/0 (socket says 172.21.15.2:48300) 2024-09-15T23:12:58.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.535+0000 7f4d4cfe6640 1 -- 172.21.15.2:0/20111872 learned_addr learned my addr 172.21.15.2:0/20111872 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:12:58.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.536+0000 7f4d4d7e7640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d48102d90 0x7f4d481009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:58.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.536+0000 7f4d4dfe8640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d48108290 0x7f4d48101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:58.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.536+0000 7f4d4cfe6640 1 -- 172.21.15.2:0/20111872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d48102d90 msgr2=0x7f4d481009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:58.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.536+0000 7f4d4cfe6640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d48102d90 0x7f4d481009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:58.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.536+0000 7f4d4cfe6640 1 -- 172.21.15.2:0/20111872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d48108290 msgr2=0x7f4d48101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:58.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.536+0000 7f4d4cfe6640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d48108290 0x7f4d48101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:58.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.536+0000 7f4d4cfe6640 1 -- 172.21.15.2:0/20111872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d481a6a00 con 0x7f4d48103740 2024-09-15T23:12:58.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.536+0000 7f4d4cfe6640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d48103740 0x7f4d48100f30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d38031440 tx=0x7f4d38004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:58.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.536+0000 7f4d3e7fc640 1 -- 172.21.15.2:0/20111872 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3803f030 con 0x7f4d48103740 2024-09-15T23:12:58.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.536+0000 7f4d3e7fc640 1 -- 172.21.15.2:0/20111872 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d38003aa0 con 0x7f4d48103740 2024-09-15T23:12:58.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.536+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/20111872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d481a6c90 con 0x7f4d48103740 2024-09-15T23:12:58.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.536+0000 7f4d3e7fc640 1 -- 172.21.15.2:0/20111872 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38035070 con 0x7f4d48103740 2024-09-15T23:12:58.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.536+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/20111872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d481a71c0 con 0x7f4d48103740 2024-09-15T23:12:58.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.537+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/20111872 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d4806a7f0 con 0x7f4d48103740 2024-09-15T23:12:58.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.539+0000 7f4d3e7fc640 1 -- 172.21.15.2:0/20111872 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4d38042030 con 0x7f4d48103740 2024-09-15T23:12:58.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.539+0000 7f4d3e7fc640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f4d340a3350 0x7f4d340a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:58.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.539+0000 7f4d4d7e7640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f4d340a3350 0x7f4d340a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:58.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.539+0000 7f4d3e7fc640 1 -- 172.21.15.2:0/20111872 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f4d380eff70 con 0x7f4d48103740 2024-09-15T23:12:58.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.540+0000 7f4d4d7e7640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f4d340a3350 0x7f4d340a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4d44005fd0 tx=0x7f4d4400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:58.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.543+0000 7f4d3e7fc640 1 -- 172.21.15.2:0/20111872 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d380bcce0 con 0x7f4d48103740 2024-09-15T23:12:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.748+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/20111872 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4d48062630 con 0x7f4d340a3350 2024-09-15T23:12:58.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.771+0000 7f4d3e7fc640 1 -- 172.21.15.2:0/20111872 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4d48062630 con 0x7f4d340a3350 2024-09-15T23:12:58.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.773+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/20111872 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f4d340a3350 msgr2=0x7f4d340a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:58.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.773+0000 7f4d4fa4b640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f4d340a3350 0x7f4d340a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4d44005fd0 tx=0x7f4d4400b390 comp rx=0 tx=0).stop 2024-09-15T23:12:58.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.773+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/20111872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d48103740 msgr2=0x7f4d48100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:58.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.773+0000 7f4d4fa4b640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d48103740 0x7f4d48100f30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d38031440 tx=0x7f4d38004270 comp rx=0 tx=0).stop 2024-09-15T23:12:58.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.773+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/20111872 shutdown_connections 2024-09-15T23:12:58.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.773+0000 7f4d4fa4b640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f4d340a3350 0x7f4d340a5810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:58.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.773+0000 7f4d4fa4b640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d48108290 0x7f4d48101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:58.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.773+0000 7f4d4fa4b640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d48103740 0x7f4d48100f30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:58.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.773+0000 7f4d4fa4b640 1 --2- 172.21.15.2:0/20111872 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d48102d90 0x7f4d481009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:58.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.773+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/20111872 >> 172.21.15.2:0/20111872 conn(0x7f4d480fc7d0 msgr2=0x7f4d48105ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:58.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.773+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/20111872 shutdown_connections 2024-09-15T23:12:58.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:12:58.773+0000 7f4d4fa4b640 1 -- 172.21.15.2:0/20111872 wait complete. 2024-09-15T23:12:59.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:58 smithi002 ceph-mon[31019]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 767 B/s wr, 3 op/s 2024-09-15T23:12:59.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:58 smithi145 ceph-mon[34901]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 767 B/s wr, 3 op/s 2024-09-15T23:12:59.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:58 smithi112 ceph-mon[34367]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 767 B/s wr, 3 op/s 2024-09-15T23:12:59.514 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-15T23:12:59.773 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:00.054 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:12:59 smithi002 ceph-mon[31019]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:13:00.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:12:59 smithi145 ceph-mon[34901]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:13:00.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:12:59 smithi112 ceph-mon[34367]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:13:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.245+0000 7ff2c4d44640 1 -- 172.21.15.2:0/2316607006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2c0109120 msgr2=0x7ff2c0110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.245+0000 7ff2c4d44640 1 --2- 172.21.15.2:0/2316607006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2c0109120 0x7ff2c0110ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009ca0 tx=0x7ff2b802a8c0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.245+0000 7ff2c4d44640 1 -- 172.21.15.2:0/2316607006 shutdown_connections 2024-09-15T23:13:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.245+0000 7ff2c4d44640 1 --2- 172.21.15.2:0/2316607006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2c0109120 0x7ff2c0110ca0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.245+0000 7ff2c4d44640 1 --2- 172.21.15.2:0/2316607006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2c01049a0 0x7ff2c01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.245+0000 7ff2c4d44640 1 --2- 172.21.15.2:0/2316607006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2c0103ff0 0x7ff2c01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.245+0000 7ff2c4d44640 1 -- 172.21.15.2:0/2316607006 >> 172.21.15.2:0/2316607006 conn(0x7ff2c00ffa90 msgr2=0x7ff2c0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.245+0000 7ff2c4d44640 1 -- 172.21.15.2:0/2316607006 shutdown_connections 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.245+0000 7ff2c4d44640 1 -- 172.21.15.2:0/2316607006 wait complete. 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.246+0000 7ff2c4d44640 1 Processor -- start 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.246+0000 7ff2c4d44640 1 -- start start 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.246+0000 7ff2c4d44640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2c0103ff0 0x7ff2c019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.246+0000 7ff2c4d44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2c01049a0 0x7ff2c019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.246+0000 7ff2c4d44640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2c0109120 0x7ff2c019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.246+0000 7ff2c4d44640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01140d0 con 0x7ff2c01049a0 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.246+0000 7ff2c4d44640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0113f50 con 0x7ff2c0109120 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.246+0000 7ff2c4d44640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0114250 con 0x7ff2c0103ff0 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2bdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2c01049a0 0x7ff2c019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2bdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2c01049a0 0x7ff2c019aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48314/0 (socket says 172.21.15.2:48314) 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2bdd9b640 1 -- 172.21.15.2:0/3461417338 learned_addr learned my addr 172.21.15.2:0/3461417338 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2bed9d640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2c0109120 0x7ff2c019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2be59c640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2c0103ff0 0x7ff2c019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2bdd9b640 1 -- 172.21.15.2:0/3461417338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2c0103ff0 msgr2=0x7ff2c019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2bdd9b640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2c0103ff0 0x7ff2c019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2bdd9b640 1 -- 172.21.15.2:0/3461417338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2c0109120 msgr2=0x7ff2c019ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2bdd9b640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2c0109120 0x7ff2c019ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2bdd9b640 1 -- 172.21.15.2:0/3461417338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c019f560 con 0x7ff2c01049a0 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2bed9d640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2c0109120 0x7ff2c019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2be59c640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2c0103ff0 0x7ff2c019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2bdd9b640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2c01049a0 0x7ff2c019aaf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400b4a0 tx=0x7ff2b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2af7fe640 1 -- 172.21.15.2:0/3461417338 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4014070 con 0x7ff2c01049a0 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2c4d44640 1 -- 172.21.15.2:0/3461417338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c019f850 con 0x7ff2c01049a0 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2af7fe640 1 -- 172.21.15.2:0/3461417338 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2b4010ac0 con 0x7ff2c01049a0 2024-09-15T23:13:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2af7fe640 1 -- 172.21.15.2:0/3461417338 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4017c30 con 0x7ff2c01049a0 2024-09-15T23:13:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.247+0000 7ff2c4d44640 1 -- 172.21.15.2:0/3461417338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c01a7130 con 0x7ff2c01049a0 2024-09-15T23:13:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.248+0000 7ff2c4d44640 1 -- 172.21.15.2:0/3461417338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c01043d0 con 0x7ff2c01049a0 2024-09-15T23:13:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.249+0000 7ff2af7fe640 1 -- 172.21.15.2:0/3461417338 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff2b4017070 con 0x7ff2c01049a0 2024-09-15T23:13:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.250+0000 7ff2af7fe640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff2a80a32d0 0x7ff2a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.250+0000 7ff2be59c640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff2a80a32d0 0x7ff2a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.250+0000 7ff2af7fe640 1 -- 172.21.15.2:0/3461417338 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7ff2b40cef70 con 0x7ff2c01049a0 2024-09-15T23:13:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.250+0000 7ff2be59c640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff2a80a32d0 0x7ff2a80a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0006fd0 tx=0x7ff2b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.254+0000 7ff2af7fe640 1 -- 172.21.15.2:0/3461417338 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2b409bdf0 con 0x7ff2c01049a0 2024-09-15T23:13:00.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.459+0000 7ff2c4d44640 1 -- 172.21.15.2:0/3461417338 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7ff2c010c3c0 con 0x7ff2a80a32d0 2024-09-15T23:13:00.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.465+0000 7ff2af7fe640 1 -- 172.21.15.2:0/3461417338 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ff2c010c3c0 con 0x7ff2a80a32d0 2024-09-15T23:13:00.466 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_1/f8c20362-91d6-45c2-9829-9f0deef236a3 2024-09-15T23:13:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.468+0000 7ff2c4d44640 1 -- 172.21.15.2:0/3461417338 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff2a80a32d0 msgr2=0x7ff2a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.468+0000 7ff2c4d44640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff2a80a32d0 0x7ff2a80a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0006fd0 tx=0x7ff2b0008040 comp rx=0 tx=0).stop 2024-09-15T23:13:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.468+0000 7ff2c4d44640 1 -- 172.21.15.2:0/3461417338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2c01049a0 msgr2=0x7ff2c019aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.468+0000 7ff2c4d44640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2c01049a0 0x7ff2c019aaf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400b4a0 tx=0x7ff2b400b960 comp rx=0 tx=0).stop 2024-09-15T23:13:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.468+0000 7ff2c4d44640 1 -- 172.21.15.2:0/3461417338 shutdown_connections 2024-09-15T23:13:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.468+0000 7ff2c4d44640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff2a80a32d0 0x7ff2a80a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.468+0000 7ff2c4d44640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2c0109120 0x7ff2c019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.468+0000 7ff2c4d44640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2c01049a0 0x7ff2c019aaf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.468+0000 7ff2c4d44640 1 --2- 172.21.15.2:0/3461417338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff2c0103ff0 0x7ff2c019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.468+0000 7ff2c4d44640 1 -- 172.21.15.2:0/3461417338 >> 172.21.15.2:0/3461417338 conn(0x7ff2c00ffa90 msgr2=0x7ff2c0100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:00.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.468+0000 7ff2c4d44640 1 -- 172.21.15.2:0/3461417338 shutdown_connections 2024-09-15T23:13:00.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:00.468+0000 7ff2c4d44640 1 -- 172.21.15.2:0/3461417338 wait complete. 2024-09-15T23:13:01.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:00 smithi002 ceph-mon[31019]: pgmap v290: 97 pgs: 97 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-15T23:13:01.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:00 smithi002 ceph-mon[31019]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:13:01.160 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:13:01.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:00 smithi145 ceph-mon[34901]: pgmap v290: 97 pgs: 97 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-15T23:13:01.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:00 smithi145 ceph-mon[34901]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:13:01.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:00 smithi112 ceph-mon[34367]: pgmap v290: 97 pgs: 97 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.6 KiB/s wr, 3 op/s 2024-09-15T23:13:01.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:00 smithi112 ceph-mon[34367]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:13:01.416 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:01.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.915+0000 7fa146ebc640 1 -- 172.21.15.2:0/296270022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa140102790 msgr2=0x7fa1401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.915+0000 7fa146ebc640 1 --2- 172.21.15.2:0/296270022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa140102790 0x7fa1401067e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa134009900 tx=0x7fa13402a410 comp rx=0 tx=0).stop 2024-09-15T23:13:01.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.915+0000 7fa146ebc640 1 -- 172.21.15.2:0/296270022 shutdown_connections 2024-09-15T23:13:01.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.915+0000 7fa146ebc640 1 --2- 172.21.15.2:0/296270022 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa140106f10 0x7fa14010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.915+0000 7fa146ebc640 1 --2- 172.21.15.2:0/296270022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa140102790 0x7fa1401067e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.915+0000 7fa146ebc640 1 --2- 172.21.15.2:0/296270022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa140101de0 0x7fa1401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.916+0000 7fa146ebc640 1 -- 172.21.15.2:0/296270022 >> 172.21.15.2:0/296270022 conn(0x7fa1400fd8c0 msgr2=0x7fa1400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:01.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.916+0000 7fa146ebc640 1 -- 172.21.15.2:0/296270022 shutdown_connections 2024-09-15T23:13:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.916+0000 7fa146ebc640 1 -- 172.21.15.2:0/296270022 wait complete. 2024-09-15T23:13:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.916+0000 7fa146ebc640 1 Processor -- start 2024-09-15T23:13:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.916+0000 7fa146ebc640 1 -- start start 2024-09-15T23:13:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.916+0000 7fa146ebc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa140101de0 0x7fa1401983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.916+0000 7fa146ebc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa140102790 0x7fa140198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.916+0000 7fa146ebc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa140106f10 0x7fa14019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.916+0000 7fa146ebc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa140111e40 con 0x7fa140101de0 2024-09-15T23:13:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.916+0000 7fa146ebc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa140111cc0 con 0x7fa140106f10 2024-09-15T23:13:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.916+0000 7fa146ebc640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa140111fc0 con 0x7fa140102790 2024-09-15T23:13:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.916+0000 7fa144c58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa140101de0 0x7fa1401983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.916+0000 7fa144c58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa140101de0 0x7fa1401983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48342/0 (socket says 172.21.15.2:48342) 2024-09-15T23:13:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa144c58640 1 -- 172.21.15.2:0/1925020783 learned_addr learned my addr 172.21.15.2:0/1925020783 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:01.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa145459640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa140106f10 0x7fa14019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa13ffff640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa140102790 0x7fa140198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa144c58640 1 -- 172.21.15.2:0/1925020783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa140102790 msgr2=0x7fa140198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa144c58640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa140102790 0x7fa140198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa144c58640 1 -- 172.21.15.2:0/1925020783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa140106f10 msgr2=0x7fa14019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa144c58640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa140106f10 0x7fa14019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa144c58640 1 -- 172.21.15.2:0/1925020783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14019d370 con 0x7fa140101de0 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa145459640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa140106f10 0x7fa14019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa144c58640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa140101de0 0x7fa1401983c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa13000b4a0 tx=0x7fa13000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa13dffb640 1 -- 172.21.15.2:0/1925020783 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa130014070 con 0x7fa140101de0 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa13dffb640 1 -- 172.21.15.2:0/1925020783 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa130010ac0 con 0x7fa140101de0 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa13dffb640 1 -- 172.21.15.2:0/1925020783 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa130017c30 con 0x7fa140101de0 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa146ebc640 1 -- 172.21.15.2:0/1925020783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14019d660 con 0x7fa140101de0 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.917+0000 7fa146ebc640 1 -- 172.21.15.2:0/1925020783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1401a4f40 con 0x7fa140101de0 2024-09-15T23:13:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.918+0000 7fa146ebc640 1 -- 172.21.15.2:0/1925020783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1401021c0 con 0x7fa140101de0 2024-09-15T23:13:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.919+0000 7fa13dffb640 1 -- 172.21.15.2:0/1925020783 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa130017070 con 0x7fa140101de0 2024-09-15T23:13:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.920+0000 7fa13dffb640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa1280a3350 0x7fa1280a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.920+0000 7fa13ffff640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa1280a3350 0x7fa1280a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.920+0000 7fa13dffb640 1 -- 172.21.15.2:0/1925020783 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fa1300ceec0 con 0x7fa140101de0 2024-09-15T23:13:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.921+0000 7fa13ffff640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa1280a3350 0x7fa1280a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa134031440 tx=0x7fa1340095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:01.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:01.924+0000 7fa13dffb640 1 -- 172.21.15.2:0/1925020783 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa13009bd40 con 0x7fa140101de0 2024-09-15T23:13:02.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.136+0000 7fa146ebc640 1 -- 172.21.15.2:0/1925020783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa14010a0f0 con 0x7fa140101de0 2024-09-15T23:13:02.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.137+0000 7fa13dffb640 1 -- 172.21.15.2:0/1925020783 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11843 (secure 0 0 0) 0x7fa130097070 con 0x7fa140101de0 2024-09-15T23:13:02.138 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:02.138 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"btime":"2024-09-15T23:12:51:758295+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1051460220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1051460220},{"type":"v1","addr":"172.21.15.2:6839","nonce":1051460220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/1583533983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":1583533983},{"type":"v1","addr":"172.21.15.2:6841","nonce":1583533983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/91315913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":91315913},{"type":"v1","addr":"172.21.15.145:6835","nonce":91315913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1066293931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":1066293931},{"type":"v1","addr":"172.21.15.145:6837","nonce":1066293931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/418078184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":418078184},{"type":"v1","addr":"172.21.15.112:6837","nonce":418078184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:12:42.434565+0000","modified":"2024-09-15T23:12:51.456432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3930825714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3930825714},{"type":"v1","addr":"172.21.15.145:6839","nonce":3930825714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/1380244119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1380244119},{"type":"v1","addr":"172.21.15.112:6839","nonce":1380244119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24464,"qdb_cluster":[24464]},"id":1}]} 2024-09-15T23:13:02.139 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-09-15T23:13:02.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.139+0000 7fa146ebc640 1 -- 172.21.15.2:0/1925020783 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa1280a3350 msgr2=0x7fa1280a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:02.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.139+0000 7fa146ebc640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa1280a3350 0x7fa1280a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa134031440 tx=0x7fa1340095f0 comp rx=0 tx=0).stop 2024-09-15T23:13:02.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.139+0000 7fa146ebc640 1 -- 172.21.15.2:0/1925020783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa140101de0 msgr2=0x7fa1401983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:02.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.139+0000 7fa146ebc640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa140101de0 0x7fa1401983c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa13000b4a0 tx=0x7fa13000b960 comp rx=0 tx=0).stop 2024-09-15T23:13:02.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.139+0000 7fa146ebc640 1 -- 172.21.15.2:0/1925020783 shutdown_connections 2024-09-15T23:13:02.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.139+0000 7fa146ebc640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa1280a3350 0x7fa1280a5810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:02.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.139+0000 7fa146ebc640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa140106f10 0x7fa14019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:02.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.139+0000 7fa146ebc640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa140102790 0x7fa140198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:02.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.139+0000 7fa146ebc640 1 --2- 172.21.15.2:0/1925020783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa140101de0 0x7fa1401983c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:02.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.139+0000 7fa146ebc640 1 -- 172.21.15.2:0/1925020783 >> 172.21.15.2:0/1925020783 conn(0x7fa1400fd8c0 msgr2=0x7fa1400fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:02.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.140+0000 7fa146ebc640 1 -- 172.21.15.2:0/1925020783 shutdown_connections 2024-09-15T23:13:02.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:02.140+0000 7fa146ebc640 1 -- 172.21.15.2:0/1925020783 wait complete. 2024-09-15T23:13:02.948 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:02 smithi002 ceph-mon[31019]: pgmap v291: 97 pgs: 97 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.7 KiB/s wr, 3 op/s 2024-09-15T23:13:02.948 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:02 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1925020783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:13:02.985 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:13:03.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:02 smithi145 ceph-mon[34901]: pgmap v291: 97 pgs: 97 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.7 KiB/s wr, 3 op/s 2024-09-15T23:13:03.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:02 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1925020783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:13:03.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:02 smithi112 ceph-mon[34367]: pgmap v291: 97 pgs: 97 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.7 KiB/s wr, 3 op/s 2024-09-15T23:13:03.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:02 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1925020783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:13:03.248 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:03.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.731+0000 7fa7364c2640 1 -- 172.21.15.2:0/2369743100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa730102790 msgr2=0x7fa7301067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:03.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.731+0000 7fa7364c2640 1 --2- 172.21.15.2:0/2369743100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa730102790 0x7fa7301067e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa724009900 tx=0x7fa72402a410 comp rx=0 tx=0).stop 2024-09-15T23:13:03.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.731+0000 7fa7364c2640 1 -- 172.21.15.2:0/2369743100 shutdown_connections 2024-09-15T23:13:03.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.731+0000 7fa7364c2640 1 --2- 172.21.15.2:0/2369743100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa730106f10 0x7fa73010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.731+0000 7fa7364c2640 1 --2- 172.21.15.2:0/2369743100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa730102790 0x7fa7301067e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.731+0000 7fa7364c2640 1 --2- 172.21.15.2:0/2369743100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa730101de0 0x7fa7301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.731+0000 7fa7364c2640 1 -- 172.21.15.2:0/2369743100 >> 172.21.15.2:0/2369743100 conn(0x7fa7300fd8c0 msgr2=0x7fa7300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.732+0000 7fa7364c2640 1 -- 172.21.15.2:0/2369743100 shutdown_connections 2024-09-15T23:13:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.732+0000 7fa7364c2640 1 -- 172.21.15.2:0/2369743100 wait complete. 2024-09-15T23:13:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.732+0000 7fa7364c2640 1 Processor -- start 2024-09-15T23:13:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.732+0000 7fa7364c2640 1 -- start start 2024-09-15T23:13:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.732+0000 7fa7364c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa730101de0 0x7fa7301983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.732+0000 7fa7364c2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa730102790 0x7fa730198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.732+0000 7fa7364c2640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa730106f10 0x7fa73019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa7364c2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa730111e20 con 0x7fa730101de0 2024-09-15T23:13:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa7364c2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa730111ca0 con 0x7fa730102790 2024-09-15T23:13:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa7364c2640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa730111fa0 con 0x7fa730106f10 2024-09-15T23:13:03.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa72ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa730101de0 0x7fa7301983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:03.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa72ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa730101de0 0x7fa7301983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48360/0 (socket says 172.21.15.2:48360) 2024-09-15T23:13:03.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa72ffff640 1 -- 172.21.15.2:0/2804011467 learned_addr learned my addr 172.21.15.2:0/2804011467 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:03.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa72f7fe640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa730102790 0x7fa730198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:03.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa734a5f640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa730106f10 0x7fa73019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:03.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa72ffff640 1 -- 172.21.15.2:0/2804011467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa730106f10 msgr2=0x7fa73019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:03.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa72ffff640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa730106f10 0x7fa73019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa72ffff640 1 -- 172.21.15.2:0/2804011467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa730102790 msgr2=0x7fa730198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:03.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa72ffff640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa730102790 0x7fa730198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa72ffff640 1 -- 172.21.15.2:0/2804011467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73019d370 con 0x7fa730101de0 2024-09-15T23:13:03.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa72ffff640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa730101de0 0x7fa7301983c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa72000c890 tx=0x7fa72000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:03.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa72d7fa640 1 -- 172.21.15.2:0/2804011467 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720004220 con 0x7fa730101de0 2024-09-15T23:13:03.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa72d7fa640 1 -- 172.21.15.2:0/2804011467 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7200043c0 con 0x7fa730101de0 2024-09-15T23:13:03.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa72d7fa640 1 -- 172.21.15.2:0/2804011467 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720004a00 con 0x7fa730101de0 2024-09-15T23:13:03.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa7364c2640 1 -- 172.21.15.2:0/2804011467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73019d660 con 0x7fa730101de0 2024-09-15T23:13:03.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.733+0000 7fa7364c2640 1 -- 172.21.15.2:0/2804011467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7301a4f40 con 0x7fa730101de0 2024-09-15T23:13:03.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.735+0000 7fa7364c2640 1 -- 172.21.15.2:0/2804011467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7301032c0 con 0x7fa730101de0 2024-09-15T23:13:03.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.735+0000 7fa72d7fa640 1 -- 172.21.15.2:0/2804011467 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa720004ba0 con 0x7fa730101de0 2024-09-15T23:13:03.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.736+0000 7fa72d7fa640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa7180a3350 0x7fa7180a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:03.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.736+0000 7fa72f7fe640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa7180a3350 0x7fa7180a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:03.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.736+0000 7fa72d7fa640 1 -- 172.21.15.2:0/2804011467 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fa7200cf530 con 0x7fa730101de0 2024-09-15T23:13:03.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.737+0000 7fa72f7fe640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa7180a3350 0x7fa7180a5810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa724031440 tx=0x7fa724005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:03.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.740+0000 7fa72d7fa640 1 -- 172.21.15.2:0/2804011467 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa720014030 con 0x7fa730101de0 2024-09-15T23:13:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.917+0000 7fa7364c2640 1 -- 172.21.15.2:0/2804011467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa73010a150 con 0x7fa730101de0 2024-09-15T23:13:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.919+0000 7fa72d7fa640 1 -- 172.21.15.2:0/2804011467 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22195 (secure 0 0 0) 0x7fa72009c2a0 con 0x7fa730101de0 2024-09-15T23:13:03.921 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:03.921 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","created":"2024-09-15T23:04:45.101432+0000","modified":"2024-09-15T23:12:42.434365+0000","last_up_change":"2024-09-15T23:11:49.566858+0000","last_in_change":"2024-09-15T23:11:25.723093+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:07:57.919291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:38.100522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:40.716254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40ff4fd9-3904-4178-a9cb-51f4647be540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6803","nonce":280991401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6805","nonce":280991401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6809","nonce":280991401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6807","nonce":280991401}]},"public_addr":"172.21.15.2:6803/280991401","cluster_addr":"172.21.15.2:6805/280991401","heartbeat_back_addr":"172.21.15.2:6809/280991401","heartbeat_front_addr":"172.21.15.2:6807/280991401","state":["exists","up"]},{"osd":1,"uuid":"af5e265d-fe45-4d9c-a34c-6f0b103d75d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6801","nonce":2649210970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6803","nonce":2649210970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6807","nonce":2649210970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6805","nonce":2649210970}]},"public_addr":"172.21.15.112:6801/2649210970","cluster_addr":"172.21.15.112:6803/2649210970","heartbeat_back_addr":"172.21.15.112:6807/2649210970","heartbeat_front_addr":"172.21.15.112:6805/2649210970","state":["exists","up"]},{"osd":2,"uuid":"8df9e644-fc51-4626-a1a7-6ac4448a5b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6801","nonce":3485615437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6803","nonce":3485615437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6807","nonce":3485615437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6805","nonce":3485615437}]},"public_addr":"172.21.15.145:6801/3485615437","cluster_addr":"172.21.15.145:6803/3485615437","heartbeat_back_addr":"172.21.15.145:6807/3485615437","heartbeat_front_addr":"172.21.15.145:6805/3485615437","state":["exists","up"]},{"osd":3,"uuid":"dbab372a-8fdd-4b0c-bee3-16cd75b35ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6811","nonce":113061968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6813","nonce":113061968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6817","nonce":113061968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6815","nonce":113061968}]},"public_addr":"172.21.15.2:6811/113061968","cluster_addr":"172.21.15.2:6813/113061968","heartbeat_back_addr":"172.21.15.2:6817/113061968","heartbeat_front_addr":"172.21.15.2:6815/113061968","state":["exists","up"]},{"osd":4,"uuid":"73bab8af-3973-4beb-a034-d00bcf0c572f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6809","nonce":2519162767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6811","nonce":2519162767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6815","nonce":2519162767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6813","nonce":2519162767}]},"public_addr":"172.21.15.112:6809/2519162767","cluster_addr":"172.21.15.112:6811/2519162767","heartbeat_back_addr":"172.21.15.112:6815/2519162767","heartbeat_front_addr":"172.21.15.112:6813/2519162767","state":["exists","up"]},{"osd":5,"uuid":"2d163e61-5891-46c1-b1c2-39d50a3b6f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6809","nonce":712427242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6811","nonce":712427242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6815","nonce":712427242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6813","nonce":712427242}]},"public_addr":"172.21.15.145:6809/712427242","cluster_addr":"172.21.15.145:6811/712427242","heartbeat_back_addr":"172.21.15.145:6815/712427242","heartbeat_front_addr":"172.21.15.145:6813/712427242","state":["exists","up"]},{"osd":6,"uuid":"bca02c96-10de-4953-96e9-42fc9ddf7c1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6819","nonce":2930673197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6821","nonce":2930673197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6825","nonce":2930673197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6823","nonce":2930673197}]},"public_addr":"172.21.15.2:6819/2930673197","cluster_addr":"172.21.15.2:6821/2930673197","heartbeat_back_addr":"172.21.15.2:6825/2930673197","heartbeat_front_addr":"172.21.15.2:6823/2930673197","state":["exists","up"]},{"osd":7,"uuid":"4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6817","nonce":830628191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6819","nonce":830628191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6823","nonce":830628191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6821","nonce":830628191}]},"public_addr":"172.21.15.112:6817/830628191","cluster_addr":"172.21.15.112:6819/830628191","heartbeat_back_addr":"172.21.15.112:6823/830628191","heartbeat_front_addr":"172.21.15.112:6821/830628191","state":["exists","up"]},{"osd":8,"uuid":"2733f9dd-3872-4bec-9c22-bcdb64828ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6817","nonce":3634470540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6819","nonce":3634470540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6823","nonce":3634470540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6821","nonce":3634470540}]},"public_addr":"172.21.15.145:6817/3634470540","cluster_addr":"172.21.15.145:6819/3634470540","heartbeat_back_addr":"172.21.15.145:6823/3634470540","heartbeat_front_addr":"172.21.15.145:6821/3634470540","state":["exists","up"]},{"osd":9,"uuid":"bd1f4a4a-547c-43a9-859a-75b37b06905f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6827","nonce":1417377702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6829","nonce":1417377702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6833","nonce":1417377702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6831","nonce":1417377702}]},"public_addr":"172.21.15.2:6827/1417377702","cluster_addr":"172.21.15.2:6829/1417377702","heartbeat_back_addr":"172.21.15.2:6833/1417377702","heartbeat_front_addr":"172.21.15.2:6831/1417377702","state":["exists","up"]},{"osd":10,"uuid":"f8b895e8-39f5-4753-9343-03f96da12246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6825","nonce":105615908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6827","nonce":105615908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6831","nonce":105615908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6829","nonce":105615908}]},"public_addr":"172.21.15.112:6825/105615908","cluster_addr":"172.21.15.112:6827/105615908","heartbeat_back_addr":"172.21.15.112:6831/105615908","heartbeat_front_addr":"172.21.15.112:6829/105615908","state":["exists","up"]},{"osd":11,"uuid":"dc018bfc-bc13-4ef2-a712-5cd406a56cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6825","nonce":430484289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6827","nonce":430484289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6831","nonce":430484289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6829","nonce":430484289}]},"public_addr":"172.21.15.145:6825/430484289","cluster_addr":"172.21.15.145:6827/430484289","heartbeat_back_addr":"172.21.15.145:6831/430484289","heartbeat_front_addr":"172.21.15.145:6829/430484289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:03.938207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:29.814740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:54.853802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:20.802021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:47.028090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:13.226130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:39.003023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:04.465156+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:29.321331+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:55.992585+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:21.623406+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:48.269840+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/2956732837":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6800/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/896502743":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/3802152324":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/1891095221":"2024-09-16T23:05:17.756048+0000","172.21.15.2:6800/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/236781836":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/2404111366":"2024-09-16T23:05:17.756048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:13:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.921+0000 7fa7364c2640 1 -- 172.21.15.2:0/2804011467 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa7180a3350 msgr2=0x7fa7180a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.921+0000 7fa7364c2640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa7180a3350 0x7fa7180a5810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa724031440 tx=0x7fa724005b50 comp rx=0 tx=0).stop 2024-09-15T23:13:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.921+0000 7fa7364c2640 1 -- 172.21.15.2:0/2804011467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa730101de0 msgr2=0x7fa7301983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.921+0000 7fa7364c2640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa730101de0 0x7fa7301983c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa72000c890 tx=0x7fa72000cd50 comp rx=0 tx=0).stop 2024-09-15T23:13:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.921+0000 7fa7364c2640 1 -- 172.21.15.2:0/2804011467 shutdown_connections 2024-09-15T23:13:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.921+0000 7fa7364c2640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa7180a3350 0x7fa7180a5810 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.921+0000 7fa7364c2640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa730106f10 0x7fa73019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.921+0000 7fa7364c2640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa730102790 0x7fa730198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.921+0000 7fa7364c2640 1 --2- 172.21.15.2:0/2804011467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa730101de0 0x7fa7301983c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.921+0000 7fa7364c2640 1 -- 172.21.15.2:0/2804011467 >> 172.21.15.2:0/2804011467 conn(0x7fa7300fd8c0 msgr2=0x7fa7300fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.921+0000 7fa7364c2640 1 -- 172.21.15.2:0/2804011467 shutdown_connections 2024-09-15T23:13:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:03.921+0000 7fa7364c2640 1 -- 172.21.15.2:0/2804011467 wait complete. 2024-09-15T23:13:04.726 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T23:13:04.726 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T23:13:04.990 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:05.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:04 smithi002 ceph-mon[31019]: pgmap v292: 97 pgs: 97 active+clean; 629 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-15T23:13:05.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:04 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2804011467' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:13:05.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:04 smithi145 ceph-mon[34901]: pgmap v292: 97 pgs: 97 active+clean; 629 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-15T23:13:05.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:04 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2804011467' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:13:05.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:04 smithi112 ceph-mon[34367]: pgmap v292: 97 pgs: 97 active+clean; 629 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-15T23:13:05.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:04 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2804011467' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:13:05.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.481+0000 7f71dc62d640 1 -- 172.21.15.2:0/758250406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71d4100a80 msgr2=0x7f71d4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:05.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.481+0000 7f71dc62d640 1 --2- 172.21.15.2:0/758250406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71d4100a80 0x7f71d4100ee0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009930 tx=0x7f71c802a420 comp rx=0 tx=0).stop 2024-09-15T23:13:05.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.481+0000 7f71dc62d640 1 -- 172.21.15.2:0/758250406 shutdown_connections 2024-09-15T23:13:05.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.481+0000 7f71dc62d640 1 --2- 172.21.15.2:0/758250406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71d4101420 0x7f71d410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:05.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.481+0000 7f71dc62d640 1 --2- 172.21.15.2:0/758250406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71d4100a80 0x7f71d4100ee0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.481+0000 7f71dc62d640 1 --2- 172.21.15.2:0/758250406 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71d4106a80 0x7f71d4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.481+0000 7f71dc62d640 1 -- 172.21.15.2:0/758250406 >> 172.21.15.2:0/758250406 conn(0x7f71d40fc7a0 msgr2=0x7f71d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.481+0000 7f71dc62d640 1 -- 172.21.15.2:0/758250406 shutdown_connections 2024-09-15T23:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.481+0000 7f71dc62d640 1 -- 172.21.15.2:0/758250406 wait complete. 2024-09-15T23:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71dc62d640 1 Processor -- start 2024-09-15T23:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71dc62d640 1 -- start start 2024-09-15T23:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71dc62d640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71d4100a80 0x7f71d4197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71dc62d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71d4101420 0x7f71d41977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71dc62d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71d4106a80 0x7f71d419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71dc62d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f71d4110cf0 con 0x7f71d4101420 2024-09-15T23:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71dc62d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f71d4110b70 con 0x7f71d4106a80 2024-09-15T23:13:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71dc62d640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f71d4110e70 con 0x7f71d4100a80 2024-09-15T23:13:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71d9bc8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71d4101420 0x7f71d41977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71d9bc8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71d4101420 0x7f71d41977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48386/0 (socket says 172.21.15.2:48386) 2024-09-15T23:13:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71d9bc8640 1 -- 172.21.15.2:0/4025828072 learned_addr learned my addr 172.21.15.2:0/4025828072 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71dabca640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71d4106a80 0x7f71d419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71da3c9640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71d4100a80 0x7f71d4197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71d9bc8640 1 -- 172.21.15.2:0/4025828072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71d4100a80 msgr2=0x7f71d4197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71d9bc8640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71d4100a80 0x7f71d4197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71d9bc8640 1 -- 172.21.15.2:0/4025828072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71d4106a80 msgr2=0x7f71d419bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71d9bc8640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71d4106a80 0x7f71d419bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.482+0000 7f71d9bc8640 1 -- 172.21.15.2:0/4025828072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d419c230 con 0x7f71d4101420 2024-09-15T23:13:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.483+0000 7f71d9bc8640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71d4101420 0x7f71d41977c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f71c8004770 tx=0x7f71c8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.483+0000 7f71d37fe640 1 -- 172.21.15.2:0/4025828072 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c8035050 con 0x7f71d4101420 2024-09-15T23:13:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.483+0000 7f71dc62d640 1 -- 172.21.15.2:0/4025828072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d419c4c0 con 0x7f71d4101420 2024-09-15T23:13:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.483+0000 7f71d37fe640 1 -- 172.21.15.2:0/4025828072 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f71c8003aa0 con 0x7f71d4101420 2024-09-15T23:13:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.483+0000 7f71d37fe640 1 -- 172.21.15.2:0/4025828072 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c8038ae0 con 0x7f71d4101420 2024-09-15T23:13:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.483+0000 7f71dc62d640 1 -- 172.21.15.2:0/4025828072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d406a790 con 0x7f71d4101420 2024-09-15T23:13:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.484+0000 7f71dc62d640 1 -- 172.21.15.2:0/4025828072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d41021c0 con 0x7f71d4101420 2024-09-15T23:13:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.485+0000 7f71d37fe640 1 -- 172.21.15.2:0/4025828072 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f71c8003c50 con 0x7f71d4101420 2024-09-15T23:13:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.486+0000 7f71d37fe640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f71bc0a32d0 0x7f71bc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.486+0000 7f71da3c9640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f71bc0a32d0 0x7f71bc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.486+0000 7f71d37fe640 1 -- 172.21.15.2:0/4025828072 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f71c80f1d70 con 0x7f71d4101420 2024-09-15T23:13:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.486+0000 7f71da3c9640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f71bc0a32d0 0x7f71bc0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f71c4005fd0 tx=0x7f71c4009200 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.489+0000 7f71d37fe640 1 -- 172.21.15.2:0/4025828072 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71c80beae0 con 0x7f71d4101420 2024-09-15T23:13:05.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.660+0000 7f71dc62d640 1 -- 172.21.15.2:0/4025828072 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71d406a9f0 con 0x7f71bc0a32d0 2024-09-15T23:13:05.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.668+0000 7f71d37fe640 1 -- 172.21.15.2:0/4025828072 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258791 (secure 0 0 0) 0x7f71d406a9f0 con 0x7f71bc0a32d0 2024-09-15T23:13:05.671 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:05.672 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-15T23:13:05.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.671+0000 7f71dc62d640 1 -- 172.21.15.2:0/4025828072 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f71bc0a32d0 msgr2=0x7f71bc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:05.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.671+0000 7f71dc62d640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f71bc0a32d0 0x7f71bc0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f71c4005fd0 tx=0x7f71c4009200 comp rx=0 tx=0).stop 2024-09-15T23:13:05.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.671+0000 7f71dc62d640 1 -- 172.21.15.2:0/4025828072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71d4101420 msgr2=0x7f71d41977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:05.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.671+0000 7f71dc62d640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71d4101420 0x7f71d41977c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f71c8004770 tx=0x7f71c8004270 comp rx=0 tx=0).stop 2024-09-15T23:13:05.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.671+0000 7f71dc62d640 1 -- 172.21.15.2:0/4025828072 shutdown_connections 2024-09-15T23:13:05.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.671+0000 7f71dc62d640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f71bc0a32d0 0x7f71bc0a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:05.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.671+0000 7f71dc62d640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71d4106a80 0x7f71d419bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:05.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.671+0000 7f71dc62d640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71d4101420 0x7f71d41977c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:05.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.671+0000 7f71dc62d640 1 --2- 172.21.15.2:0/4025828072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71d4100a80 0x7f71d4197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:05.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.671+0000 7f71dc62d640 1 -- 172.21.15.2:0/4025828072 >> 172.21.15.2:0/4025828072 conn(0x7f71d40fc7a0 msgr2=0x7f71d40fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:05.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.671+0000 7f71dc62d640 1 -- 172.21.15.2:0/4025828072 shutdown_connections 2024-09-15T23:13:05.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:05.671+0000 7f71dc62d640 1 -- 172.21.15.2:0/4025828072 wait complete. 2024-09-15T23:13:06.532 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-09-15T23:13:05.507628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644567,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":177,"num_read_kb":193,"num_write":261,"num_write_kb":3016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368232,"kb_used_data":10632,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573592,"statfs":{"total":1151940427776,"available":1151563358208,"internally_reserved":0,"allocated":10887168,"data_stored":7004205,"data_compressed":108771,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51789,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":63,"num_write":35,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003339"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.733281+0000","last_change":"2024-09-15T23:12:41.750867+0000","last_active":"2024-09-15T23:12:42.733281+0000","last_peered":"2024-09-15T23:12:42.733281+0000","last_clean":"2024-09-15T23:12:42.733281+0000","last_became_active":"2024-09-15T23:12:41.750508+0000","last_became_peered":"2024-09-15T23:12:41.750508+0000","last_unstale":"2024-09-15T23:12:42.733281+0000","last_undegraded":"2024-09-15T23:12:42.733281+0000","last_fullsized":"2024-09-15T23:12:42.733281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:55.104563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740528+0000","last_change":"2024-09-15T23:12:41.752704+0000","last_active":"2024-09-15T23:12:42.740528+0000","last_peered":"2024-09-15T23:12:42.740528+0000","last_clean":"2024-09-15T23:12:42.740528+0000","last_became_active":"2024-09-15T23:12:41.751144+0000","last_became_peered":"2024-09-15T23:12:41.751144+0000","last_unstale":"2024-09-15T23:12:42.740528+0000","last_undegraded":"2024-09-15T23:12:42.740528+0000","last_fullsized":"2024-09-15T23:12:42.740528+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:10.332172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739915+0000","last_change":"2024-09-15T23:12:41.759051+0000","last_active":"2024-09-15T23:12:42.739915+0000","last_peered":"2024-09-15T23:12:42.739915+0000","last_clean":"2024-09-15T23:12:42.739915+0000","last_became_active":"2024-09-15T23:12:41.757243+0000","last_became_peered":"2024-09-15T23:12:41.757243+0000","last_unstale":"2024-09-15T23:12:42.739915+0000","last_undegraded":"2024-09-15T23:12:42.739915+0000","last_fullsized":"2024-09-15T23:12:42.739915+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:44.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745069+0000","last_change":"2024-09-15T23:12:41.751732+0000","last_active":"2024-09-15T23:12:42.745069+0000","last_peered":"2024-09-15T23:12:42.745069+0000","last_clean":"2024-09-15T23:12:42.745069+0000","last_became_active":"2024-09-15T23:12:41.751404+0000","last_became_peered":"2024-09-15T23:12:41.751404+0000","last_unstale":"2024-09-15T23:12:42.745069+0000","last_undegraded":"2024-09-15T23:12:42.745069+0000","last_fullsized":"2024-09-15T23:12:42.745069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:05.724326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739163+0000","last_change":"2024-09-15T23:12:41.750642+0000","last_active":"2024-09-15T23:12:42.739163+0000","last_peered":"2024-09-15T23:12:42.739163+0000","last_clean":"2024-09-15T23:12:42.739163+0000","last_became_active":"2024-09-15T23:12:41.750312+0000","last_became_peered":"2024-09-15T23:12:41.750312+0000","last_unstale":"2024-09-15T23:12:42.739163+0000","last_undegraded":"2024-09-15T23:12:42.739163+0000","last_fullsized":"2024-09-15T23:12:42.739163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:46.168397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732323+0000","last_change":"2024-09-15T23:12:41.744794+0000","last_active":"2024-09-15T23:12:42.732323+0000","last_peered":"2024-09-15T23:12:42.732323+0000","last_clean":"2024-09-15T23:12:42.732323+0000","last_became_active":"2024-09-15T23:12:41.744468+0000","last_became_peered":"2024-09-15T23:12:41.744468+0000","last_unstale":"2024-09-15T23:12:42.732323+0000","last_undegraded":"2024-09-15T23:12:42.732323+0000","last_fullsized":"2024-09-15T23:12:42.732323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:22.298132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740783+0000","last_change":"2024-09-15T23:12:41.746124+0000","last_active":"2024-09-15T23:12:42.740783+0000","last_peered":"2024-09-15T23:12:42.740783+0000","last_clean":"2024-09-15T23:12:42.740783+0000","last_became_active":"2024-09-15T23:12:41.745756+0000","last_became_peered":"2024-09-15T23:12:41.745756+0000","last_unstale":"2024-09-15T23:12:42.740783+0000","last_undegraded":"2024-09-15T23:12:42.740783+0000","last_fullsized":"2024-09-15T23:12:42.740783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:12.368976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739435+0000","last_change":"2024-09-15T23:12:41.742047+0000","last_active":"2024-09-15T23:12:42.739435+0000","last_peered":"2024-09-15T23:12:42.739435+0000","last_clean":"2024-09-15T23:12:42.739435+0000","last_became_active":"2024-09-15T23:12:41.741730+0000","last_became_peered":"2024-09-15T23:12:41.741730+0000","last_unstale":"2024-09-15T23:12:42.739435+0000","last_undegraded":"2024-09-15T23:12:42.739435+0000","last_fullsized":"2024-09-15T23:12:42.739435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:46.278342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740074+0000","last_change":"2024-09-15T23:12:41.757117+0000","last_active":"2024-09-15T23:12:42.740074+0000","last_peered":"2024-09-15T23:12:42.740074+0000","last_clean":"2024-09-15T23:12:42.740074+0000","last_became_active":"2024-09-15T23:12:41.756515+0000","last_became_peered":"2024-09-15T23:12:41.756515+0000","last_unstale":"2024-09-15T23:12:42.740074+0000","last_undegraded":"2024-09-15T23:12:42.740074+0000","last_fullsized":"2024-09-15T23:12:42.740074+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:37.453454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732831+0000","last_change":"2024-09-15T23:12:41.751118+0000","last_active":"2024-09-15T23:12:42.732831+0000","last_peered":"2024-09-15T23:12:42.732831+0000","last_clean":"2024-09-15T23:12:42.732831+0000","last_became_active":"2024-09-15T23:12:41.750748+0000","last_became_peered":"2024-09-15T23:12:41.750748+0000","last_unstale":"2024-09-15T23:12:42.732831+0000","last_undegraded":"2024-09-15T23:12:42.732831+0000","last_fullsized":"2024-09-15T23:12:42.732831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:55.079937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741321+0000","last_change":"2024-09-15T23:12:41.756539+0000","last_active":"2024-09-15T23:12:42.741321+0000","last_peered":"2024-09-15T23:12:42.741321+0000","last_clean":"2024-09-15T23:12:42.741321+0000","last_became_active":"2024-09-15T23:12:41.756191+0000","last_became_peered":"2024-09-15T23:12:41.756191+0000","last_unstale":"2024-09-15T23:12:42.741321+0000","last_undegraded":"2024-09-15T23:12:42.741321+0000","last_fullsized":"2024-09-15T23:12:42.741321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:52.715699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745055+0000","last_change":"2024-09-15T23:12:41.750681+0000","last_active":"2024-09-15T23:12:42.745055+0000","last_peered":"2024-09-15T23:12:42.745055+0000","last_clean":"2024-09-15T23:12:42.745055+0000","last_became_active":"2024-09-15T23:12:41.750344+0000","last_became_peered":"2024-09-15T23:12:41.750344+0000","last_unstale":"2024-09-15T23:12:42.745055+0000","last_undegraded":"2024-09-15T23:12:42.745055+0000","last_fullsized":"2024-09-15T23:12:42.745055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:13.455792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.742252+0000","last_change":"2024-09-15T23:12:41.752626+0000","last_active":"2024-09-15T23:12:42.742252+0000","last_peered":"2024-09-15T23:12:42.742252+0000","last_clean":"2024-09-15T23:12:42.742252+0000","last_became_active":"2024-09-15T23:12:41.752177+0000","last_became_peered":"2024-09-15T23:12:41.752177+0000","last_unstale":"2024-09-15T23:12:42.742252+0000","last_undegraded":"2024-09-15T23:12:42.742252+0000","last_fullsized":"2024-09-15T23:12:42.742252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:41.180073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740175+0000","last_change":"2024-09-15T23:12:41.750831+0000","last_active":"2024-09-15T23:12:42.740175+0000","last_peered":"2024-09-15T23:12:42.740175+0000","last_clean":"2024-09-15T23:12:42.740175+0000","last_became_active":"2024-09-15T23:12:41.750528+0000","last_became_peered":"2024-09-15T23:12:41.750528+0000","last_unstale":"2024-09-15T23:12:42.740175+0000","last_undegraded":"2024-09-15T23:12:42.740175+0000","last_fullsized":"2024-09-15T23:12:42.740175+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:11.737726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740210+0000","last_change":"2024-09-15T23:12:41.750079+0000","last_active":"2024-09-15T23:12:42.740210+0000","last_peered":"2024-09-15T23:12:42.740210+0000","last_clean":"2024-09-15T23:12:42.740210+0000","last_became_active":"2024-09-15T23:12:41.749551+0000","last_became_peered":"2024-09-15T23:12:41.749551+0000","last_unstale":"2024-09-15T23:12:42.740210+0000","last_undegraded":"2024-09-15T23:12:42.740210+0000","last_fullsized":"2024-09-15T23:12:42.740210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:37.283315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738760+0000","last_change":"2024-09-15T23:12:41.754855+0000","last_active":"2024-09-15T23:12:42.738760+0000","last_peered":"2024-09-15T23:12:42.738760+0000","last_clean":"2024-09-15T23:12:42.738760+0000","last_became_active":"2024-09-15T23:12:41.753825+0000","last_became_peered":"2024-09-15T23:12:41.753825+0000","last_unstale":"2024-09-15T23:12:42.738760+0000","last_undegraded":"2024-09-15T23:12:42.738760+0000","last_fullsized":"2024-09-15T23:12:42.738760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:21.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.733315+0000","last_change":"2024-09-15T23:12:41.750708+0000","last_active":"2024-09-15T23:12:42.733315+0000","last_peered":"2024-09-15T23:12:42.733315+0000","last_clean":"2024-09-15T23:12:42.733315+0000","last_became_active":"2024-09-15T23:12:41.750372+0000","last_became_peered":"2024-09-15T23:12:41.750372+0000","last_unstale":"2024-09-15T23:12:42.733315+0000","last_undegraded":"2024-09-15T23:12:42.733315+0000","last_fullsized":"2024-09-15T23:12:42.733315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:22.693466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.742015+0000","last_change":"2024-09-15T23:12:41.745514+0000","last_active":"2024-09-15T23:12:42.742015+0000","last_peered":"2024-09-15T23:12:42.742015+0000","last_clean":"2024-09-15T23:12:42.742015+0000","last_became_active":"2024-09-15T23:12:41.745165+0000","last_became_peered":"2024-09-15T23:12:41.745165+0000","last_unstale":"2024-09-15T23:12:42.742015+0000","last_undegraded":"2024-09-15T23:12:42.742015+0000","last_fullsized":"2024-09-15T23:12:42.742015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:39.275396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738623+0000","last_change":"2024-09-15T23:12:41.752590+0000","last_active":"2024-09-15T23:12:42.738623+0000","last_peered":"2024-09-15T23:12:42.738623+0000","last_clean":"2024-09-15T23:12:42.738623+0000","last_became_active":"2024-09-15T23:12:41.752269+0000","last_became_peered":"2024-09-15T23:12:41.752269+0000","last_unstale":"2024-09-15T23:12:42.738623+0000","last_undegraded":"2024-09-15T23:12:42.738623+0000","last_fullsized":"2024-09-15T23:12:42.738623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:48:12.304549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732581+0000","last_change":"2024-09-15T23:12:41.746485+0000","last_active":"2024-09-15T23:12:42.732581+0000","last_peered":"2024-09-15T23:12:42.732581+0000","last_clean":"2024-09-15T23:12:42.732581+0000","last_became_active":"2024-09-15T23:12:41.746148+0000","last_became_peered":"2024-09-15T23:12:41.746148+0000","last_unstale":"2024-09-15T23:12:42.732581+0000","last_undegraded":"2024-09-15T23:12:42.732581+0000","last_fullsized":"2024-09-15T23:12:42.732581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:38.874706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741136+0000","last_change":"2024-09-15T23:12:41.758169+0000","last_active":"2024-09-15T23:12:42.741136+0000","last_peered":"2024-09-15T23:12:42.741136+0000","last_clean":"2024-09-15T23:12:42.741136+0000","last_became_active":"2024-09-15T23:12:41.757542+0000","last_became_peered":"2024-09-15T23:12:41.757542+0000","last_unstale":"2024-09-15T23:12:42.741136+0000","last_undegraded":"2024-09-15T23:12:42.741136+0000","last_fullsized":"2024-09-15T23:12:42.741136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:55.430022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739205+0000","last_change":"2024-09-15T23:12:41.751024+0000","last_active":"2024-09-15T23:12:42.739205+0000","last_peered":"2024-09-15T23:12:42.739205+0000","last_clean":"2024-09-15T23:12:42.739205+0000","last_became_active":"2024-09-15T23:12:41.750610+0000","last_became_peered":"2024-09-15T23:12:41.750610+0000","last_unstale":"2024-09-15T23:12:42.739205+0000","last_undegraded":"2024-09-15T23:12:42.739205+0000","last_fullsized":"2024-09-15T23:12:42.739205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:54.563688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739421+0000","last_change":"2024-09-15T23:12:41.748779+0000","last_active":"2024-09-15T23:12:42.739421+0000","last_peered":"2024-09-15T23:12:42.739421+0000","last_clean":"2024-09-15T23:12:42.739421+0000","last_became_active":"2024-09-15T23:12:41.748471+0000","last_became_peered":"2024-09-15T23:12:41.748471+0000","last_unstale":"2024-09-15T23:12:42.739421+0000","last_undegraded":"2024-09-15T23:12:42.739421+0000","last_fullsized":"2024-09-15T23:12:42.739421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:55.771917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732238+0000","last_change":"2024-09-15T23:12:41.748306+0000","last_active":"2024-09-15T23:12:42.732238+0000","last_peered":"2024-09-15T23:12:42.732238+0000","last_clean":"2024-09-15T23:12:42.732238+0000","last_became_active":"2024-09-15T23:12:41.747950+0000","last_became_peered":"2024-09-15T23:12:41.747950+0000","last_unstale":"2024-09-15T23:12:42.732238+0000","last_undegraded":"2024-09-15T23:12:42.732238+0000","last_fullsized":"2024-09-15T23:12:42.732238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:51.846769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.743408+0000","last_change":"2024-09-15T23:12:41.747059+0000","last_active":"2024-09-15T23:12:42.743408+0000","last_peered":"2024-09-15T23:12:42.743408+0000","last_clean":"2024-09-15T23:12:42.743408+0000","last_became_active":"2024-09-15T23:12:41.746369+0000","last_became_peered":"2024-09-15T23:12:41.746369+0000","last_unstale":"2024-09-15T23:12:42.743408+0000","last_undegraded":"2024-09-15T23:12:42.743408+0000","last_fullsized":"2024-09-15T23:12:42.743408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:44.472384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739020+0000","last_change":"2024-09-15T23:12:41.745342+0000","last_active":"2024-09-15T23:12:42.739020+0000","last_peered":"2024-09-15T23:12:42.739020+0000","last_clean":"2024-09-15T23:12:42.739020+0000","last_became_active":"2024-09-15T23:12:41.743658+0000","last_became_peered":"2024-09-15T23:12:41.743658+0000","last_unstale":"2024-09-15T23:12:42.739020+0000","last_undegraded":"2024-09-15T23:12:42.739020+0000","last_fullsized":"2024-09-15T23:12:42.739020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:32.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732868+0000","last_change":"2024-09-15T23:12:41.753015+0000","last_active":"2024-09-15T23:12:42.732868+0000","last_peered":"2024-09-15T23:12:42.732868+0000","last_clean":"2024-09-15T23:12:42.732868+0000","last_became_active":"2024-09-15T23:12:41.752692+0000","last_became_peered":"2024-09-15T23:12:41.752692+0000","last_unstale":"2024-09-15T23:12:42.732868+0000","last_undegraded":"2024-09-15T23:12:42.732868+0000","last_fullsized":"2024-09-15T23:12:42.732868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:51.310427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739992+0000","last_change":"2024-09-15T23:12:41.757381+0000","last_active":"2024-09-15T23:12:42.739992+0000","last_peered":"2024-09-15T23:12:42.739992+0000","last_clean":"2024-09-15T23:12:42.739992+0000","last_became_active":"2024-09-15T23:12:41.757075+0000","last_became_peered":"2024-09-15T23:12:41.757075+0000","last_unstale":"2024-09-15T23:12:42.739992+0000","last_undegraded":"2024-09-15T23:12:42.739992+0000","last_fullsized":"2024-09-15T23:12:42.739992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:57.282022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740142+0000","last_change":"2024-09-15T23:12:41.753164+0000","last_active":"2024-09-15T23:12:42.740142+0000","last_peered":"2024-09-15T23:12:42.740142+0000","last_clean":"2024-09-15T23:12:42.740142+0000","last_became_active":"2024-09-15T23:12:41.752855+0000","last_became_peered":"2024-09-15T23:12:41.752855+0000","last_unstale":"2024-09-15T23:12:42.740142+0000","last_undegraded":"2024-09-15T23:12:42.740142+0000","last_fullsized":"2024-09-15T23:12:42.740142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:29.569535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738833+0000","last_change":"2024-09-15T23:12:41.750087+0000","last_active":"2024-09-15T23:12:42.738833+0000","last_peered":"2024-09-15T23:12:42.738833+0000","last_clean":"2024-09-15T23:12:42.738833+0000","last_became_active":"2024-09-15T23:12:41.749752+0000","last_became_peered":"2024-09-15T23:12:41.749752+0000","last_unstale":"2024-09-15T23:12:42.738833+0000","last_undegraded":"2024-09-15T23:12:42.738833+0000","last_fullsized":"2024-09-15T23:12:42.738833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:03.483448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739477+0000","last_change":"2024-09-15T23:12:41.746724+0000","last_active":"2024-09-15T23:12:42.739477+0000","last_peered":"2024-09-15T23:12:42.739477+0000","last_clean":"2024-09-15T23:12:42.739477+0000","last_became_active":"2024-09-15T23:12:41.746333+0000","last_became_peered":"2024-09-15T23:12:41.746333+0000","last_unstale":"2024-09-15T23:12:42.739477+0000","last_undegraded":"2024-09-15T23:12:42.739477+0000","last_fullsized":"2024-09-15T23:12:42.739477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:04.413591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732909+0000","last_change":"2024-09-15T23:12:41.749473+0000","last_active":"2024-09-15T23:12:42.732909+0000","last_peered":"2024-09-15T23:12:42.732909+0000","last_clean":"2024-09-15T23:12:42.732909+0000","last_became_active":"2024-09-15T23:12:41.748764+0000","last_became_peered":"2024-09-15T23:12:41.748764+0000","last_unstale":"2024-09-15T23:12:42.732909+0000","last_undegraded":"2024-09-15T23:12:42.732909+0000","last_fullsized":"2024-09-15T23:12:42.732909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:43.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741904+0000","last_change":"2024-09-15T23:12:41.755451+0000","last_active":"2024-09-15T23:12:42.741904+0000","last_peered":"2024-09-15T23:12:42.741904+0000","last_clean":"2024-09-15T23:12:42.741904+0000","last_became_active":"2024-09-15T23:12:41.755083+0000","last_became_peered":"2024-09-15T23:12:41.755083+0000","last_unstale":"2024-09-15T23:12:42.741904+0000","last_undegraded":"2024-09-15T23:12:42.741904+0000","last_fullsized":"2024-09-15T23:12:42.741904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:06.340043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732839+0000","last_change":"2024-09-15T23:12:39.485771+0000","last_active":"2024-09-15T23:12:42.732839+0000","last_peered":"2024-09-15T23:12:42.732839+0000","last_clean":"2024-09-15T23:12:42.732839+0000","last_became_active":"2024-09-15T23:12:39.485430+0000","last_became_peered":"2024-09-15T23:12:39.485430+0000","last_unstale":"2024-09-15T23:12:42.732839+0000","last_undegraded":"2024-09-15T23:12:42.732839+0000","last_fullsized":"2024-09-15T23:12:42.732839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:49:08.027243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732924+0000","last_change":"2024-09-15T23:12:41.748977+0000","last_active":"2024-09-15T23:12:42.732924+0000","last_peered":"2024-09-15T23:12:42.732924+0000","last_clean":"2024-09-15T23:12:42.732924+0000","last_became_active":"2024-09-15T23:12:41.748616+0000","last_became_peered":"2024-09-15T23:12:41.748616+0000","last_unstale":"2024-09-15T23:12:42.732924+0000","last_undegraded":"2024-09-15T23:12:42.732924+0000","last_fullsized":"2024-09-15T23:12:42.732924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:45.248469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.743799+0000","last_change":"2024-09-15T23:12:39.486497+0000","last_active":"2024-09-15T23:12:42.743799+0000","last_peered":"2024-09-15T23:12:42.743799+0000","last_clean":"2024-09-15T23:12:42.743799+0000","last_became_active":"2024-09-15T23:12:39.486173+0000","last_became_peered":"2024-09-15T23:12:39.486173+0000","last_unstale":"2024-09-15T23:12:42.743799+0000","last_undegraded":"2024-09-15T23:12:42.743799+0000","last_fullsized":"2024-09-15T23:12:42.743799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:06.125300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738267+0000","last_change":"2024-09-15T23:12:39.483270+0000","last_active":"2024-09-15T23:12:42.738267+0000","last_peered":"2024-09-15T23:12:42.738267+0000","last_clean":"2024-09-15T23:12:42.738267+0000","last_became_active":"2024-09-15T23:12:39.482913+0000","last_became_peered":"2024-09-15T23:12:39.482913+0000","last_unstale":"2024-09-15T23:12:42.738267+0000","last_undegraded":"2024-09-15T23:12:42.738267+0000","last_fullsized":"2024-09-15T23:12:42.738267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:25.333182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739570+0000","last_change":"2024-09-15T23:12:41.741778+0000","last_active":"2024-09-15T23:12:42.739570+0000","last_peered":"2024-09-15T23:12:42.739570+0000","last_clean":"2024-09-15T23:12:42.739570+0000","last_became_active":"2024-09-15T23:12:41.740768+0000","last_became_peered":"2024-09-15T23:12:41.740768+0000","last_unstale":"2024-09-15T23:12:42.739570+0000","last_undegraded":"2024-09-15T23:12:42.739570+0000","last_fullsized":"2024-09-15T23:12:42.739570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:22.086290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732552+0000","last_change":"2024-09-15T23:12:39.483029+0000","last_active":"2024-09-15T23:12:42.732552+0000","last_peered":"2024-09-15T23:12:42.732552+0000","last_clean":"2024-09-15T23:12:42.732552+0000","last_became_active":"2024-09-15T23:12:39.482080+0000","last_became_peered":"2024-09-15T23:12:39.482080+0000","last_unstale":"2024-09-15T23:12:42.732552+0000","last_undegraded":"2024-09-15T23:12:42.732552+0000","last_fullsized":"2024-09-15T23:12:42.732552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:41.076993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741024+0000","last_change":"2024-09-15T23:12:41.747332+0000","last_active":"2024-09-15T23:12:42.741024+0000","last_peered":"2024-09-15T23:12:42.741024+0000","last_clean":"2024-09-15T23:12:42.741024+0000","last_became_active":"2024-09-15T23:12:41.746818+0000","last_became_peered":"2024-09-15T23:12:41.746818+0000","last_unstale":"2024-09-15T23:12:42.741024+0000","last_undegraded":"2024-09-15T23:12:42.741024+0000","last_fullsized":"2024-09-15T23:12:42.741024+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:14.323947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732577+0000","last_change":"2024-09-15T23:12:39.486150+0000","last_active":"2024-09-15T23:12:42.732577+0000","last_peered":"2024-09-15T23:12:42.732577+0000","last_clean":"2024-09-15T23:12:42.732577+0000","last_became_active":"2024-09-15T23:12:39.485827+0000","last_became_peered":"2024-09-15T23:12:39.485827+0000","last_unstale":"2024-09-15T23:12:42.732577+0000","last_undegraded":"2024-09-15T23:12:42.732577+0000","last_fullsized":"2024-09-15T23:12:42.732577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:53.308822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739699+0000","last_change":"2024-09-15T23:12:41.747866+0000","last_active":"2024-09-15T23:12:42.739699+0000","last_peered":"2024-09-15T23:12:42.739699+0000","last_clean":"2024-09-15T23:12:42.739699+0000","last_became_active":"2024-09-15T23:12:41.746593+0000","last_became_peered":"2024-09-15T23:12:41.746593+0000","last_unstale":"2024-09-15T23:12:42.739699+0000","last_undegraded":"2024-09-15T23:12:42.739699+0000","last_fullsized":"2024-09-15T23:12:42.739699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:35.952241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741110+0000","last_change":"2024-09-15T23:12:39.486320+0000","last_active":"2024-09-15T23:12:42.741110+0000","last_peered":"2024-09-15T23:12:42.741110+0000","last_clean":"2024-09-15T23:12:42.741110+0000","last_became_active":"2024-09-15T23:12:39.486010+0000","last_became_peered":"2024-09-15T23:12:39.486010+0000","last_unstale":"2024-09-15T23:12:42.741110+0000","last_undegraded":"2024-09-15T23:12:42.741110+0000","last_fullsized":"2024-09-15T23:12:42.741110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:33.701288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741014+0000","last_change":"2024-09-15T23:12:41.759468+0000","last_active":"2024-09-15T23:12:42.741014+0000","last_peered":"2024-09-15T23:12:42.741014+0000","last_clean":"2024-09-15T23:12:42.741014+0000","last_became_active":"2024-09-15T23:12:41.758145+0000","last_became_peered":"2024-09-15T23:12:41.758145+0000","last_unstale":"2024-09-15T23:12:42.741014+0000","last_undegraded":"2024-09-15T23:12:42.741014+0000","last_fullsized":"2024-09-15T23:12:42.741014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:19.055440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740992+0000","last_change":"2024-09-15T23:12:39.693366+0000","last_active":"2024-09-15T23:12:42.740992+0000","last_peered":"2024-09-15T23:12:42.740992+0000","last_clean":"2024-09-15T23:12:42.740992+0000","last_became_active":"2024-09-15T23:12:39.692941+0000","last_became_peered":"2024-09-15T23:12:39.692941+0000","last_unstale":"2024-09-15T23:12:42.740992+0000","last_undegraded":"2024-09-15T23:12:42.740992+0000","last_fullsized":"2024-09-15T23:12:42.740992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:04.371184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739895+0000","last_change":"2024-09-15T23:12:41.750195+0000","last_active":"2024-09-15T23:12:42.739895+0000","last_peered":"2024-09-15T23:12:42.739895+0000","last_clean":"2024-09-15T23:12:42.739895+0000","last_became_active":"2024-09-15T23:12:41.749862+0000","last_became_peered":"2024-09-15T23:12:41.749862+0000","last_unstale":"2024-09-15T23:12:42.739895+0000","last_undegraded":"2024-09-15T23:12:42.739895+0000","last_fullsized":"2024-09-15T23:12:42.739895+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:59.746604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:13:02.792121+0000","last_change":"2024-09-15T23:12:39.485608+0000","last_active":"2024-09-15T23:13:02.792121+0000","last_peered":"2024-09-15T23:13:02.792121+0000","last_clean":"2024-09-15T23:13:02.792121+0000","last_became_active":"2024-09-15T23:12:39.485266+0000","last_became_peered":"2024-09-15T23:12:39.485266+0000","last_unstale":"2024-09-15T23:13:02.792121+0000","last_undegraded":"2024-09-15T23:13:02.792121+0000","last_fullsized":"2024-09-15T23:13:02.792121+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:04.696726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":68,"num_write":25,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739653+0000","last_change":"2024-09-15T23:12:41.756495+0000","last_active":"2024-09-15T23:12:42.739653+0000","last_peered":"2024-09-15T23:12:42.739653+0000","last_clean":"2024-09-15T23:12:42.739653+0000","last_became_active":"2024-09-15T23:12:41.756130+0000","last_became_peered":"2024-09-15T23:12:41.756130+0000","last_unstale":"2024-09-15T23:12:42.739653+0000","last_undegraded":"2024-09-15T23:12:42.739653+0000","last_fullsized":"2024-09-15T23:12:42.739653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:29.100300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745626+0000","last_change":"2024-09-15T23:12:39.488511+0000","last_active":"2024-09-15T23:12:42.745626+0000","last_peered":"2024-09-15T23:12:42.745626+0000","last_clean":"2024-09-15T23:12:42.745626+0000","last_became_active":"2024-09-15T23:12:39.488199+0000","last_became_peered":"2024-09-15T23:12:39.488199+0000","last_unstale":"2024-09-15T23:12:42.745626+0000","last_undegraded":"2024-09-15T23:12:42.745626+0000","last_fullsized":"2024-09-15T23:12:42.745626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:08.678809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.737980+0000","last_change":"2024-09-15T23:12:41.756216+0000","last_active":"2024-09-15T23:12:42.737980+0000","last_peered":"2024-09-15T23:12:42.737980+0000","last_clean":"2024-09-15T23:12:42.737980+0000","last_became_active":"2024-09-15T23:12:41.755857+0000","last_became_peered":"2024-09-15T23:12:41.755857+0000","last_unstale":"2024-09-15T23:12:42.737980+0000","last_undegraded":"2024-09-15T23:12:42.737980+0000","last_fullsized":"2024-09-15T23:12:42.737980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:03.639704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732400+0000","last_change":"2024-09-15T23:12:39.482504+0000","last_active":"2024-09-15T23:12:42.732400+0000","last_peered":"2024-09-15T23:12:42.732400+0000","last_clean":"2024-09-15T23:12:42.732400+0000","last_became_active":"2024-09-15T23:12:39.482083+0000","last_became_peered":"2024-09-15T23:12:39.482083+0000","last_unstale":"2024-09-15T23:12:42.732400+0000","last_undegraded":"2024-09-15T23:12:42.732400+0000","last_fullsized":"2024-09-15T23:12:42.732400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:33.273301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741167+0000","last_change":"2024-09-15T23:12:41.752607+0000","last_active":"2024-09-15T23:12:42.741167+0000","last_peered":"2024-09-15T23:12:42.741167+0000","last_clean":"2024-09-15T23:12:42.741167+0000","last_became_active":"2024-09-15T23:12:41.752217+0000","last_became_peered":"2024-09-15T23:12:41.752217+0000","last_unstale":"2024-09-15T23:12:42.741167+0000","last_undegraded":"2024-09-15T23:12:42.741167+0000","last_fullsized":"2024-09-15T23:12:42.741167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:46:01.152604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.744681+0000","last_change":"2024-09-15T23:12:39.486036+0000","last_active":"2024-09-15T23:12:42.744681+0000","last_peered":"2024-09-15T23:12:42.744681+0000","last_clean":"2024-09-15T23:12:42.744681+0000","last_became_active":"2024-09-15T23:12:39.485703+0000","last_became_peered":"2024-09-15T23:12:39.485703+0000","last_unstale":"2024-09-15T23:12:42.744681+0000","last_undegraded":"2024-09-15T23:12:42.744681+0000","last_fullsized":"2024-09-15T23:12:42.744681+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:19.172258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740504+0000","last_change":"2024-09-15T23:12:41.751872+0000","last_active":"2024-09-15T23:12:42.740504+0000","last_peered":"2024-09-15T23:12:42.740504+0000","last_clean":"2024-09-15T23:12:42.740504+0000","last_became_active":"2024-09-15T23:12:41.751172+0000","last_became_peered":"2024-09-15T23:12:41.751172+0000","last_unstale":"2024-09-15T23:12:42.740504+0000","last_undegraded":"2024-09-15T23:12:42.740504+0000","last_fullsized":"2024-09-15T23:12:42.740504+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:00.508912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.746250+0000","last_change":"2024-09-15T23:12:39.692467+0000","last_active":"2024-09-15T23:12:42.746250+0000","last_peered":"2024-09-15T23:12:42.746250+0000","last_clean":"2024-09-15T23:12:42.746250+0000","last_became_active":"2024-09-15T23:12:39.692101+0000","last_became_peered":"2024-09-15T23:12:39.692101+0000","last_unstale":"2024-09-15T23:12:42.746250+0000","last_undegraded":"2024-09-15T23:12:42.746250+0000","last_fullsized":"2024-09-15T23:12:42.746250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:23.099398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732262+0000","last_change":"2024-09-15T23:12:41.744463+0000","last_active":"2024-09-15T23:12:42.732262+0000","last_peered":"2024-09-15T23:12:42.732262+0000","last_clean":"2024-09-15T23:12:42.732262+0000","last_became_active":"2024-09-15T23:12:41.743591+0000","last_became_peered":"2024-09-15T23:12:41.743591+0000","last_unstale":"2024-09-15T23:12:42.732262+0000","last_undegraded":"2024-09-15T23:12:42.732262+0000","last_fullsized":"2024-09-15T23:12:42.732262+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:37.311609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745161+0000","last_change":"2024-09-15T23:12:39.481639+0000","last_active":"2024-09-15T23:12:42.745161+0000","last_peered":"2024-09-15T23:12:42.745161+0000","last_clean":"2024-09-15T23:12:42.745161+0000","last_became_active":"2024-09-15T23:12:39.481231+0000","last_became_peered":"2024-09-15T23:12:39.481231+0000","last_unstale":"2024-09-15T23:12:42.745161+0000","last_undegraded":"2024-09-15T23:12:42.745161+0000","last_fullsized":"2024-09-15T23:12:42.745161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:37.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732633+0000","last_change":"2024-09-15T23:12:41.751557+0000","last_active":"2024-09-15T23:12:42.732633+0000","last_peered":"2024-09-15T23:12:42.732633+0000","last_clean":"2024-09-15T23:12:42.732633+0000","last_became_active":"2024-09-15T23:12:41.751257+0000","last_became_peered":"2024-09-15T23:12:41.751257+0000","last_unstale":"2024-09-15T23:12:42.732633+0000","last_undegraded":"2024-09-15T23:12:42.732633+0000","last_fullsized":"2024-09-15T23:12:42.732633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:59:48.799875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.744483+0000","last_change":"2024-09-15T23:12:39.485812+0000","last_active":"2024-09-15T23:12:42.744483+0000","last_peered":"2024-09-15T23:12:42.744483+0000","last_clean":"2024-09-15T23:12:42.744483+0000","last_became_active":"2024-09-15T23:12:39.485447+0000","last_became_peered":"2024-09-15T23:12:39.485447+0000","last_unstale":"2024-09-15T23:12:42.744483+0000","last_undegraded":"2024-09-15T23:12:42.744483+0000","last_fullsized":"2024-09-15T23:12:42.744483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:05.483798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741676+0000","last_change":"2024-09-15T23:12:41.753166+0000","last_active":"2024-09-15T23:12:42.741676+0000","last_peered":"2024-09-15T23:12:42.741676+0000","last_clean":"2024-09-15T23:12:42.741676+0000","last_became_active":"2024-09-15T23:12:41.752841+0000","last_became_peered":"2024-09-15T23:12:41.752841+0000","last_unstale":"2024-09-15T23:12:42.741676+0000","last_undegraded":"2024-09-15T23:12:42.741676+0000","last_fullsized":"2024-09-15T23:12:42.741676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:38.439192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.743699+0000","last_change":"2024-09-15T23:12:39.484696+0000","last_active":"2024-09-15T23:12:42.743699+0000","last_peered":"2024-09-15T23:12:42.743699+0000","last_clean":"2024-09-15T23:12:42.743699+0000","last_became_active":"2024-09-15T23:12:39.484230+0000","last_became_peered":"2024-09-15T23:12:39.484230+0000","last_unstale":"2024-09-15T23:12:42.743699+0000","last_undegraded":"2024-09-15T23:12:42.743699+0000","last_fullsized":"2024-09-15T23:12:42.743699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:12.456661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741503+0000","last_change":"2024-09-15T23:12:41.750605+0000","last_active":"2024-09-15T23:12:42.741503+0000","last_peered":"2024-09-15T23:12:42.741503+0000","last_clean":"2024-09-15T23:12:42.741503+0000","last_became_active":"2024-09-15T23:12:41.750236+0000","last_became_peered":"2024-09-15T23:12:41.750236+0000","last_unstale":"2024-09-15T23:12:42.741503+0000","last_undegraded":"2024-09-15T23:12:42.741503+0000","last_fullsized":"2024-09-15T23:12:42.741503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:24.918315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738855+0000","last_change":"2024-09-15T23:12:40.282059+0000","last_active":"2024-09-15T23:12:42.738855+0000","last_peered":"2024-09-15T23:12:42.738855+0000","last_clean":"2024-09-15T23:12:42.738855+0000","last_became_active":"2024-09-15T23:12:40.281653+0000","last_became_peered":"2024-09-15T23:12:40.281653+0000","last_unstale":"2024-09-15T23:12:42.738855+0000","last_undegraded":"2024-09-15T23:12:42.738855+0000","last_fullsized":"2024-09-15T23:12:42.738855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:36.408119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741482+0000","last_change":"2024-09-15T23:12:41.751629+0000","last_active":"2024-09-15T23:12:42.741482+0000","last_peered":"2024-09-15T23:12:42.741482+0000","last_clean":"2024-09-15T23:12:42.741482+0000","last_became_active":"2024-09-15T23:12:41.751279+0000","last_became_peered":"2024-09-15T23:12:41.751279+0000","last_unstale":"2024-09-15T23:12:42.741482+0000","last_undegraded":"2024-09-15T23:12:42.741482+0000","last_fullsized":"2024-09-15T23:12:42.741482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:34.240811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":343,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740703+0000","last_change":"2024-09-15T23:11:26.734634+0000","last_active":"2024-09-15T23:12:42.740703+0000","last_peered":"2024-09-15T23:12:42.740703+0000","last_clean":"2024-09-15T23:12:42.740703+0000","last_became_active":"2024-09-15T23:11:26.734217+0000","last_became_peered":"2024-09-15T23:11:26.734217+0000","last_unstale":"2024-09-15T23:12:42.740703+0000","last_undegraded":"2024-09-15T23:12:42.740703+0000","last_fullsized":"2024-09-15T23:12:42.740703+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:07:58.008474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:07:58.008474+0000","last_clean_scrub_stamp":"2024-09-15T23:07:58.008474+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:59.634217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.744886+0000","last_change":"2024-09-15T23:12:39.485101+0000","last_active":"2024-09-15T23:12:42.744886+0000","last_peered":"2024-09-15T23:12:42.744886+0000","last_clean":"2024-09-15T23:12:42.744886+0000","last_became_active":"2024-09-15T23:12:39.484651+0000","last_became_peered":"2024-09-15T23:12:39.484651+0000","last_unstale":"2024-09-15T23:12:42.744886+0000","last_undegraded":"2024-09-15T23:12:42.744886+0000","last_fullsized":"2024-09-15T23:12:42.744886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:46.709430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739809+0000","last_change":"2024-09-15T23:12:41.742460+0000","last_active":"2024-09-15T23:12:42.739809+0000","last_peered":"2024-09-15T23:12:42.739809+0000","last_clean":"2024-09-15T23:12:42.739809+0000","last_became_active":"2024-09-15T23:12:41.742157+0000","last_became_peered":"2024-09-15T23:12:41.742157+0000","last_unstale":"2024-09-15T23:12:42.739809+0000","last_undegraded":"2024-09-15T23:12:42.739809+0000","last_fullsized":"2024-09-15T23:12:42.739809+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:36.602078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740755+0000","last_change":"2024-09-15T23:12:39.481814+0000","last_active":"2024-09-15T23:12:42.740755+0000","last_peered":"2024-09-15T23:12:42.740755+0000","last_clean":"2024-09-15T23:12:42.740755+0000","last_became_active":"2024-09-15T23:12:39.481419+0000","last_became_peered":"2024-09-15T23:12:39.481419+0000","last_unstale":"2024-09-15T23:12:42.740755+0000","last_undegraded":"2024-09-15T23:12:42.740755+0000","last_fullsized":"2024-09-15T23:12:42.740755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:42.217786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.737908+0000","last_change":"2024-09-15T23:12:41.752430+0000","last_active":"2024-09-15T23:12:42.737908+0000","last_peered":"2024-09-15T23:12:42.737908+0000","last_clean":"2024-09-15T23:12:42.737908+0000","last_became_active":"2024-09-15T23:12:41.752102+0000","last_became_peered":"2024-09-15T23:12:41.752102+0000","last_unstale":"2024-09-15T23:12:42.737908+0000","last_undegraded":"2024-09-15T23:12:42.737908+0000","last_fullsized":"2024-09-15T23:12:42.737908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:50.177644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738122+0000","last_change":"2024-09-15T23:12:39.692189+0000","last_active":"2024-09-15T23:12:42.738122+0000","last_peered":"2024-09-15T23:12:42.738122+0000","last_clean":"2024-09-15T23:12:42.738122+0000","last_became_active":"2024-09-15T23:12:39.691839+0000","last_became_peered":"2024-09-15T23:12:39.691839+0000","last_unstale":"2024-09-15T23:12:42.738122+0000","last_undegraded":"2024-09-15T23:12:42.738122+0000","last_fullsized":"2024-09-15T23:12:42.738122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:31.286533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732423+0000","last_change":"2024-09-15T23:12:41.745096+0000","last_active":"2024-09-15T23:12:42.732423+0000","last_peered":"2024-09-15T23:12:42.732423+0000","last_clean":"2024-09-15T23:12:42.732423+0000","last_became_active":"2024-09-15T23:12:41.744647+0000","last_became_peered":"2024-09-15T23:12:41.744647+0000","last_unstale":"2024-09-15T23:12:42.732423+0000","last_undegraded":"2024-09-15T23:12:42.732423+0000","last_fullsized":"2024-09-15T23:12:42.732423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:06.681024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741031+0000","last_change":"2024-09-15T23:12:39.482633+0000","last_active":"2024-09-15T23:12:42.741031+0000","last_peered":"2024-09-15T23:12:42.741031+0000","last_clean":"2024-09-15T23:12:42.741031+0000","last_became_active":"2024-09-15T23:12:39.481842+0000","last_became_peered":"2024-09-15T23:12:39.481842+0000","last_unstale":"2024-09-15T23:12:42.741031+0000","last_undegraded":"2024-09-15T23:12:42.741031+0000","last_fullsized":"2024-09-15T23:12:42.741031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:16.995713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732633+0000","last_change":"2024-09-15T23:12:41.750155+0000","last_active":"2024-09-15T23:12:42.732633+0000","last_peered":"2024-09-15T23:12:42.732633+0000","last_clean":"2024-09-15T23:12:42.732633+0000","last_became_active":"2024-09-15T23:12:41.749851+0000","last_became_peered":"2024-09-15T23:12:41.749851+0000","last_unstale":"2024-09-15T23:12:42.732633+0000","last_undegraded":"2024-09-15T23:12:42.732633+0000","last_fullsized":"2024-09-15T23:12:42.732633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:48.019129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741629+0000","last_change":"2024-09-15T23:12:39.692721+0000","last_active":"2024-09-15T23:12:42.741629+0000","last_peered":"2024-09-15T23:12:42.741629+0000","last_clean":"2024-09-15T23:12:42.741629+0000","last_became_active":"2024-09-15T23:12:39.692345+0000","last_became_peered":"2024-09-15T23:12:39.692345+0000","last_unstale":"2024-09-15T23:12:42.741629+0000","last_undegraded":"2024-09-15T23:12:42.741629+0000","last_fullsized":"2024-09-15T23:12:42.741629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:36.527037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:43.241720+0000","last_change":"2024-09-15T23:12:41.739854+0000","last_active":"2024-09-15T23:12:43.241720+0000","last_peered":"2024-09-15T23:12:43.241720+0000","last_clean":"2024-09-15T23:12:43.241720+0000","last_became_active":"2024-09-15T23:12:41.739514+0000","last_became_peered":"2024-09-15T23:12:41.739514+0000","last_unstale":"2024-09-15T23:12:43.241720+0000","last_undegraded":"2024-09-15T23:12:43.241720+0000","last_fullsized":"2024-09-15T23:12:43.241720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:08.001384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739992+0000","last_change":"2024-09-15T23:12:39.693238+0000","last_active":"2024-09-15T23:12:42.739992+0000","last_peered":"2024-09-15T23:12:42.739992+0000","last_clean":"2024-09-15T23:12:42.739992+0000","last_became_active":"2024-09-15T23:12:39.692838+0000","last_became_peered":"2024-09-15T23:12:39.692838+0000","last_unstale":"2024-09-15T23:12:42.739992+0000","last_undegraded":"2024-09-15T23:12:42.739992+0000","last_fullsized":"2024-09-15T23:12:42.739992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:48.385920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740144+0000","last_change":"2024-09-15T23:12:41.750113+0000","last_active":"2024-09-15T23:12:42.740144+0000","last_peered":"2024-09-15T23:12:42.740144+0000","last_clean":"2024-09-15T23:12:42.740144+0000","last_became_active":"2024-09-15T23:12:41.749799+0000","last_became_peered":"2024-09-15T23:12:41.749799+0000","last_unstale":"2024-09-15T23:12:42.740144+0000","last_undegraded":"2024-09-15T23:12:42.740144+0000","last_fullsized":"2024-09-15T23:12:42.740144+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:52:48.095393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:13:01.739514+0000","last_change":"2024-09-15T23:12:39.480093+0000","last_active":"2024-09-15T23:13:01.739514+0000","last_peered":"2024-09-15T23:13:01.739514+0000","last_clean":"2024-09-15T23:13:01.739514+0000","last_became_active":"2024-09-15T23:12:39.479702+0000","last_became_peered":"2024-09-15T23:12:39.479702+0000","last_unstale":"2024-09-15T23:13:01.739514+0000","last_undegraded":"2024-09-15T23:13:01.739514+0000","last_fullsized":"2024-09-15T23:13:01.739514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:34.617090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.743556+0000","last_change":"2024-09-15T23:12:41.746786+0000","last_active":"2024-09-15T23:12:42.743556+0000","last_peered":"2024-09-15T23:12:42.743556+0000","last_clean":"2024-09-15T23:12:42.743556+0000","last_became_active":"2024-09-15T23:12:41.745877+0000","last_became_peered":"2024-09-15T23:12:41.745877+0000","last_unstale":"2024-09-15T23:12:42.743556+0000","last_undegraded":"2024-09-15T23:12:42.743556+0000","last_fullsized":"2024-09-15T23:12:42.743556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:33.458142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.746831+0000","last_change":"2024-09-15T23:12:40.282279+0000","last_active":"2024-09-15T23:12:42.746831+0000","last_peered":"2024-09-15T23:12:42.746831+0000","last_clean":"2024-09-15T23:12:42.746831+0000","last_became_active":"2024-09-15T23:12:40.281854+0000","last_became_peered":"2024-09-15T23:12:40.281854+0000","last_unstale":"2024-09-15T23:12:42.746831+0000","last_undegraded":"2024-09-15T23:12:42.746831+0000","last_fullsized":"2024-09-15T23:12:42.746831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:09.344989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740553+0000","last_change":"2024-09-15T23:12:41.759333+0000","last_active":"2024-09-15T23:12:42.740553+0000","last_peered":"2024-09-15T23:12:42.740553+0000","last_clean":"2024-09-15T23:12:42.740553+0000","last_became_active":"2024-09-15T23:12:41.757329+0000","last_became_peered":"2024-09-15T23:12:41.757329+0000","last_unstale":"2024-09-15T23:12:42.740553+0000","last_undegraded":"2024-09-15T23:12:42.740553+0000","last_fullsized":"2024-09-15T23:12:42.740553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:03.804263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739031+0000","last_change":"2024-09-15T23:12:39.692428+0000","last_active":"2024-09-15T23:12:42.739031+0000","last_peered":"2024-09-15T23:12:42.739031+0000","last_clean":"2024-09-15T23:12:42.739031+0000","last_became_active":"2024-09-15T23:12:39.692073+0000","last_became_peered":"2024-09-15T23:12:39.692073+0000","last_unstale":"2024-09-15T23:12:42.739031+0000","last_undegraded":"2024-09-15T23:12:42.739031+0000","last_fullsized":"2024-09-15T23:12:42.739031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:39.971583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739289+0000","last_change":"2024-09-15T23:12:41.752157+0000","last_active":"2024-09-15T23:12:42.739289+0000","last_peered":"2024-09-15T23:12:42.739289+0000","last_clean":"2024-09-15T23:12:42.739289+0000","last_became_active":"2024-09-15T23:12:41.751628+0000","last_became_peered":"2024-09-15T23:12:41.751628+0000","last_unstale":"2024-09-15T23:12:42.739289+0000","last_undegraded":"2024-09-15T23:12:42.739289+0000","last_fullsized":"2024-09-15T23:12:42.739289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:39.865611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740544+0000","last_change":"2024-09-15T23:12:39.484920+0000","last_active":"2024-09-15T23:12:42.740544+0000","last_peered":"2024-09-15T23:12:42.740544+0000","last_clean":"2024-09-15T23:12:42.740544+0000","last_became_active":"2024-09-15T23:12:39.484563+0000","last_became_peered":"2024-09-15T23:12:39.484563+0000","last_unstale":"2024-09-15T23:12:42.740544+0000","last_undegraded":"2024-09-15T23:12:42.740544+0000","last_fullsized":"2024-09-15T23:12:42.740544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:50.429881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.733033+0000","last_change":"2024-09-15T23:12:41.749718+0000","last_active":"2024-09-15T23:12:42.733033+0000","last_peered":"2024-09-15T23:12:42.733033+0000","last_clean":"2024-09-15T23:12:42.733033+0000","last_became_active":"2024-09-15T23:12:41.749187+0000","last_became_peered":"2024-09-15T23:12:41.749187+0000","last_unstale":"2024-09-15T23:12:42.733033+0000","last_undegraded":"2024-09-15T23:12:42.733033+0000","last_fullsized":"2024-09-15T23:12:42.733033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:30.700175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738368+0000","last_change":"2024-09-15T23:12:39.482472+0000","last_active":"2024-09-15T23:12:42.738368+0000","last_peered":"2024-09-15T23:12:42.738368+0000","last_clean":"2024-09-15T23:12:42.738368+0000","last_became_active":"2024-09-15T23:12:39.481105+0000","last_became_peered":"2024-09-15T23:12:39.481105+0000","last_unstale":"2024-09-15T23:12:42.738368+0000","last_undegraded":"2024-09-15T23:12:42.738368+0000","last_fullsized":"2024-09-15T23:12:42.738368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:34.106771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740801+0000","last_change":"2024-09-15T23:12:41.749399+0000","last_active":"2024-09-15T23:12:42.740801+0000","last_peered":"2024-09-15T23:12:42.740801+0000","last_clean":"2024-09-15T23:12:42.740801+0000","last_became_active":"2024-09-15T23:12:41.748616+0000","last_became_peered":"2024-09-15T23:12:41.748616+0000","last_unstale":"2024-09-15T23:12:42.740801+0000","last_undegraded":"2024-09-15T23:12:42.740801+0000","last_fullsized":"2024-09-15T23:12:42.740801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:28.729933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745413+0000","last_change":"2024-09-15T23:12:39.485773+0000","last_active":"2024-09-15T23:12:42.745413+0000","last_peered":"2024-09-15T23:12:42.745413+0000","last_clean":"2024-09-15T23:12:42.745413+0000","last_became_active":"2024-09-15T23:12:39.485403+0000","last_became_peered":"2024-09-15T23:12:39.485403+0000","last_unstale":"2024-09-15T23:12:42.745413+0000","last_undegraded":"2024-09-15T23:12:42.745413+0000","last_fullsized":"2024-09-15T23:12:42.745413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:56.405296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740903+0000","last_change":"2024-09-15T23:12:41.752877+0000","last_active":"2024-09-15T23:12:42.740903+0000","last_peered":"2024-09-15T23:12:42.740903+0000","last_clean":"2024-09-15T23:12:42.740903+0000","last_became_active":"2024-09-15T23:12:41.748011+0000","last_became_peered":"2024-09-15T23:12:41.748011+0000","last_unstale":"2024-09-15T23:12:42.740903+0000","last_undegraded":"2024-09-15T23:12:42.740903+0000","last_fullsized":"2024-09-15T23:12:42.740903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:58.741067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.733051+0000","last_change":"2024-09-15T23:12:41.743781+0000","last_active":"2024-09-15T23:12:42.733051+0000","last_peered":"2024-09-15T23:12:42.733051+0000","last_clean":"2024-09-15T23:12:42.733051+0000","last_became_active":"2024-09-15T23:12:41.743420+0000","last_became_peered":"2024-09-15T23:12:41.743420+0000","last_unstale":"2024-09-15T23:12:42.733051+0000","last_undegraded":"2024-09-15T23:12:42.733051+0000","last_fullsized":"2024-09-15T23:12:42.733051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:51.728955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.743704+0000","last_change":"2024-09-15T23:12:39.478145+0000","last_active":"2024-09-15T23:12:42.743704+0000","last_peered":"2024-09-15T23:12:42.743704+0000","last_clean":"2024-09-15T23:12:42.743704+0000","last_became_active":"2024-09-15T23:12:39.477774+0000","last_became_peered":"2024-09-15T23:12:39.477774+0000","last_unstale":"2024-09-15T23:12:42.743704+0000","last_undegraded":"2024-09-15T23:12:42.743704+0000","last_fullsized":"2024-09-15T23:12:42.743704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:19.057212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739744+0000","last_change":"2024-09-15T23:12:41.747398+0000","last_active":"2024-09-15T23:12:42.739744+0000","last_peered":"2024-09-15T23:12:42.739744+0000","last_clean":"2024-09-15T23:12:42.739744+0000","last_became_active":"2024-09-15T23:12:41.747049+0000","last_became_peered":"2024-09-15T23:12:41.747049+0000","last_unstale":"2024-09-15T23:12:42.739744+0000","last_undegraded":"2024-09-15T23:12:42.739744+0000","last_fullsized":"2024-09-15T23:12:42.739744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:00.979843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745155+0000","last_change":"2024-09-15T23:12:39.483666+0000","last_active":"2024-09-15T23:12:42.745155+0000","last_peered":"2024-09-15T23:12:42.745155+0000","last_clean":"2024-09-15T23:12:42.745155+0000","last_became_active":"2024-09-15T23:12:39.483309+0000","last_became_peered":"2024-09-15T23:12:39.483309+0000","last_unstale":"2024-09-15T23:12:42.745155+0000","last_undegraded":"2024-09-15T23:12:42.745155+0000","last_fullsized":"2024-09-15T23:12:42.745155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:25.785868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740838+0000","last_change":"2024-09-15T23:12:41.758766+0000","last_active":"2024-09-15T23:12:42.740838+0000","last_peered":"2024-09-15T23:12:42.740838+0000","last_clean":"2024-09-15T23:12:42.740838+0000","last_became_active":"2024-09-15T23:12:41.758457+0000","last_became_peered":"2024-09-15T23:12:41.758457+0000","last_unstale":"2024-09-15T23:12:42.740838+0000","last_undegraded":"2024-09-15T23:12:42.740838+0000","last_fullsized":"2024-09-15T23:12:42.740838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:45.319708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745491+0000","last_change":"2024-09-15T23:12:39.692412+0000","last_active":"2024-09-15T23:12:42.745491+0000","last_peered":"2024-09-15T23:12:42.745491+0000","last_clean":"2024-09-15T23:12:42.745491+0000","last_became_active":"2024-09-15T23:12:39.691953+0000","last_became_peered":"2024-09-15T23:12:39.691953+0000","last_unstale":"2024-09-15T23:12:42.745491+0000","last_undegraded":"2024-09-15T23:12:42.745491+0000","last_fullsized":"2024-09-15T23:12:42.745491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:07.811976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.743113+0000","last_change":"2024-09-15T23:12:41.753181+0000","last_active":"2024-09-15T23:12:42.743113+0000","last_peered":"2024-09-15T23:12:42.743113+0000","last_clean":"2024-09-15T23:12:42.743113+0000","last_became_active":"2024-09-15T23:12:41.752432+0000","last_became_peered":"2024-09-15T23:12:41.752432+0000","last_unstale":"2024-09-15T23:12:42.743113+0000","last_undegraded":"2024-09-15T23:12:42.743113+0000","last_fullsized":"2024-09-15T23:12:42.743113+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:37.363331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745102+0000","last_change":"2024-09-15T23:12:39.482238+0000","last_active":"2024-09-15T23:12:42.745102+0000","last_peered":"2024-09-15T23:12:42.745102+0000","last_clean":"2024-09-15T23:12:42.745102+0000","last_became_active":"2024-09-15T23:12:39.481524+0000","last_became_peered":"2024-09-15T23:12:39.481524+0000","last_unstale":"2024-09-15T23:12:42.745102+0000","last_undegraded":"2024-09-15T23:12:42.745102+0000","last_fullsized":"2024-09-15T23:12:42.745102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:36.839260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53965,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":41,"num_read_kb":74,"num_write":78,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":161895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285160,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":872448,"data_stored":422542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":1066388,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939676,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":423124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201312,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":423146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":1013609,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":422659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":1013209,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986230,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":876544,"data_stored":422564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215163,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":422880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444096,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":475743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":475709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":876544,"data_stored":422632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34625,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34625,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34625,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":53167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":53201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:13:06.537 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T23:13:06.798 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:07.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:06 smithi002 ceph-mon[31019]: pgmap v293: 97 pgs: 97 active+clean; 629 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.3 KiB/s wr, 5 op/s 2024-09-15T23:13:07.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:06 smithi002 ceph-mon[31019]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:13:07.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:06 smithi145 ceph-mon[34901]: pgmap v293: 97 pgs: 97 active+clean; 629 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.3 KiB/s wr, 5 op/s 2024-09-15T23:13:07.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:06 smithi145 ceph-mon[34901]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:13:07.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:06 smithi112 ceph-mon[34367]: pgmap v293: 97 pgs: 97 active+clean; 629 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.3 KiB/s wr, 5 op/s 2024-09-15T23:13:07.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:06 smithi112 ceph-mon[34367]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:13:07.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.301+0000 7fae1192e640 1 -- 172.21.15.2:0/2590345335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101420 msgr2=0x7fae0c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:07.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.301+0000 7fae1192e640 1 --2- 172.21.15.2:0/2590345335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101420 0x7fae0c10d950 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fae04009cd0 tx=0x7fae0402a8e0 comp rx=0 tx=0).stop 2024-09-15T23:13:07.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.301+0000 7fae1192e640 1 -- 172.21.15.2:0/2590345335 shutdown_connections 2024-09-15T23:13:07.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.301+0000 7fae1192e640 1 --2- 172.21.15.2:0/2590345335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101420 0x7fae0c10d950 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:07.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.301+0000 7fae1192e640 1 --2- 172.21.15.2:0/2590345335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c100a80 0x7fae0c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:07.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.301+0000 7fae1192e640 1 --2- 172.21.15.2:0/2590345335 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae0c106a80 0x7fae0c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:07.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.301+0000 7fae1192e640 1 -- 172.21.15.2:0/2590345335 >> 172.21.15.2:0/2590345335 conn(0x7fae0c0fc7a0 msgr2=0x7fae0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:07.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.301+0000 7fae1192e640 1 -- 172.21.15.2:0/2590345335 shutdown_connections 2024-09-15T23:13:07.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.301+0000 7fae1192e640 1 -- 172.21.15.2:0/2590345335 wait complete. 2024-09-15T23:13:07.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.301+0000 7fae1192e640 1 Processor -- start 2024-09-15T23:13:07.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae1192e640 1 -- start start 2024-09-15T23:13:07.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae1192e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae0c100a80 0x7fae0c0fced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:07.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae1192e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101420 0x7fae0c0fd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:07.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae1192e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c106a80 0x7fae0c0fd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:07.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae1192e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c110dd0 con 0x7fae0c101420 2024-09-15T23:13:07.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae1192e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c110c50 con 0x7fae0c106a80 2024-09-15T23:13:07.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae1192e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c110f50 con 0x7fae0c100a80 2024-09-15T23:13:07.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae0a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101420 0x7fae0c0fd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:07.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae0a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101420 0x7fae0c0fd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56726/0 (socket says 172.21.15.2:56726) 2024-09-15T23:13:07.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae0a7fc640 1 -- 172.21.15.2:0/2014051131 learned_addr learned my addr 172.21.15.2:0/2014051131 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:07.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae0affd640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae0c100a80 0x7fae0c0fced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:07.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae0b7fe640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c106a80 0x7fae0c0fd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:07.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae0a7fc640 1 -- 172.21.15.2:0/2014051131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae0c100a80 msgr2=0x7fae0c0fced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:07.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae0a7fc640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae0c100a80 0x7fae0c0fced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:07.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae0a7fc640 1 -- 172.21.15.2:0/2014051131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c106a80 msgr2=0x7fae0c0fd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:07.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae0a7fc640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c106a80 0x7fae0c0fd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:07.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae0a7fc640 1 -- 172.21.15.2:0/2014051131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0c1a68e0 con 0x7fae0c101420 2024-09-15T23:13:07.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae0a7fc640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101420 0x7fae0c0fd410 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fae0000b4a0 tx=0x7fae0000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:07.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.302+0000 7fae1092c640 1 -- 172.21.15.2:0/2014051131 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00014070 con 0x7fae0c101420 2024-09-15T23:13:07.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.303+0000 7fae1092c640 1 -- 172.21.15.2:0/2014051131 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae00010ac0 con 0x7fae0c101420 2024-09-15T23:13:07.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.303+0000 7fae1192e640 1 -- 172.21.15.2:0/2014051131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae0c1a6bd0 con 0x7fae0c101420 2024-09-15T23:13:07.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.303+0000 7fae1092c640 1 -- 172.21.15.2:0/2014051131 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00017c30 con 0x7fae0c101420 2024-09-15T23:13:07.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.303+0000 7fae1192e640 1 -- 172.21.15.2:0/2014051131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae0c1a7110 con 0x7fae0c101420 2024-09-15T23:13:07.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.304+0000 7fae1192e640 1 -- 172.21.15.2:0/2014051131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae0c100f60 con 0x7fae0c101420 2024-09-15T23:13:07.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.305+0000 7fae1092c640 1 -- 172.21.15.2:0/2014051131 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fae00017070 con 0x7fae0c101420 2024-09-15T23:13:07.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.305+0000 7fae1092c640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fadf40a32d0 0x7fadf40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:07.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.305+0000 7fae0affd640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fadf40a32d0 0x7fadf40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:07.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.306+0000 7fae1092c640 1 -- 172.21.15.2:0/2014051131 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fae000cef60 con 0x7fae0c101420 2024-09-15T23:13:07.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.306+0000 7fae0affd640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fadf40a32d0 0x7fadf40a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009890 tx=0x7fadfc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:07.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.309+0000 7fae1092c640 1 -- 172.21.15.2:0/2014051131 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae0009bde0 con 0x7fae0c101420 2024-09-15T23:13:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.481+0000 7fae1192e640 1 -- 172.21.15.2:0/2014051131 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae0c062630 con 0x7fadf40a32d0 2024-09-15T23:13:07.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.488+0000 7fae1092c640 1 -- 172.21.15.2:0/2014051131 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258791 (secure 0 0 0) 0x7fae0c062630 con 0x7fadf40a32d0 2024-09-15T23:13:07.495 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:07.498 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-15T23:13:07.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.491+0000 7fae1192e640 1 -- 172.21.15.2:0/2014051131 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fadf40a32d0 msgr2=0x7fadf40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:07.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.491+0000 7fae1192e640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fadf40a32d0 0x7fadf40a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009890 tx=0x7fadfc008040 comp rx=0 tx=0).stop 2024-09-15T23:13:07.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.491+0000 7fae1192e640 1 -- 172.21.15.2:0/2014051131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101420 msgr2=0x7fae0c0fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:07.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.491+0000 7fae1192e640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101420 0x7fae0c0fd410 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fae0000b4a0 tx=0x7fae0000b960 comp rx=0 tx=0).stop 2024-09-15T23:13:07.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.491+0000 7fae1192e640 1 -- 172.21.15.2:0/2014051131 shutdown_connections 2024-09-15T23:13:07.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.491+0000 7fae1192e640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fadf40a32d0 0x7fadf40a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:07.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.491+0000 7fae1192e640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae0c106a80 0x7fae0c0fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:07.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.491+0000 7fae1192e640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101420 0x7fae0c0fd410 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:07.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.491+0000 7fae1192e640 1 --2- 172.21.15.2:0/2014051131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fae0c100a80 0x7fae0c0fced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:07.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.491+0000 7fae1192e640 1 -- 172.21.15.2:0/2014051131 >> 172.21.15.2:0/2014051131 conn(0x7fae0c0fc7a0 msgr2=0x7fae0c06ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:07.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.492+0000 7fae1192e640 1 -- 172.21.15.2:0/2014051131 shutdown_connections 2024-09-15T23:13:07.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:07.492+0000 7fae1192e640 1 -- 172.21.15.2:0/2014051131 wait complete. 2024-09-15T23:13:08.223 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-09-15T23:13:05.507628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644567,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":177,"num_read_kb":193,"num_write":261,"num_write_kb":3016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368232,"kb_used_data":10632,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573592,"statfs":{"total":1151940427776,"available":1151563358208,"internally_reserved":0,"allocated":10887168,"data_stored":7004205,"data_compressed":108771,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51789,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":63,"num_write":35,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003339"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.733281+0000","last_change":"2024-09-15T23:12:41.750867+0000","last_active":"2024-09-15T23:12:42.733281+0000","last_peered":"2024-09-15T23:12:42.733281+0000","last_clean":"2024-09-15T23:12:42.733281+0000","last_became_active":"2024-09-15T23:12:41.750508+0000","last_became_peered":"2024-09-15T23:12:41.750508+0000","last_unstale":"2024-09-15T23:12:42.733281+0000","last_undegraded":"2024-09-15T23:12:42.733281+0000","last_fullsized":"2024-09-15T23:12:42.733281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:55.104563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740528+0000","last_change":"2024-09-15T23:12:41.752704+0000","last_active":"2024-09-15T23:12:42.740528+0000","last_peered":"2024-09-15T23:12:42.740528+0000","last_clean":"2024-09-15T23:12:42.740528+0000","last_became_active":"2024-09-15T23:12:41.751144+0000","last_became_peered":"2024-09-15T23:12:41.751144+0000","last_unstale":"2024-09-15T23:12:42.740528+0000","last_undegraded":"2024-09-15T23:12:42.740528+0000","last_fullsized":"2024-09-15T23:12:42.740528+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:10.332172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739915+0000","last_change":"2024-09-15T23:12:41.759051+0000","last_active":"2024-09-15T23:12:42.739915+0000","last_peered":"2024-09-15T23:12:42.739915+0000","last_clean":"2024-09-15T23:12:42.739915+0000","last_became_active":"2024-09-15T23:12:41.757243+0000","last_became_peered":"2024-09-15T23:12:41.757243+0000","last_unstale":"2024-09-15T23:12:42.739915+0000","last_undegraded":"2024-09-15T23:12:42.739915+0000","last_fullsized":"2024-09-15T23:12:42.739915+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:44.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745069+0000","last_change":"2024-09-15T23:12:41.751732+0000","last_active":"2024-09-15T23:12:42.745069+0000","last_peered":"2024-09-15T23:12:42.745069+0000","last_clean":"2024-09-15T23:12:42.745069+0000","last_became_active":"2024-09-15T23:12:41.751404+0000","last_became_peered":"2024-09-15T23:12:41.751404+0000","last_unstale":"2024-09-15T23:12:42.745069+0000","last_undegraded":"2024-09-15T23:12:42.745069+0000","last_fullsized":"2024-09-15T23:12:42.745069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:05.724326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739163+0000","last_change":"2024-09-15T23:12:41.750642+0000","last_active":"2024-09-15T23:12:42.739163+0000","last_peered":"2024-09-15T23:12:42.739163+0000","last_clean":"2024-09-15T23:12:42.739163+0000","last_became_active":"2024-09-15T23:12:41.750312+0000","last_became_peered":"2024-09-15T23:12:41.750312+0000","last_unstale":"2024-09-15T23:12:42.739163+0000","last_undegraded":"2024-09-15T23:12:42.739163+0000","last_fullsized":"2024-09-15T23:12:42.739163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:46.168397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732323+0000","last_change":"2024-09-15T23:12:41.744794+0000","last_active":"2024-09-15T23:12:42.732323+0000","last_peered":"2024-09-15T23:12:42.732323+0000","last_clean":"2024-09-15T23:12:42.732323+0000","last_became_active":"2024-09-15T23:12:41.744468+0000","last_became_peered":"2024-09-15T23:12:41.744468+0000","last_unstale":"2024-09-15T23:12:42.732323+0000","last_undegraded":"2024-09-15T23:12:42.732323+0000","last_fullsized":"2024-09-15T23:12:42.732323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:22.298132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740783+0000","last_change":"2024-09-15T23:12:41.746124+0000","last_active":"2024-09-15T23:12:42.740783+0000","last_peered":"2024-09-15T23:12:42.740783+0000","last_clean":"2024-09-15T23:12:42.740783+0000","last_became_active":"2024-09-15T23:12:41.745756+0000","last_became_peered":"2024-09-15T23:12:41.745756+0000","last_unstale":"2024-09-15T23:12:42.740783+0000","last_undegraded":"2024-09-15T23:12:42.740783+0000","last_fullsized":"2024-09-15T23:12:42.740783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:12.368976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739435+0000","last_change":"2024-09-15T23:12:41.742047+0000","last_active":"2024-09-15T23:12:42.739435+0000","last_peered":"2024-09-15T23:12:42.739435+0000","last_clean":"2024-09-15T23:12:42.739435+0000","last_became_active":"2024-09-15T23:12:41.741730+0000","last_became_peered":"2024-09-15T23:12:41.741730+0000","last_unstale":"2024-09-15T23:12:42.739435+0000","last_undegraded":"2024-09-15T23:12:42.739435+0000","last_fullsized":"2024-09-15T23:12:42.739435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:46.278342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740074+0000","last_change":"2024-09-15T23:12:41.757117+0000","last_active":"2024-09-15T23:12:42.740074+0000","last_peered":"2024-09-15T23:12:42.740074+0000","last_clean":"2024-09-15T23:12:42.740074+0000","last_became_active":"2024-09-15T23:12:41.756515+0000","last_became_peered":"2024-09-15T23:12:41.756515+0000","last_unstale":"2024-09-15T23:12:42.740074+0000","last_undegraded":"2024-09-15T23:12:42.740074+0000","last_fullsized":"2024-09-15T23:12:42.740074+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:37.453454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732831+0000","last_change":"2024-09-15T23:12:41.751118+0000","last_active":"2024-09-15T23:12:42.732831+0000","last_peered":"2024-09-15T23:12:42.732831+0000","last_clean":"2024-09-15T23:12:42.732831+0000","last_became_active":"2024-09-15T23:12:41.750748+0000","last_became_peered":"2024-09-15T23:12:41.750748+0000","last_unstale":"2024-09-15T23:12:42.732831+0000","last_undegraded":"2024-09-15T23:12:42.732831+0000","last_fullsized":"2024-09-15T23:12:42.732831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:55.079937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741321+0000","last_change":"2024-09-15T23:12:41.756539+0000","last_active":"2024-09-15T23:12:42.741321+0000","last_peered":"2024-09-15T23:12:42.741321+0000","last_clean":"2024-09-15T23:12:42.741321+0000","last_became_active":"2024-09-15T23:12:41.756191+0000","last_became_peered":"2024-09-15T23:12:41.756191+0000","last_unstale":"2024-09-15T23:12:42.741321+0000","last_undegraded":"2024-09-15T23:12:42.741321+0000","last_fullsized":"2024-09-15T23:12:42.741321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:52.715699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745055+0000","last_change":"2024-09-15T23:12:41.750681+0000","last_active":"2024-09-15T23:12:42.745055+0000","last_peered":"2024-09-15T23:12:42.745055+0000","last_clean":"2024-09-15T23:12:42.745055+0000","last_became_active":"2024-09-15T23:12:41.750344+0000","last_became_peered":"2024-09-15T23:12:41.750344+0000","last_unstale":"2024-09-15T23:12:42.745055+0000","last_undegraded":"2024-09-15T23:12:42.745055+0000","last_fullsized":"2024-09-15T23:12:42.745055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:13.455792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.742252+0000","last_change":"2024-09-15T23:12:41.752626+0000","last_active":"2024-09-15T23:12:42.742252+0000","last_peered":"2024-09-15T23:12:42.742252+0000","last_clean":"2024-09-15T23:12:42.742252+0000","last_became_active":"2024-09-15T23:12:41.752177+0000","last_became_peered":"2024-09-15T23:12:41.752177+0000","last_unstale":"2024-09-15T23:12:42.742252+0000","last_undegraded":"2024-09-15T23:12:42.742252+0000","last_fullsized":"2024-09-15T23:12:42.742252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:41.180073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740175+0000","last_change":"2024-09-15T23:12:41.750831+0000","last_active":"2024-09-15T23:12:42.740175+0000","last_peered":"2024-09-15T23:12:42.740175+0000","last_clean":"2024-09-15T23:12:42.740175+0000","last_became_active":"2024-09-15T23:12:41.750528+0000","last_became_peered":"2024-09-15T23:12:41.750528+0000","last_unstale":"2024-09-15T23:12:42.740175+0000","last_undegraded":"2024-09-15T23:12:42.740175+0000","last_fullsized":"2024-09-15T23:12:42.740175+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:11.737726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740210+0000","last_change":"2024-09-15T23:12:41.750079+0000","last_active":"2024-09-15T23:12:42.740210+0000","last_peered":"2024-09-15T23:12:42.740210+0000","last_clean":"2024-09-15T23:12:42.740210+0000","last_became_active":"2024-09-15T23:12:41.749551+0000","last_became_peered":"2024-09-15T23:12:41.749551+0000","last_unstale":"2024-09-15T23:12:42.740210+0000","last_undegraded":"2024-09-15T23:12:42.740210+0000","last_fullsized":"2024-09-15T23:12:42.740210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:37.283315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738760+0000","last_change":"2024-09-15T23:12:41.754855+0000","last_active":"2024-09-15T23:12:42.738760+0000","last_peered":"2024-09-15T23:12:42.738760+0000","last_clean":"2024-09-15T23:12:42.738760+0000","last_became_active":"2024-09-15T23:12:41.753825+0000","last_became_peered":"2024-09-15T23:12:41.753825+0000","last_unstale":"2024-09-15T23:12:42.738760+0000","last_undegraded":"2024-09-15T23:12:42.738760+0000","last_fullsized":"2024-09-15T23:12:42.738760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:21.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.733315+0000","last_change":"2024-09-15T23:12:41.750708+0000","last_active":"2024-09-15T23:12:42.733315+0000","last_peered":"2024-09-15T23:12:42.733315+0000","last_clean":"2024-09-15T23:12:42.733315+0000","last_became_active":"2024-09-15T23:12:41.750372+0000","last_became_peered":"2024-09-15T23:12:41.750372+0000","last_unstale":"2024-09-15T23:12:42.733315+0000","last_undegraded":"2024-09-15T23:12:42.733315+0000","last_fullsized":"2024-09-15T23:12:42.733315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:22.693466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.742015+0000","last_change":"2024-09-15T23:12:41.745514+0000","last_active":"2024-09-15T23:12:42.742015+0000","last_peered":"2024-09-15T23:12:42.742015+0000","last_clean":"2024-09-15T23:12:42.742015+0000","last_became_active":"2024-09-15T23:12:41.745165+0000","last_became_peered":"2024-09-15T23:12:41.745165+0000","last_unstale":"2024-09-15T23:12:42.742015+0000","last_undegraded":"2024-09-15T23:12:42.742015+0000","last_fullsized":"2024-09-15T23:12:42.742015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:39.275396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738623+0000","last_change":"2024-09-15T23:12:41.752590+0000","last_active":"2024-09-15T23:12:42.738623+0000","last_peered":"2024-09-15T23:12:42.738623+0000","last_clean":"2024-09-15T23:12:42.738623+0000","last_became_active":"2024-09-15T23:12:41.752269+0000","last_became_peered":"2024-09-15T23:12:41.752269+0000","last_unstale":"2024-09-15T23:12:42.738623+0000","last_undegraded":"2024-09-15T23:12:42.738623+0000","last_fullsized":"2024-09-15T23:12:42.738623+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:48:12.304549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732581+0000","last_change":"2024-09-15T23:12:41.746485+0000","last_active":"2024-09-15T23:12:42.732581+0000","last_peered":"2024-09-15T23:12:42.732581+0000","last_clean":"2024-09-15T23:12:42.732581+0000","last_became_active":"2024-09-15T23:12:41.746148+0000","last_became_peered":"2024-09-15T23:12:41.746148+0000","last_unstale":"2024-09-15T23:12:42.732581+0000","last_undegraded":"2024-09-15T23:12:42.732581+0000","last_fullsized":"2024-09-15T23:12:42.732581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:38.874706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741136+0000","last_change":"2024-09-15T23:12:41.758169+0000","last_active":"2024-09-15T23:12:42.741136+0000","last_peered":"2024-09-15T23:12:42.741136+0000","last_clean":"2024-09-15T23:12:42.741136+0000","last_became_active":"2024-09-15T23:12:41.757542+0000","last_became_peered":"2024-09-15T23:12:41.757542+0000","last_unstale":"2024-09-15T23:12:42.741136+0000","last_undegraded":"2024-09-15T23:12:42.741136+0000","last_fullsized":"2024-09-15T23:12:42.741136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:55.430022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739205+0000","last_change":"2024-09-15T23:12:41.751024+0000","last_active":"2024-09-15T23:12:42.739205+0000","last_peered":"2024-09-15T23:12:42.739205+0000","last_clean":"2024-09-15T23:12:42.739205+0000","last_became_active":"2024-09-15T23:12:41.750610+0000","last_became_peered":"2024-09-15T23:12:41.750610+0000","last_unstale":"2024-09-15T23:12:42.739205+0000","last_undegraded":"2024-09-15T23:12:42.739205+0000","last_fullsized":"2024-09-15T23:12:42.739205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:54.563688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739421+0000","last_change":"2024-09-15T23:12:41.748779+0000","last_active":"2024-09-15T23:12:42.739421+0000","last_peered":"2024-09-15T23:12:42.739421+0000","last_clean":"2024-09-15T23:12:42.739421+0000","last_became_active":"2024-09-15T23:12:41.748471+0000","last_became_peered":"2024-09-15T23:12:41.748471+0000","last_unstale":"2024-09-15T23:12:42.739421+0000","last_undegraded":"2024-09-15T23:12:42.739421+0000","last_fullsized":"2024-09-15T23:12:42.739421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:55.771917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732238+0000","last_change":"2024-09-15T23:12:41.748306+0000","last_active":"2024-09-15T23:12:42.732238+0000","last_peered":"2024-09-15T23:12:42.732238+0000","last_clean":"2024-09-15T23:12:42.732238+0000","last_became_active":"2024-09-15T23:12:41.747950+0000","last_became_peered":"2024-09-15T23:12:41.747950+0000","last_unstale":"2024-09-15T23:12:42.732238+0000","last_undegraded":"2024-09-15T23:12:42.732238+0000","last_fullsized":"2024-09-15T23:12:42.732238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:51.846769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.743408+0000","last_change":"2024-09-15T23:12:41.747059+0000","last_active":"2024-09-15T23:12:42.743408+0000","last_peered":"2024-09-15T23:12:42.743408+0000","last_clean":"2024-09-15T23:12:42.743408+0000","last_became_active":"2024-09-15T23:12:41.746369+0000","last_became_peered":"2024-09-15T23:12:41.746369+0000","last_unstale":"2024-09-15T23:12:42.743408+0000","last_undegraded":"2024-09-15T23:12:42.743408+0000","last_fullsized":"2024-09-15T23:12:42.743408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:44.472384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739020+0000","last_change":"2024-09-15T23:12:41.745342+0000","last_active":"2024-09-15T23:12:42.739020+0000","last_peered":"2024-09-15T23:12:42.739020+0000","last_clean":"2024-09-15T23:12:42.739020+0000","last_became_active":"2024-09-15T23:12:41.743658+0000","last_became_peered":"2024-09-15T23:12:41.743658+0000","last_unstale":"2024-09-15T23:12:42.739020+0000","last_undegraded":"2024-09-15T23:12:42.739020+0000","last_fullsized":"2024-09-15T23:12:42.739020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:32.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732868+0000","last_change":"2024-09-15T23:12:41.753015+0000","last_active":"2024-09-15T23:12:42.732868+0000","last_peered":"2024-09-15T23:12:42.732868+0000","last_clean":"2024-09-15T23:12:42.732868+0000","last_became_active":"2024-09-15T23:12:41.752692+0000","last_became_peered":"2024-09-15T23:12:41.752692+0000","last_unstale":"2024-09-15T23:12:42.732868+0000","last_undegraded":"2024-09-15T23:12:42.732868+0000","last_fullsized":"2024-09-15T23:12:42.732868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:51.310427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739992+0000","last_change":"2024-09-15T23:12:41.757381+0000","last_active":"2024-09-15T23:12:42.739992+0000","last_peered":"2024-09-15T23:12:42.739992+0000","last_clean":"2024-09-15T23:12:42.739992+0000","last_became_active":"2024-09-15T23:12:41.757075+0000","last_became_peered":"2024-09-15T23:12:41.757075+0000","last_unstale":"2024-09-15T23:12:42.739992+0000","last_undegraded":"2024-09-15T23:12:42.739992+0000","last_fullsized":"2024-09-15T23:12:42.739992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:57.282022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740142+0000","last_change":"2024-09-15T23:12:41.753164+0000","last_active":"2024-09-15T23:12:42.740142+0000","last_peered":"2024-09-15T23:12:42.740142+0000","last_clean":"2024-09-15T23:12:42.740142+0000","last_became_active":"2024-09-15T23:12:41.752855+0000","last_became_peered":"2024-09-15T23:12:41.752855+0000","last_unstale":"2024-09-15T23:12:42.740142+0000","last_undegraded":"2024-09-15T23:12:42.740142+0000","last_fullsized":"2024-09-15T23:12:42.740142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:29.569535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738833+0000","last_change":"2024-09-15T23:12:41.750087+0000","last_active":"2024-09-15T23:12:42.738833+0000","last_peered":"2024-09-15T23:12:42.738833+0000","last_clean":"2024-09-15T23:12:42.738833+0000","last_became_active":"2024-09-15T23:12:41.749752+0000","last_became_peered":"2024-09-15T23:12:41.749752+0000","last_unstale":"2024-09-15T23:12:42.738833+0000","last_undegraded":"2024-09-15T23:12:42.738833+0000","last_fullsized":"2024-09-15T23:12:42.738833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:03.483448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739477+0000","last_change":"2024-09-15T23:12:41.746724+0000","last_active":"2024-09-15T23:12:42.739477+0000","last_peered":"2024-09-15T23:12:42.739477+0000","last_clean":"2024-09-15T23:12:42.739477+0000","last_became_active":"2024-09-15T23:12:41.746333+0000","last_became_peered":"2024-09-15T23:12:41.746333+0000","last_unstale":"2024-09-15T23:12:42.739477+0000","last_undegraded":"2024-09-15T23:12:42.739477+0000","last_fullsized":"2024-09-15T23:12:42.739477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:04.413591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732909+0000","last_change":"2024-09-15T23:12:41.749473+0000","last_active":"2024-09-15T23:12:42.732909+0000","last_peered":"2024-09-15T23:12:42.732909+0000","last_clean":"2024-09-15T23:12:42.732909+0000","last_became_active":"2024-09-15T23:12:41.748764+0000","last_became_peered":"2024-09-15T23:12:41.748764+0000","last_unstale":"2024-09-15T23:12:42.732909+0000","last_undegraded":"2024-09-15T23:12:42.732909+0000","last_fullsized":"2024-09-15T23:12:42.732909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:43.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741904+0000","last_change":"2024-09-15T23:12:41.755451+0000","last_active":"2024-09-15T23:12:42.741904+0000","last_peered":"2024-09-15T23:12:42.741904+0000","last_clean":"2024-09-15T23:12:42.741904+0000","last_became_active":"2024-09-15T23:12:41.755083+0000","last_became_peered":"2024-09-15T23:12:41.755083+0000","last_unstale":"2024-09-15T23:12:42.741904+0000","last_undegraded":"2024-09-15T23:12:42.741904+0000","last_fullsized":"2024-09-15T23:12:42.741904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:06.340043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732839+0000","last_change":"2024-09-15T23:12:39.485771+0000","last_active":"2024-09-15T23:12:42.732839+0000","last_peered":"2024-09-15T23:12:42.732839+0000","last_clean":"2024-09-15T23:12:42.732839+0000","last_became_active":"2024-09-15T23:12:39.485430+0000","last_became_peered":"2024-09-15T23:12:39.485430+0000","last_unstale":"2024-09-15T23:12:42.732839+0000","last_undegraded":"2024-09-15T23:12:42.732839+0000","last_fullsized":"2024-09-15T23:12:42.732839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:49:08.027243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732924+0000","last_change":"2024-09-15T23:12:41.748977+0000","last_active":"2024-09-15T23:12:42.732924+0000","last_peered":"2024-09-15T23:12:42.732924+0000","last_clean":"2024-09-15T23:12:42.732924+0000","last_became_active":"2024-09-15T23:12:41.748616+0000","last_became_peered":"2024-09-15T23:12:41.748616+0000","last_unstale":"2024-09-15T23:12:42.732924+0000","last_undegraded":"2024-09-15T23:12:42.732924+0000","last_fullsized":"2024-09-15T23:12:42.732924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:45.248469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.743799+0000","last_change":"2024-09-15T23:12:39.486497+0000","last_active":"2024-09-15T23:12:42.743799+0000","last_peered":"2024-09-15T23:12:42.743799+0000","last_clean":"2024-09-15T23:12:42.743799+0000","last_became_active":"2024-09-15T23:12:39.486173+0000","last_became_peered":"2024-09-15T23:12:39.486173+0000","last_unstale":"2024-09-15T23:12:42.743799+0000","last_undegraded":"2024-09-15T23:12:42.743799+0000","last_fullsized":"2024-09-15T23:12:42.743799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:06.125300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738267+0000","last_change":"2024-09-15T23:12:39.483270+0000","last_active":"2024-09-15T23:12:42.738267+0000","last_peered":"2024-09-15T23:12:42.738267+0000","last_clean":"2024-09-15T23:12:42.738267+0000","last_became_active":"2024-09-15T23:12:39.482913+0000","last_became_peered":"2024-09-15T23:12:39.482913+0000","last_unstale":"2024-09-15T23:12:42.738267+0000","last_undegraded":"2024-09-15T23:12:42.738267+0000","last_fullsized":"2024-09-15T23:12:42.738267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:25.333182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739570+0000","last_change":"2024-09-15T23:12:41.741778+0000","last_active":"2024-09-15T23:12:42.739570+0000","last_peered":"2024-09-15T23:12:42.739570+0000","last_clean":"2024-09-15T23:12:42.739570+0000","last_became_active":"2024-09-15T23:12:41.740768+0000","last_became_peered":"2024-09-15T23:12:41.740768+0000","last_unstale":"2024-09-15T23:12:42.739570+0000","last_undegraded":"2024-09-15T23:12:42.739570+0000","last_fullsized":"2024-09-15T23:12:42.739570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:22.086290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732552+0000","last_change":"2024-09-15T23:12:39.483029+0000","last_active":"2024-09-15T23:12:42.732552+0000","last_peered":"2024-09-15T23:12:42.732552+0000","last_clean":"2024-09-15T23:12:42.732552+0000","last_became_active":"2024-09-15T23:12:39.482080+0000","last_became_peered":"2024-09-15T23:12:39.482080+0000","last_unstale":"2024-09-15T23:12:42.732552+0000","last_undegraded":"2024-09-15T23:12:42.732552+0000","last_fullsized":"2024-09-15T23:12:42.732552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:41.076993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741024+0000","last_change":"2024-09-15T23:12:41.747332+0000","last_active":"2024-09-15T23:12:42.741024+0000","last_peered":"2024-09-15T23:12:42.741024+0000","last_clean":"2024-09-15T23:12:42.741024+0000","last_became_active":"2024-09-15T23:12:41.746818+0000","last_became_peered":"2024-09-15T23:12:41.746818+0000","last_unstale":"2024-09-15T23:12:42.741024+0000","last_undegraded":"2024-09-15T23:12:42.741024+0000","last_fullsized":"2024-09-15T23:12:42.741024+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:14.323947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732577+0000","last_change":"2024-09-15T23:12:39.486150+0000","last_active":"2024-09-15T23:12:42.732577+0000","last_peered":"2024-09-15T23:12:42.732577+0000","last_clean":"2024-09-15T23:12:42.732577+0000","last_became_active":"2024-09-15T23:12:39.485827+0000","last_became_peered":"2024-09-15T23:12:39.485827+0000","last_unstale":"2024-09-15T23:12:42.732577+0000","last_undegraded":"2024-09-15T23:12:42.732577+0000","last_fullsized":"2024-09-15T23:12:42.732577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:53.308822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739699+0000","last_change":"2024-09-15T23:12:41.747866+0000","last_active":"2024-09-15T23:12:42.739699+0000","last_peered":"2024-09-15T23:12:42.739699+0000","last_clean":"2024-09-15T23:12:42.739699+0000","last_became_active":"2024-09-15T23:12:41.746593+0000","last_became_peered":"2024-09-15T23:12:41.746593+0000","last_unstale":"2024-09-15T23:12:42.739699+0000","last_undegraded":"2024-09-15T23:12:42.739699+0000","last_fullsized":"2024-09-15T23:12:42.739699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:35.952241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741110+0000","last_change":"2024-09-15T23:12:39.486320+0000","last_active":"2024-09-15T23:12:42.741110+0000","last_peered":"2024-09-15T23:12:42.741110+0000","last_clean":"2024-09-15T23:12:42.741110+0000","last_became_active":"2024-09-15T23:12:39.486010+0000","last_became_peered":"2024-09-15T23:12:39.486010+0000","last_unstale":"2024-09-15T23:12:42.741110+0000","last_undegraded":"2024-09-15T23:12:42.741110+0000","last_fullsized":"2024-09-15T23:12:42.741110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:33.701288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741014+0000","last_change":"2024-09-15T23:12:41.759468+0000","last_active":"2024-09-15T23:12:42.741014+0000","last_peered":"2024-09-15T23:12:42.741014+0000","last_clean":"2024-09-15T23:12:42.741014+0000","last_became_active":"2024-09-15T23:12:41.758145+0000","last_became_peered":"2024-09-15T23:12:41.758145+0000","last_unstale":"2024-09-15T23:12:42.741014+0000","last_undegraded":"2024-09-15T23:12:42.741014+0000","last_fullsized":"2024-09-15T23:12:42.741014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:19.055440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740992+0000","last_change":"2024-09-15T23:12:39.693366+0000","last_active":"2024-09-15T23:12:42.740992+0000","last_peered":"2024-09-15T23:12:42.740992+0000","last_clean":"2024-09-15T23:12:42.740992+0000","last_became_active":"2024-09-15T23:12:39.692941+0000","last_became_peered":"2024-09-15T23:12:39.692941+0000","last_unstale":"2024-09-15T23:12:42.740992+0000","last_undegraded":"2024-09-15T23:12:42.740992+0000","last_fullsized":"2024-09-15T23:12:42.740992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:04.371184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739895+0000","last_change":"2024-09-15T23:12:41.750195+0000","last_active":"2024-09-15T23:12:42.739895+0000","last_peered":"2024-09-15T23:12:42.739895+0000","last_clean":"2024-09-15T23:12:42.739895+0000","last_became_active":"2024-09-15T23:12:41.749862+0000","last_became_peered":"2024-09-15T23:12:41.749862+0000","last_unstale":"2024-09-15T23:12:42.739895+0000","last_undegraded":"2024-09-15T23:12:42.739895+0000","last_fullsized":"2024-09-15T23:12:42.739895+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:59.746604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:13:02.792121+0000","last_change":"2024-09-15T23:12:39.485608+0000","last_active":"2024-09-15T23:13:02.792121+0000","last_peered":"2024-09-15T23:13:02.792121+0000","last_clean":"2024-09-15T23:13:02.792121+0000","last_became_active":"2024-09-15T23:12:39.485266+0000","last_became_peered":"2024-09-15T23:12:39.485266+0000","last_unstale":"2024-09-15T23:13:02.792121+0000","last_undegraded":"2024-09-15T23:13:02.792121+0000","last_fullsized":"2024-09-15T23:13:02.792121+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:04.696726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":68,"num_write":25,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739653+0000","last_change":"2024-09-15T23:12:41.756495+0000","last_active":"2024-09-15T23:12:42.739653+0000","last_peered":"2024-09-15T23:12:42.739653+0000","last_clean":"2024-09-15T23:12:42.739653+0000","last_became_active":"2024-09-15T23:12:41.756130+0000","last_became_peered":"2024-09-15T23:12:41.756130+0000","last_unstale":"2024-09-15T23:12:42.739653+0000","last_undegraded":"2024-09-15T23:12:42.739653+0000","last_fullsized":"2024-09-15T23:12:42.739653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:29.100300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745626+0000","last_change":"2024-09-15T23:12:39.488511+0000","last_active":"2024-09-15T23:12:42.745626+0000","last_peered":"2024-09-15T23:12:42.745626+0000","last_clean":"2024-09-15T23:12:42.745626+0000","last_became_active":"2024-09-15T23:12:39.488199+0000","last_became_peered":"2024-09-15T23:12:39.488199+0000","last_unstale":"2024-09-15T23:12:42.745626+0000","last_undegraded":"2024-09-15T23:12:42.745626+0000","last_fullsized":"2024-09-15T23:12:42.745626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:08.678809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.737980+0000","last_change":"2024-09-15T23:12:41.756216+0000","last_active":"2024-09-15T23:12:42.737980+0000","last_peered":"2024-09-15T23:12:42.737980+0000","last_clean":"2024-09-15T23:12:42.737980+0000","last_became_active":"2024-09-15T23:12:41.755857+0000","last_became_peered":"2024-09-15T23:12:41.755857+0000","last_unstale":"2024-09-15T23:12:42.737980+0000","last_undegraded":"2024-09-15T23:12:42.737980+0000","last_fullsized":"2024-09-15T23:12:42.737980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:03.639704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732400+0000","last_change":"2024-09-15T23:12:39.482504+0000","last_active":"2024-09-15T23:12:42.732400+0000","last_peered":"2024-09-15T23:12:42.732400+0000","last_clean":"2024-09-15T23:12:42.732400+0000","last_became_active":"2024-09-15T23:12:39.482083+0000","last_became_peered":"2024-09-15T23:12:39.482083+0000","last_unstale":"2024-09-15T23:12:42.732400+0000","last_undegraded":"2024-09-15T23:12:42.732400+0000","last_fullsized":"2024-09-15T23:12:42.732400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:33.273301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741167+0000","last_change":"2024-09-15T23:12:41.752607+0000","last_active":"2024-09-15T23:12:42.741167+0000","last_peered":"2024-09-15T23:12:42.741167+0000","last_clean":"2024-09-15T23:12:42.741167+0000","last_became_active":"2024-09-15T23:12:41.752217+0000","last_became_peered":"2024-09-15T23:12:41.752217+0000","last_unstale":"2024-09-15T23:12:42.741167+0000","last_undegraded":"2024-09-15T23:12:42.741167+0000","last_fullsized":"2024-09-15T23:12:42.741167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:46:01.152604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.744681+0000","last_change":"2024-09-15T23:12:39.486036+0000","last_active":"2024-09-15T23:12:42.744681+0000","last_peered":"2024-09-15T23:12:42.744681+0000","last_clean":"2024-09-15T23:12:42.744681+0000","last_became_active":"2024-09-15T23:12:39.485703+0000","last_became_peered":"2024-09-15T23:12:39.485703+0000","last_unstale":"2024-09-15T23:12:42.744681+0000","last_undegraded":"2024-09-15T23:12:42.744681+0000","last_fullsized":"2024-09-15T23:12:42.744681+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:19.172258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740504+0000","last_change":"2024-09-15T23:12:41.751872+0000","last_active":"2024-09-15T23:12:42.740504+0000","last_peered":"2024-09-15T23:12:42.740504+0000","last_clean":"2024-09-15T23:12:42.740504+0000","last_became_active":"2024-09-15T23:12:41.751172+0000","last_became_peered":"2024-09-15T23:12:41.751172+0000","last_unstale":"2024-09-15T23:12:42.740504+0000","last_undegraded":"2024-09-15T23:12:42.740504+0000","last_fullsized":"2024-09-15T23:12:42.740504+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:00.508912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.746250+0000","last_change":"2024-09-15T23:12:39.692467+0000","last_active":"2024-09-15T23:12:42.746250+0000","last_peered":"2024-09-15T23:12:42.746250+0000","last_clean":"2024-09-15T23:12:42.746250+0000","last_became_active":"2024-09-15T23:12:39.692101+0000","last_became_peered":"2024-09-15T23:12:39.692101+0000","last_unstale":"2024-09-15T23:12:42.746250+0000","last_undegraded":"2024-09-15T23:12:42.746250+0000","last_fullsized":"2024-09-15T23:12:42.746250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:23.099398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732262+0000","last_change":"2024-09-15T23:12:41.744463+0000","last_active":"2024-09-15T23:12:42.732262+0000","last_peered":"2024-09-15T23:12:42.732262+0000","last_clean":"2024-09-15T23:12:42.732262+0000","last_became_active":"2024-09-15T23:12:41.743591+0000","last_became_peered":"2024-09-15T23:12:41.743591+0000","last_unstale":"2024-09-15T23:12:42.732262+0000","last_undegraded":"2024-09-15T23:12:42.732262+0000","last_fullsized":"2024-09-15T23:12:42.732262+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:37.311609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745161+0000","last_change":"2024-09-15T23:12:39.481639+0000","last_active":"2024-09-15T23:12:42.745161+0000","last_peered":"2024-09-15T23:12:42.745161+0000","last_clean":"2024-09-15T23:12:42.745161+0000","last_became_active":"2024-09-15T23:12:39.481231+0000","last_became_peered":"2024-09-15T23:12:39.481231+0000","last_unstale":"2024-09-15T23:12:42.745161+0000","last_undegraded":"2024-09-15T23:12:42.745161+0000","last_fullsized":"2024-09-15T23:12:42.745161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:37.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732633+0000","last_change":"2024-09-15T23:12:41.751557+0000","last_active":"2024-09-15T23:12:42.732633+0000","last_peered":"2024-09-15T23:12:42.732633+0000","last_clean":"2024-09-15T23:12:42.732633+0000","last_became_active":"2024-09-15T23:12:41.751257+0000","last_became_peered":"2024-09-15T23:12:41.751257+0000","last_unstale":"2024-09-15T23:12:42.732633+0000","last_undegraded":"2024-09-15T23:12:42.732633+0000","last_fullsized":"2024-09-15T23:12:42.732633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:59:48.799875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.744483+0000","last_change":"2024-09-15T23:12:39.485812+0000","last_active":"2024-09-15T23:12:42.744483+0000","last_peered":"2024-09-15T23:12:42.744483+0000","last_clean":"2024-09-15T23:12:42.744483+0000","last_became_active":"2024-09-15T23:12:39.485447+0000","last_became_peered":"2024-09-15T23:12:39.485447+0000","last_unstale":"2024-09-15T23:12:42.744483+0000","last_undegraded":"2024-09-15T23:12:42.744483+0000","last_fullsized":"2024-09-15T23:12:42.744483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:05.483798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741676+0000","last_change":"2024-09-15T23:12:41.753166+0000","last_active":"2024-09-15T23:12:42.741676+0000","last_peered":"2024-09-15T23:12:42.741676+0000","last_clean":"2024-09-15T23:12:42.741676+0000","last_became_active":"2024-09-15T23:12:41.752841+0000","last_became_peered":"2024-09-15T23:12:41.752841+0000","last_unstale":"2024-09-15T23:12:42.741676+0000","last_undegraded":"2024-09-15T23:12:42.741676+0000","last_fullsized":"2024-09-15T23:12:42.741676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:38.439192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.743699+0000","last_change":"2024-09-15T23:12:39.484696+0000","last_active":"2024-09-15T23:12:42.743699+0000","last_peered":"2024-09-15T23:12:42.743699+0000","last_clean":"2024-09-15T23:12:42.743699+0000","last_became_active":"2024-09-15T23:12:39.484230+0000","last_became_peered":"2024-09-15T23:12:39.484230+0000","last_unstale":"2024-09-15T23:12:42.743699+0000","last_undegraded":"2024-09-15T23:12:42.743699+0000","last_fullsized":"2024-09-15T23:12:42.743699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:12.456661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741503+0000","last_change":"2024-09-15T23:12:41.750605+0000","last_active":"2024-09-15T23:12:42.741503+0000","last_peered":"2024-09-15T23:12:42.741503+0000","last_clean":"2024-09-15T23:12:42.741503+0000","last_became_active":"2024-09-15T23:12:41.750236+0000","last_became_peered":"2024-09-15T23:12:41.750236+0000","last_unstale":"2024-09-15T23:12:42.741503+0000","last_undegraded":"2024-09-15T23:12:42.741503+0000","last_fullsized":"2024-09-15T23:12:42.741503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:24.918315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738855+0000","last_change":"2024-09-15T23:12:40.282059+0000","last_active":"2024-09-15T23:12:42.738855+0000","last_peered":"2024-09-15T23:12:42.738855+0000","last_clean":"2024-09-15T23:12:42.738855+0000","last_became_active":"2024-09-15T23:12:40.281653+0000","last_became_peered":"2024-09-15T23:12:40.281653+0000","last_unstale":"2024-09-15T23:12:42.738855+0000","last_undegraded":"2024-09-15T23:12:42.738855+0000","last_fullsized":"2024-09-15T23:12:42.738855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:36.408119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741482+0000","last_change":"2024-09-15T23:12:41.751629+0000","last_active":"2024-09-15T23:12:42.741482+0000","last_peered":"2024-09-15T23:12:42.741482+0000","last_clean":"2024-09-15T23:12:42.741482+0000","last_became_active":"2024-09-15T23:12:41.751279+0000","last_became_peered":"2024-09-15T23:12:41.751279+0000","last_unstale":"2024-09-15T23:12:42.741482+0000","last_undegraded":"2024-09-15T23:12:42.741482+0000","last_fullsized":"2024-09-15T23:12:42.741482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:34.240811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":343,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740703+0000","last_change":"2024-09-15T23:11:26.734634+0000","last_active":"2024-09-15T23:12:42.740703+0000","last_peered":"2024-09-15T23:12:42.740703+0000","last_clean":"2024-09-15T23:12:42.740703+0000","last_became_active":"2024-09-15T23:11:26.734217+0000","last_became_peered":"2024-09-15T23:11:26.734217+0000","last_unstale":"2024-09-15T23:12:42.740703+0000","last_undegraded":"2024-09-15T23:12:42.740703+0000","last_fullsized":"2024-09-15T23:12:42.740703+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:07:58.008474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:07:58.008474+0000","last_clean_scrub_stamp":"2024-09-15T23:07:58.008474+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:59.634217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.744886+0000","last_change":"2024-09-15T23:12:39.485101+0000","last_active":"2024-09-15T23:12:42.744886+0000","last_peered":"2024-09-15T23:12:42.744886+0000","last_clean":"2024-09-15T23:12:42.744886+0000","last_became_active":"2024-09-15T23:12:39.484651+0000","last_became_peered":"2024-09-15T23:12:39.484651+0000","last_unstale":"2024-09-15T23:12:42.744886+0000","last_undegraded":"2024-09-15T23:12:42.744886+0000","last_fullsized":"2024-09-15T23:12:42.744886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:46.709430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739809+0000","last_change":"2024-09-15T23:12:41.742460+0000","last_active":"2024-09-15T23:12:42.739809+0000","last_peered":"2024-09-15T23:12:42.739809+0000","last_clean":"2024-09-15T23:12:42.739809+0000","last_became_active":"2024-09-15T23:12:41.742157+0000","last_became_peered":"2024-09-15T23:12:41.742157+0000","last_unstale":"2024-09-15T23:12:42.739809+0000","last_undegraded":"2024-09-15T23:12:42.739809+0000","last_fullsized":"2024-09-15T23:12:42.739809+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:36.602078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740755+0000","last_change":"2024-09-15T23:12:39.481814+0000","last_active":"2024-09-15T23:12:42.740755+0000","last_peered":"2024-09-15T23:12:42.740755+0000","last_clean":"2024-09-15T23:12:42.740755+0000","last_became_active":"2024-09-15T23:12:39.481419+0000","last_became_peered":"2024-09-15T23:12:39.481419+0000","last_unstale":"2024-09-15T23:12:42.740755+0000","last_undegraded":"2024-09-15T23:12:42.740755+0000","last_fullsized":"2024-09-15T23:12:42.740755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:42.217786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.737908+0000","last_change":"2024-09-15T23:12:41.752430+0000","last_active":"2024-09-15T23:12:42.737908+0000","last_peered":"2024-09-15T23:12:42.737908+0000","last_clean":"2024-09-15T23:12:42.737908+0000","last_became_active":"2024-09-15T23:12:41.752102+0000","last_became_peered":"2024-09-15T23:12:41.752102+0000","last_unstale":"2024-09-15T23:12:42.737908+0000","last_undegraded":"2024-09-15T23:12:42.737908+0000","last_fullsized":"2024-09-15T23:12:42.737908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:50.177644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738122+0000","last_change":"2024-09-15T23:12:39.692189+0000","last_active":"2024-09-15T23:12:42.738122+0000","last_peered":"2024-09-15T23:12:42.738122+0000","last_clean":"2024-09-15T23:12:42.738122+0000","last_became_active":"2024-09-15T23:12:39.691839+0000","last_became_peered":"2024-09-15T23:12:39.691839+0000","last_unstale":"2024-09-15T23:12:42.738122+0000","last_undegraded":"2024-09-15T23:12:42.738122+0000","last_fullsized":"2024-09-15T23:12:42.738122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:31.286533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732423+0000","last_change":"2024-09-15T23:12:41.745096+0000","last_active":"2024-09-15T23:12:42.732423+0000","last_peered":"2024-09-15T23:12:42.732423+0000","last_clean":"2024-09-15T23:12:42.732423+0000","last_became_active":"2024-09-15T23:12:41.744647+0000","last_became_peered":"2024-09-15T23:12:41.744647+0000","last_unstale":"2024-09-15T23:12:42.732423+0000","last_undegraded":"2024-09-15T23:12:42.732423+0000","last_fullsized":"2024-09-15T23:12:42.732423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:06.681024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741031+0000","last_change":"2024-09-15T23:12:39.482633+0000","last_active":"2024-09-15T23:12:42.741031+0000","last_peered":"2024-09-15T23:12:42.741031+0000","last_clean":"2024-09-15T23:12:42.741031+0000","last_became_active":"2024-09-15T23:12:39.481842+0000","last_became_peered":"2024-09-15T23:12:39.481842+0000","last_unstale":"2024-09-15T23:12:42.741031+0000","last_undegraded":"2024-09-15T23:12:42.741031+0000","last_fullsized":"2024-09-15T23:12:42.741031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:16.995713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732633+0000","last_change":"2024-09-15T23:12:41.750155+0000","last_active":"2024-09-15T23:12:42.732633+0000","last_peered":"2024-09-15T23:12:42.732633+0000","last_clean":"2024-09-15T23:12:42.732633+0000","last_became_active":"2024-09-15T23:12:41.749851+0000","last_became_peered":"2024-09-15T23:12:41.749851+0000","last_unstale":"2024-09-15T23:12:42.732633+0000","last_undegraded":"2024-09-15T23:12:42.732633+0000","last_fullsized":"2024-09-15T23:12:42.732633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:48.019129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741629+0000","last_change":"2024-09-15T23:12:39.692721+0000","last_active":"2024-09-15T23:12:42.741629+0000","last_peered":"2024-09-15T23:12:42.741629+0000","last_clean":"2024-09-15T23:12:42.741629+0000","last_became_active":"2024-09-15T23:12:39.692345+0000","last_became_peered":"2024-09-15T23:12:39.692345+0000","last_unstale":"2024-09-15T23:12:42.741629+0000","last_undegraded":"2024-09-15T23:12:42.741629+0000","last_fullsized":"2024-09-15T23:12:42.741629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:36.527037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:43.241720+0000","last_change":"2024-09-15T23:12:41.739854+0000","last_active":"2024-09-15T23:12:43.241720+0000","last_peered":"2024-09-15T23:12:43.241720+0000","last_clean":"2024-09-15T23:12:43.241720+0000","last_became_active":"2024-09-15T23:12:41.739514+0000","last_became_peered":"2024-09-15T23:12:41.739514+0000","last_unstale":"2024-09-15T23:12:43.241720+0000","last_undegraded":"2024-09-15T23:12:43.241720+0000","last_fullsized":"2024-09-15T23:12:43.241720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:08.001384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739992+0000","last_change":"2024-09-15T23:12:39.693238+0000","last_active":"2024-09-15T23:12:42.739992+0000","last_peered":"2024-09-15T23:12:42.739992+0000","last_clean":"2024-09-15T23:12:42.739992+0000","last_became_active":"2024-09-15T23:12:39.692838+0000","last_became_peered":"2024-09-15T23:12:39.692838+0000","last_unstale":"2024-09-15T23:12:42.739992+0000","last_undegraded":"2024-09-15T23:12:42.739992+0000","last_fullsized":"2024-09-15T23:12:42.739992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:48.385920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740144+0000","last_change":"2024-09-15T23:12:41.750113+0000","last_active":"2024-09-15T23:12:42.740144+0000","last_peered":"2024-09-15T23:12:42.740144+0000","last_clean":"2024-09-15T23:12:42.740144+0000","last_became_active":"2024-09-15T23:12:41.749799+0000","last_became_peered":"2024-09-15T23:12:41.749799+0000","last_unstale":"2024-09-15T23:12:42.740144+0000","last_undegraded":"2024-09-15T23:12:42.740144+0000","last_fullsized":"2024-09-15T23:12:42.740144+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:52:48.095393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:13:01.739514+0000","last_change":"2024-09-15T23:12:39.480093+0000","last_active":"2024-09-15T23:13:01.739514+0000","last_peered":"2024-09-15T23:13:01.739514+0000","last_clean":"2024-09-15T23:13:01.739514+0000","last_became_active":"2024-09-15T23:12:39.479702+0000","last_became_peered":"2024-09-15T23:12:39.479702+0000","last_unstale":"2024-09-15T23:13:01.739514+0000","last_undegraded":"2024-09-15T23:13:01.739514+0000","last_fullsized":"2024-09-15T23:13:01.739514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:34.617090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.743556+0000","last_change":"2024-09-15T23:12:41.746786+0000","last_active":"2024-09-15T23:12:42.743556+0000","last_peered":"2024-09-15T23:12:42.743556+0000","last_clean":"2024-09-15T23:12:42.743556+0000","last_became_active":"2024-09-15T23:12:41.745877+0000","last_became_peered":"2024-09-15T23:12:41.745877+0000","last_unstale":"2024-09-15T23:12:42.743556+0000","last_undegraded":"2024-09-15T23:12:42.743556+0000","last_fullsized":"2024-09-15T23:12:42.743556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:33.458142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.746831+0000","last_change":"2024-09-15T23:12:40.282279+0000","last_active":"2024-09-15T23:12:42.746831+0000","last_peered":"2024-09-15T23:12:42.746831+0000","last_clean":"2024-09-15T23:12:42.746831+0000","last_became_active":"2024-09-15T23:12:40.281854+0000","last_became_peered":"2024-09-15T23:12:40.281854+0000","last_unstale":"2024-09-15T23:12:42.746831+0000","last_undegraded":"2024-09-15T23:12:42.746831+0000","last_fullsized":"2024-09-15T23:12:42.746831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:09.344989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740553+0000","last_change":"2024-09-15T23:12:41.759333+0000","last_active":"2024-09-15T23:12:42.740553+0000","last_peered":"2024-09-15T23:12:42.740553+0000","last_clean":"2024-09-15T23:12:42.740553+0000","last_became_active":"2024-09-15T23:12:41.757329+0000","last_became_peered":"2024-09-15T23:12:41.757329+0000","last_unstale":"2024-09-15T23:12:42.740553+0000","last_undegraded":"2024-09-15T23:12:42.740553+0000","last_fullsized":"2024-09-15T23:12:42.740553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:03.804263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739031+0000","last_change":"2024-09-15T23:12:39.692428+0000","last_active":"2024-09-15T23:12:42.739031+0000","last_peered":"2024-09-15T23:12:42.739031+0000","last_clean":"2024-09-15T23:12:42.739031+0000","last_became_active":"2024-09-15T23:12:39.692073+0000","last_became_peered":"2024-09-15T23:12:39.692073+0000","last_unstale":"2024-09-15T23:12:42.739031+0000","last_undegraded":"2024-09-15T23:12:42.739031+0000","last_fullsized":"2024-09-15T23:12:42.739031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:39.971583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739289+0000","last_change":"2024-09-15T23:12:41.752157+0000","last_active":"2024-09-15T23:12:42.739289+0000","last_peered":"2024-09-15T23:12:42.739289+0000","last_clean":"2024-09-15T23:12:42.739289+0000","last_became_active":"2024-09-15T23:12:41.751628+0000","last_became_peered":"2024-09-15T23:12:41.751628+0000","last_unstale":"2024-09-15T23:12:42.739289+0000","last_undegraded":"2024-09-15T23:12:42.739289+0000","last_fullsized":"2024-09-15T23:12:42.739289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:39.865611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740544+0000","last_change":"2024-09-15T23:12:39.484920+0000","last_active":"2024-09-15T23:12:42.740544+0000","last_peered":"2024-09-15T23:12:42.740544+0000","last_clean":"2024-09-15T23:12:42.740544+0000","last_became_active":"2024-09-15T23:12:39.484563+0000","last_became_peered":"2024-09-15T23:12:39.484563+0000","last_unstale":"2024-09-15T23:12:42.740544+0000","last_undegraded":"2024-09-15T23:12:42.740544+0000","last_fullsized":"2024-09-15T23:12:42.740544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:50.429881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.733033+0000","last_change":"2024-09-15T23:12:41.749718+0000","last_active":"2024-09-15T23:12:42.733033+0000","last_peered":"2024-09-15T23:12:42.733033+0000","last_clean":"2024-09-15T23:12:42.733033+0000","last_became_active":"2024-09-15T23:12:41.749187+0000","last_became_peered":"2024-09-15T23:12:41.749187+0000","last_unstale":"2024-09-15T23:12:42.733033+0000","last_undegraded":"2024-09-15T23:12:42.733033+0000","last_fullsized":"2024-09-15T23:12:42.733033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:30.700175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738368+0000","last_change":"2024-09-15T23:12:39.482472+0000","last_active":"2024-09-15T23:12:42.738368+0000","last_peered":"2024-09-15T23:12:42.738368+0000","last_clean":"2024-09-15T23:12:42.738368+0000","last_became_active":"2024-09-15T23:12:39.481105+0000","last_became_peered":"2024-09-15T23:12:39.481105+0000","last_unstale":"2024-09-15T23:12:42.738368+0000","last_undegraded":"2024-09-15T23:12:42.738368+0000","last_fullsized":"2024-09-15T23:12:42.738368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:34.106771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740801+0000","last_change":"2024-09-15T23:12:41.749399+0000","last_active":"2024-09-15T23:12:42.740801+0000","last_peered":"2024-09-15T23:12:42.740801+0000","last_clean":"2024-09-15T23:12:42.740801+0000","last_became_active":"2024-09-15T23:12:41.748616+0000","last_became_peered":"2024-09-15T23:12:41.748616+0000","last_unstale":"2024-09-15T23:12:42.740801+0000","last_undegraded":"2024-09-15T23:12:42.740801+0000","last_fullsized":"2024-09-15T23:12:42.740801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:28.729933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745413+0000","last_change":"2024-09-15T23:12:39.485773+0000","last_active":"2024-09-15T23:12:42.745413+0000","last_peered":"2024-09-15T23:12:42.745413+0000","last_clean":"2024-09-15T23:12:42.745413+0000","last_became_active":"2024-09-15T23:12:39.485403+0000","last_became_peered":"2024-09-15T23:12:39.485403+0000","last_unstale":"2024-09-15T23:12:42.745413+0000","last_undegraded":"2024-09-15T23:12:42.745413+0000","last_fullsized":"2024-09-15T23:12:42.745413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:56.405296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740903+0000","last_change":"2024-09-15T23:12:41.752877+0000","last_active":"2024-09-15T23:12:42.740903+0000","last_peered":"2024-09-15T23:12:42.740903+0000","last_clean":"2024-09-15T23:12:42.740903+0000","last_became_active":"2024-09-15T23:12:41.748011+0000","last_became_peered":"2024-09-15T23:12:41.748011+0000","last_unstale":"2024-09-15T23:12:42.740903+0000","last_undegraded":"2024-09-15T23:12:42.740903+0000","last_fullsized":"2024-09-15T23:12:42.740903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:58.741067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.733051+0000","last_change":"2024-09-15T23:12:41.743781+0000","last_active":"2024-09-15T23:12:42.733051+0000","last_peered":"2024-09-15T23:12:42.733051+0000","last_clean":"2024-09-15T23:12:42.733051+0000","last_became_active":"2024-09-15T23:12:41.743420+0000","last_became_peered":"2024-09-15T23:12:41.743420+0000","last_unstale":"2024-09-15T23:12:42.733051+0000","last_undegraded":"2024-09-15T23:12:42.733051+0000","last_fullsized":"2024-09-15T23:12:42.733051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:51.728955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.743704+0000","last_change":"2024-09-15T23:12:39.478145+0000","last_active":"2024-09-15T23:12:42.743704+0000","last_peered":"2024-09-15T23:12:42.743704+0000","last_clean":"2024-09-15T23:12:42.743704+0000","last_became_active":"2024-09-15T23:12:39.477774+0000","last_became_peered":"2024-09-15T23:12:39.477774+0000","last_unstale":"2024-09-15T23:12:42.743704+0000","last_undegraded":"2024-09-15T23:12:42.743704+0000","last_fullsized":"2024-09-15T23:12:42.743704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:19.057212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739744+0000","last_change":"2024-09-15T23:12:41.747398+0000","last_active":"2024-09-15T23:12:42.739744+0000","last_peered":"2024-09-15T23:12:42.739744+0000","last_clean":"2024-09-15T23:12:42.739744+0000","last_became_active":"2024-09-15T23:12:41.747049+0000","last_became_peered":"2024-09-15T23:12:41.747049+0000","last_unstale":"2024-09-15T23:12:42.739744+0000","last_undegraded":"2024-09-15T23:12:42.739744+0000","last_fullsized":"2024-09-15T23:12:42.739744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:00.979843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745155+0000","last_change":"2024-09-15T23:12:39.483666+0000","last_active":"2024-09-15T23:12:42.745155+0000","last_peered":"2024-09-15T23:12:42.745155+0000","last_clean":"2024-09-15T23:12:42.745155+0000","last_became_active":"2024-09-15T23:12:39.483309+0000","last_became_peered":"2024-09-15T23:12:39.483309+0000","last_unstale":"2024-09-15T23:12:42.745155+0000","last_undegraded":"2024-09-15T23:12:42.745155+0000","last_fullsized":"2024-09-15T23:12:42.745155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:25.785868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740838+0000","last_change":"2024-09-15T23:12:41.758766+0000","last_active":"2024-09-15T23:12:42.740838+0000","last_peered":"2024-09-15T23:12:42.740838+0000","last_clean":"2024-09-15T23:12:42.740838+0000","last_became_active":"2024-09-15T23:12:41.758457+0000","last_became_peered":"2024-09-15T23:12:41.758457+0000","last_unstale":"2024-09-15T23:12:42.740838+0000","last_undegraded":"2024-09-15T23:12:42.740838+0000","last_fullsized":"2024-09-15T23:12:42.740838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:45.319708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745491+0000","last_change":"2024-09-15T23:12:39.692412+0000","last_active":"2024-09-15T23:12:42.745491+0000","last_peered":"2024-09-15T23:12:42.745491+0000","last_clean":"2024-09-15T23:12:42.745491+0000","last_became_active":"2024-09-15T23:12:39.691953+0000","last_became_peered":"2024-09-15T23:12:39.691953+0000","last_unstale":"2024-09-15T23:12:42.745491+0000","last_undegraded":"2024-09-15T23:12:42.745491+0000","last_fullsized":"2024-09-15T23:12:42.745491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:07.811976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.743113+0000","last_change":"2024-09-15T23:12:41.753181+0000","last_active":"2024-09-15T23:12:42.743113+0000","last_peered":"2024-09-15T23:12:42.743113+0000","last_clean":"2024-09-15T23:12:42.743113+0000","last_became_active":"2024-09-15T23:12:41.752432+0000","last_became_peered":"2024-09-15T23:12:41.752432+0000","last_unstale":"2024-09-15T23:12:42.743113+0000","last_undegraded":"2024-09-15T23:12:42.743113+0000","last_fullsized":"2024-09-15T23:12:42.743113+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:37.363331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745102+0000","last_change":"2024-09-15T23:12:39.482238+0000","last_active":"2024-09-15T23:12:42.745102+0000","last_peered":"2024-09-15T23:12:42.745102+0000","last_clean":"2024-09-15T23:12:42.745102+0000","last_became_active":"2024-09-15T23:12:39.481524+0000","last_became_peered":"2024-09-15T23:12:39.481524+0000","last_unstale":"2024-09-15T23:12:42.745102+0000","last_undegraded":"2024-09-15T23:12:42.745102+0000","last_fullsized":"2024-09-15T23:12:42.745102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:36.839260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53965,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":41,"num_read_kb":74,"num_write":78,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":161895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285160,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":872448,"data_stored":422542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":1066388,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939676,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":423124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201312,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":423146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":1013609,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":422659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":1013209,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986230,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":876544,"data_stored":422564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215163,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":422880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444096,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":475743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":475709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":876544,"data_stored":422632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34625,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34625,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34625,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":53167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":53201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:13:08.228 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T23:13:08.228 INFO:tasks.cephadm:Setting up client nodes... 2024-09-15T23:13:08.229 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-15T23:13:08.488 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:08.888 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:08 smithi002 ceph-mon[31019]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:13:08.888 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:08 smithi002 ceph-mon[31019]: pgmap v294: 97 pgs: 97 active+clean; 629 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.2 KiB/s wr, 4 op/s 2024-09-15T23:13:08.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.977+0000 7f35e4389640 1 -- 172.21.15.2:0/635227346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc100dd0 msgr2=0x7f35dc101230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:08.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.977+0000 7f35e4389640 1 --2- 172.21.15.2:0/635227346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc100dd0 0x7f35dc101230 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009900 tx=0x7f35cc02a410 comp rx=0 tx=0).stop 2024-09-15T23:13:08.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 -- 172.21.15.2:0/635227346 shutdown_connections 2024-09-15T23:13:08.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 --2- 172.21.15.2:0/635227346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35dc101770 0x7f35dc101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:08.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 --2- 172.21.15.2:0/635227346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc100dd0 0x7f35dc101230 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:08.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 --2- 172.21.15.2:0/635227346 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35dc100490 0x7f35dc100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:08.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 -- 172.21.15.2:0/635227346 >> 172.21.15.2:0/635227346 conn(0x7f35dc0fc2a0 msgr2=0x7f35dc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:08.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 -- 172.21.15.2:0/635227346 shutdown_connections 2024-09-15T23:13:08.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 -- 172.21.15.2:0/635227346 wait complete. 2024-09-15T23:13:08.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 Processor -- start 2024-09-15T23:13:08.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 -- start start 2024-09-15T23:13:08.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35dc100490 0x7f35dc19a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:08.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc100dd0 0x7f35dc19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:08.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35dc101770 0x7f35dc1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:08.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc10f930 con 0x7f35dc100dd0 2024-09-15T23:13:08.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc10f7b0 con 0x7f35dc100490 2024-09-15T23:13:08.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.978+0000 7f35e4389640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc10fab0 con 0x7f35dc101770 2024-09-15T23:13:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35e1924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc100dd0 0x7f35dc19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35e1924640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc100dd0 0x7f35dc19a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56742/0 (socket says 172.21.15.2:56742) 2024-09-15T23:13:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35e1924640 1 -- 172.21.15.2:0/1949472601 learned_addr learned my addr 172.21.15.2:0/1949472601 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35e2125640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35dc100490 0x7f35dc19a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35e2926640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35dc101770 0x7f35dc1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35e1924640 1 -- 172.21.15.2:0/1949472601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35dc101770 msgr2=0x7f35dc1a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35e1924640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35dc101770 0x7f35dc1a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35e1924640 1 -- 172.21.15.2:0/1949472601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35dc100490 msgr2=0x7f35dc19a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35e1924640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35dc100490 0x7f35dc19a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35e1924640 1 -- 172.21.15.2:0/1949472601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc1a1ca0 con 0x7f35dc100dd0 2024-09-15T23:13:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35e1924640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc100dd0 0x7f35dc19a5b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35cc004770 tx=0x7f35cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35d37fe640 1 -- 172.21.15.2:0/1949472601 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc03f030 con 0x7f35dc100dd0 2024-09-15T23:13:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35e4389640 1 -- 172.21.15.2:0/1949472601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35dc1a1f30 con 0x7f35dc100dd0 2024-09-15T23:13:08.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35d37fe640 1 -- 172.21.15.2:0/1949472601 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35cc003cb0 con 0x7f35dc100dd0 2024-09-15T23:13:08.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35d37fe640 1 -- 172.21.15.2:0/1949472601 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc035070 con 0x7f35dc100dd0 2024-09-15T23:13:08.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.979+0000 7f35e4389640 1 -- 172.21.15.2:0/1949472601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35dc1a2380 con 0x7f35dc100dd0 2024-09-15T23:13:08.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.980+0000 7f35e4389640 1 -- 172.21.15.2:0/1949472601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35dc10b420 con 0x7f35dc100dd0 2024-09-15T23:13:08.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.982+0000 7f35d37fe640 1 -- 172.21.15.2:0/1949472601 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f35cc042030 con 0x7f35dc100dd0 2024-09-15T23:13:08.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.982+0000 7f35d37fe640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f35c80a3300 0x7f35c80a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:08.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.983+0000 7f35e2125640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f35c80a3300 0x7f35c80a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:08.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.983+0000 7f35d37fe640 1 -- 172.21.15.2:0/1949472601 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f35cc0efde0 con 0x7f35dc100dd0 2024-09-15T23:13:08.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.983+0000 7f35e2125640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f35c80a3300 0x7f35c80a57c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35d8005fd0 tx=0x7f35d800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:08.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:08.986+0000 7f35d37fe640 1 -- 172.21.15.2:0/1949472601 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35cc0bc500 con 0x7f35dc100dd0 2024-09-15T23:13:09.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:08 smithi145 ceph-mon[34901]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:13:09.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:08 smithi145 ceph-mon[34901]: pgmap v294: 97 pgs: 97 active+clean; 629 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.2 KiB/s wr, 4 op/s 2024-09-15T23:13:09.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.228+0000 7f35e4389640 1 -- 172.21.15.2:0/1949472601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f35dc02d7c0 con 0x7f35dc100dd0 2024-09-15T23:13:09.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.230+0000 7f35d37fe640 1 -- 172.21.15.2:0/1949472601 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f35cc0c0800 con 0x7f35dc100dd0 2024-09-15T23:13:09.231 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-15T23:13:09.232 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAFaudm0TGuDRAArSg24/3xHvpUwumovosWUQ== 2024-09-15T23:13:09.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.232+0000 7f35e4389640 1 -- 172.21.15.2:0/1949472601 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f35c80a3300 msgr2=0x7f35c80a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:09.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.232+0000 7f35e4389640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f35c80a3300 0x7f35c80a57c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35d8005fd0 tx=0x7f35d800b390 comp rx=0 tx=0).stop 2024-09-15T23:13:09.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.232+0000 7f35e4389640 1 -- 172.21.15.2:0/1949472601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc100dd0 msgr2=0x7f35dc19a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:09.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.232+0000 7f35e4389640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc100dd0 0x7f35dc19a5b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35cc004770 tx=0x7f35cc0042f0 comp rx=0 tx=0).stop 2024-09-15T23:13:09.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.233+0000 7f35e4389640 1 -- 172.21.15.2:0/1949472601 shutdown_connections 2024-09-15T23:13:09.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.233+0000 7f35e4389640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f35c80a3300 0x7f35c80a57c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:09.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.233+0000 7f35e4389640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f35dc101770 0x7f35dc1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:09.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.233+0000 7f35e4389640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc100dd0 0x7f35dc19a5b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:09.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.233+0000 7f35e4389640 1 --2- 172.21.15.2:0/1949472601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35dc100490 0x7f35dc19a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:09.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.233+0000 7f35e4389640 1 -- 172.21.15.2:0/1949472601 >> 172.21.15.2:0/1949472601 conn(0x7f35dc0fc2a0 msgr2=0x7f35dc0fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:09.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.233+0000 7f35e4389640 1 -- 172.21.15.2:0/1949472601 shutdown_connections 2024-09-15T23:13:09.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:09.233+0000 7f35e4389640 1 -- 172.21.15.2:0/1949472601 wait complete. 2024-09-15T23:13:09.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:08 smithi112 ceph-mon[34367]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:13:09.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:08 smithi112 ceph-mon[34367]: pgmap v294: 97 pgs: 97 active+clean; 629 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 5.2 KiB/s wr, 4 op/s 2024-09-15T23:13:10.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:09 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1949472601' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T23:13:10.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:09 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1949472601' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T23:13:10.064 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:13:10.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-15T23:13:10.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T23:13:10.103 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T23:13:10.104 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-15T23:13:10.104 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-15T23:13:10.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:09 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1949472601' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T23:13:10.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:09 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1949472601' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T23:13:10.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:09 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1949472601' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T23:13:10.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:09 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1949472601' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T23:13:10.400 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.940+0000 7fe7f1d67640 1 -- 172.21.15.2:0/4217659933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7ec106a80 msgr2=0x7fe7ec106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.940+0000 7fe7f1d67640 1 --2- 172.21.15.2:0/4217659933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7ec106a80 0x7fe7ec106e60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009930 tx=0x7fe7dc02a420 comp rx=0 tx=0).stop 2024-09-15T23:13:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.940+0000 7fe7f1d67640 1 -- 172.21.15.2:0/4217659933 shutdown_connections 2024-09-15T23:13:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.940+0000 7fe7f1d67640 1 --2- 172.21.15.2:0/4217659933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7ec101420 0x7fe7ec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.940+0000 7fe7f1d67640 1 --2- 172.21.15.2:0/4217659933 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7ec100a80 0x7fe7ec100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.940+0000 7fe7f1d67640 1 --2- 172.21.15.2:0/4217659933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7ec106a80 0x7fe7ec106e60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.940+0000 7fe7f1d67640 1 -- 172.21.15.2:0/4217659933 >> 172.21.15.2:0/4217659933 conn(0x7fe7ec0fc7a0 msgr2=0x7fe7ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.940+0000 7fe7f1d67640 1 -- 172.21.15.2:0/4217659933 shutdown_connections 2024-09-15T23:13:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.940+0000 7fe7f1d67640 1 -- 172.21.15.2:0/4217659933 wait complete. 2024-09-15T23:13:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.941+0000 7fe7f1d67640 1 Processor -- start 2024-09-15T23:13:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.941+0000 7fe7f1d67640 1 -- start start 2024-09-15T23:13:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.941+0000 7fe7f1d67640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7ec100a80 0x7fe7ec1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.941+0000 7fe7f1d67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7ec101420 0x7fe7ec1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.941+0000 7fe7f1d67640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7ec106a80 0x7fe7ec1a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.941+0000 7fe7f1d67640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec110d50 con 0x7fe7ec101420 2024-09-15T23:13:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.941+0000 7fe7f1d67640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec110bd0 con 0x7fe7ec106a80 2024-09-15T23:13:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.941+0000 7fe7f1d67640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec110ed0 con 0x7fe7ec100a80 2024-09-15T23:13:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7eaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7ec101420 0x7fe7ec1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7eaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7ec101420 0x7fe7ec1996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56760/0 (socket says 172.21.15.2:56760) 2024-09-15T23:13:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7eaffd640 1 -- 172.21.15.2:0/1108710141 learned_addr learned my addr 172.21.15.2:0/1108710141 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7eb7fe640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7ec100a80 0x7fe7ec1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7ebfff640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7ec106a80 0x7fe7ec1a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7eaffd640 1 -- 172.21.15.2:0/1108710141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7ec100a80 msgr2=0x7fe7ec1991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7eaffd640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7ec100a80 0x7fe7ec1991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7eaffd640 1 -- 172.21.15.2:0/1108710141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7ec106a80 msgr2=0x7fe7ec1a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7eaffd640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7ec106a80 0x7fe7ec1a4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7eaffd640 1 -- 172.21.15.2:0/1108710141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec1a4760 con 0x7fe7ec101420 2024-09-15T23:13:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7ebfff640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7ec106a80 0x7fe7ec1a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7eaffd640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7ec101420 0x7fe7ec1996e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000c920 tx=0x7fe7e000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7e8ff9640 1 -- 172.21.15.2:0/1108710141 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0007c70 con 0x7fe7ec101420 2024-09-15T23:13:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7f1d67640 1 -- 172.21.15.2:0/1108710141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ec1a4930 con 0x7fe7ec101420 2024-09-15T23:13:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7e8ff9640 1 -- 172.21.15.2:0/1108710141 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe7e0007e10 con 0x7fe7ec101420 2024-09-15T23:13:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7e8ff9640 1 -- 172.21.15.2:0/1108710141 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0018820 con 0x7fe7ec101420 2024-09-15T23:13:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.942+0000 7fe7f1d67640 1 -- 172.21.15.2:0/1108710141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ec1a4e40 con 0x7fe7ec101420 2024-09-15T23:13:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.943+0000 7fe7f1d67640 1 -- 172.21.15.2:0/1108710141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ec100ee0 con 0x7fe7ec101420 2024-09-15T23:13:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.945+0000 7fe7e8ff9640 1 -- 172.21.15.2:0/1108710141 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe7e00189c0 con 0x7fe7ec101420 2024-09-15T23:13:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.945+0000 7fe7e8ff9640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe7d40a32d0 0x7fe7d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.945+0000 7fe7eb7fe640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe7d40a32d0 0x7fe7d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.945+0000 7fe7e8ff9640 1 -- 172.21.15.2:0/1108710141 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fe7e00cfe10 con 0x7fe7ec101420 2024-09-15T23:13:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.946+0000 7fe7eb7fe640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe7d40a32d0 0x7fe7d40a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc006010 tx=0x7fe7dc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:11.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:10.948+0000 7fe7e8ff9640 1 -- 172.21.15.2:0/1108710141 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe7e0014030 con 0x7fe7ec101420 2024-09-15T23:13:11.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.172+0000 7fe7f1d67640 1 -- 172.21.15.2:0/1108710141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe7ec06ad80 con 0x7fe7ec101420 2024-09-15T23:13:11.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.177+0000 7fe7e8ff9640 1 -- 172.21.15.2:0/1108710141 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264041 (secure 0 0 0) 0x7fe7e009cb10 con 0x7fe7ec101420 2024-09-15T23:13:11.181 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.180+0000 7fe7f1d67640 1 -- 172.21.15.2:0/1108710141 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe7d40a32d0 msgr2=0x7fe7d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.180+0000 7fe7f1d67640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe7d40a32d0 0x7fe7d40a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc006010 tx=0x7fe7dc000bc0 comp rx=0 tx=0).stop 2024-09-15T23:13:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.180+0000 7fe7f1d67640 1 -- 172.21.15.2:0/1108710141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7ec101420 msgr2=0x7fe7ec1996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.180+0000 7fe7f1d67640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7ec101420 0x7fe7ec1996e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000c920 tx=0x7fe7e000cde0 comp rx=0 tx=0).stop 2024-09-15T23:13:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.180+0000 7fe7f1d67640 1 -- 172.21.15.2:0/1108710141 shutdown_connections 2024-09-15T23:13:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.180+0000 7fe7f1d67640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe7d40a32d0 0x7fe7d40a5790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:11.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.180+0000 7fe7f1d67640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7ec106a80 0x7fe7ec1a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.180+0000 7fe7f1d67640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7ec101420 0x7fe7ec1996e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.180+0000 7fe7f1d67640 1 --2- 172.21.15.2:0/1108710141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7ec100a80 0x7fe7ec1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.180+0000 7fe7f1d67640 1 -- 172.21.15.2:0/1108710141 >> 172.21.15.2:0/1108710141 conn(0x7fe7ec0fc7a0 msgr2=0x7fe7ec0fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.180+0000 7fe7f1d67640 1 -- 172.21.15.2:0/1108710141 shutdown_connections 2024-09-15T23:13:11.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:11.180+0000 7fe7f1d67640 1 -- 172.21.15.2:0/1108710141 wait complete. 2024-09-15T23:13:11.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:11 smithi112 ceph-mon[34367]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.0 KiB/s wr, 6 op/s 2024-09-15T23:13:11.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:11 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1108710141' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T23:13:11.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:11 smithi002 ceph-mon[31019]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.0 KiB/s wr, 6 op/s 2024-09-15T23:13:11.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:11 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1108710141' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T23:13:11.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:11 smithi145 ceph-mon[34901]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.0 KiB/s wr, 6 op/s 2024-09-15T23:13:11.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:11 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1108710141' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T23:13:11.864 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2564114882},{"type":"v1","addr":"172.21.15.2:6801","nonce":2564114882}]},"active_addr":"172.21.15.2:6801/2564114882","active_change":"2024-09-15T23:05:41.416780+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.2:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":2473316249}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":4081748544}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":4076310741}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3363964546}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3613177875}]}]} 2024-09-15T23:13:11.870 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-15T23:13:11.870 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-15T23:13:11.870 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:13:12.125 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:12.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.610+0000 7ff81b540640 1 -- 172.21.15.2:0/1299731626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81410e3c0 msgr2=0x7ff814110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:12.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.610+0000 7ff81b540640 1 --2- 172.21.15.2:0/1299731626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81410e3c0 0x7ff814110810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009ca0 tx=0x7ff80c02a950 comp rx=0 tx=0).stop 2024-09-15T23:13:12.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.610+0000 7ff81b540640 1 -- 172.21.15.2:0/1299731626 shutdown_connections 2024-09-15T23:13:12.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.610+0000 7ff81b540640 1 --2- 172.21.15.2:0/1299731626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff81410e3c0 0x7ff814110810 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:12.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.610+0000 7ff81b540640 1 --2- 172.21.15.2:0/1299731626 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff814074f40 0x7ff81410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:12.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.610+0000 7ff81b540640 1 --2- 172.21.15.2:0/1299731626 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff814074620 0x7ff814074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:12.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.610+0000 7ff81b540640 1 -- 172.21.15.2:0/1299731626 >> 172.21.15.2:0/1299731626 conn(0x7ff8140fd8c0 msgr2=0x7ff8140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:12.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.610+0000 7ff81b540640 1 -- 172.21.15.2:0/1299731626 shutdown_connections 2024-09-15T23:13:12.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.610+0000 7ff81b540640 1 -- 172.21.15.2:0/1299731626 wait complete. 2024-09-15T23:13:12.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.611+0000 7ff81b540640 1 Processor -- start 2024-09-15T23:13:12.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.611+0000 7ff81b540640 1 -- start start 2024-09-15T23:13:12.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.611+0000 7ff81b540640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff814074620 0x7ff81419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:12.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.611+0000 7ff81b540640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff814074f40 0x7ff81419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:12.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.611+0000 7ff81b540640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff81410e3c0 0x7ff81419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:12.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.611+0000 7ff81b540640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff814114060 con 0x7ff814074f40 2024-09-15T23:13:12.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.611+0000 7ff81b540640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff814113ee0 con 0x7ff81410e3c0 2024-09-15T23:13:12.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.611+0000 7ff81b540640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff8141141e0 con 0x7ff814074620 2024-09-15T23:13:12.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.611+0000 7ff818adb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff814074f40 0x7ff81419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:12.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.611+0000 7ff818adb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff814074f40 0x7ff81419aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56764/0 (socket says 172.21.15.2:56764) 2024-09-15T23:13:12.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.611+0000 7ff818adb640 1 -- 172.21.15.2:0/3800483788 learned_addr learned my addr 172.21.15.2:0/3800483788 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:12.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.611+0000 7ff8192dc640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff814074620 0x7ff81419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:12.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.612+0000 7ff819add640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff81410e3c0 0x7ff81419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:12.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.612+0000 7ff818adb640 1 -- 172.21.15.2:0/3800483788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff814074620 msgr2=0x7ff81419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:12.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.612+0000 7ff818adb640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff814074620 0x7ff81419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:12.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.612+0000 7ff818adb640 1 -- 172.21.15.2:0/3800483788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff81410e3c0 msgr2=0x7ff81419ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:12.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.612+0000 7ff818adb640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff81410e3c0 0x7ff81419ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:12.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.612+0000 7ff818adb640 1 -- 172.21.15.2:0/3800483788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81419f520 con 0x7ff814074f40 2024-09-15T23:13:12.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.612+0000 7ff819add640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff81410e3c0 0x7ff81419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:12.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.612+0000 7ff818adb640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff814074f40 0x7ff81419aab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff80400b4a0 tx=0x7ff80400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:12.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.612+0000 7ff80a7fc640 1 -- 172.21.15.2:0/3800483788 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804014070 con 0x7ff814074f40 2024-09-15T23:13:12.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.612+0000 7ff80a7fc640 1 -- 172.21.15.2:0/3800483788 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff804010ac0 con 0x7ff814074f40 2024-09-15T23:13:12.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.612+0000 7ff81b540640 1 -- 172.21.15.2:0/3800483788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81419f810 con 0x7ff814074f40 2024-09-15T23:13:12.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.612+0000 7ff80a7fc640 1 -- 172.21.15.2:0/3800483788 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804017c30 con 0x7ff814074f40 2024-09-15T23:13:12.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.612+0000 7ff81b540640 1 -- 172.21.15.2:0/3800483788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8141a70f0 con 0x7ff814074f40 2024-09-15T23:13:12.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.613+0000 7ff81b540640 1 -- 172.21.15.2:0/3800483788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff814074a00 con 0x7ff814074f40 2024-09-15T23:13:12.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.614+0000 7ff80a7fc640 1 -- 172.21.15.2:0/3800483788 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff804017070 con 0x7ff814074f40 2024-09-15T23:13:12.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.615+0000 7ff80a7fc640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff8000a32d0 0x7ff8000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:12.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.615+0000 7ff8192dc640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff8000a32d0 0x7ff8000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:12.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.615+0000 7ff80a7fc640 1 -- 172.21.15.2:0/3800483788 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7ff8040cefb0 con 0x7ff814074f40 2024-09-15T23:13:12.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.616+0000 7ff8192dc640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff8000a32d0 0x7ff8000a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff8100058c0 tx=0x7ff81000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:12.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.619+0000 7ff80a7fc640 1 -- 172.21.15.2:0/3800483788 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff80409bd30 con 0x7ff814074f40 2024-09-15T23:13:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.796+0000 7ff81b540640 1 -- 172.21.15.2:0/3800483788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff81402d7c0 con 0x7ff814074f40 2024-09-15T23:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.798+0000 7ff80a7fc640 1 -- 172.21.15.2:0/3800483788 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22195 (secure 0 0 0) 0x7ff80409b630 con 0x7ff814074f40 2024-09-15T23:13:12.799 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:12.799 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","created":"2024-09-15T23:04:45.101432+0000","modified":"2024-09-15T23:12:42.434365+0000","last_up_change":"2024-09-15T23:11:49.566858+0000","last_in_change":"2024-09-15T23:11:25.723093+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:07:57.919291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:38.100522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:40.716254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40ff4fd9-3904-4178-a9cb-51f4647be540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6803","nonce":280991401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6805","nonce":280991401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6809","nonce":280991401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6807","nonce":280991401}]},"public_addr":"172.21.15.2:6803/280991401","cluster_addr":"172.21.15.2:6805/280991401","heartbeat_back_addr":"172.21.15.2:6809/280991401","heartbeat_front_addr":"172.21.15.2:6807/280991401","state":["exists","up"]},{"osd":1,"uuid":"af5e265d-fe45-4d9c-a34c-6f0b103d75d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6801","nonce":2649210970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6803","nonce":2649210970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6807","nonce":2649210970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6805","nonce":2649210970}]},"public_addr":"172.21.15.112:6801/2649210970","cluster_addr":"172.21.15.112:6803/2649210970","heartbeat_back_addr":"172.21.15.112:6807/2649210970","heartbeat_front_addr":"172.21.15.112:6805/2649210970","state":["exists","up"]},{"osd":2,"uuid":"8df9e644-fc51-4626-a1a7-6ac4448a5b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6801","nonce":3485615437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6803","nonce":3485615437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6807","nonce":3485615437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6805","nonce":3485615437}]},"public_addr":"172.21.15.145:6801/3485615437","cluster_addr":"172.21.15.145:6803/3485615437","heartbeat_back_addr":"172.21.15.145:6807/3485615437","heartbeat_front_addr":"172.21.15.145:6805/3485615437","state":["exists","up"]},{"osd":3,"uuid":"dbab372a-8fdd-4b0c-bee3-16cd75b35ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6811","nonce":113061968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6813","nonce":113061968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6817","nonce":113061968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6815","nonce":113061968}]},"public_addr":"172.21.15.2:6811/113061968","cluster_addr":"172.21.15.2:6813/113061968","heartbeat_back_addr":"172.21.15.2:6817/113061968","heartbeat_front_addr":"172.21.15.2:6815/113061968","state":["exists","up"]},{"osd":4,"uuid":"73bab8af-3973-4beb-a034-d00bcf0c572f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6809","nonce":2519162767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6811","nonce":2519162767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6815","nonce":2519162767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6813","nonce":2519162767}]},"public_addr":"172.21.15.112:6809/2519162767","cluster_addr":"172.21.15.112:6811/2519162767","heartbeat_back_addr":"172.21.15.112:6815/2519162767","heartbeat_front_addr":"172.21.15.112:6813/2519162767","state":["exists","up"]},{"osd":5,"uuid":"2d163e61-5891-46c1-b1c2-39d50a3b6f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6809","nonce":712427242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6811","nonce":712427242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6815","nonce":712427242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6813","nonce":712427242}]},"public_addr":"172.21.15.145:6809/712427242","cluster_addr":"172.21.15.145:6811/712427242","heartbeat_back_addr":"172.21.15.145:6815/712427242","heartbeat_front_addr":"172.21.15.145:6813/712427242","state":["exists","up"]},{"osd":6,"uuid":"bca02c96-10de-4953-96e9-42fc9ddf7c1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6819","nonce":2930673197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6821","nonce":2930673197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6825","nonce":2930673197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6823","nonce":2930673197}]},"public_addr":"172.21.15.2:6819/2930673197","cluster_addr":"172.21.15.2:6821/2930673197","heartbeat_back_addr":"172.21.15.2:6825/2930673197","heartbeat_front_addr":"172.21.15.2:6823/2930673197","state":["exists","up"]},{"osd":7,"uuid":"4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6817","nonce":830628191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6819","nonce":830628191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6823","nonce":830628191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6821","nonce":830628191}]},"public_addr":"172.21.15.112:6817/830628191","cluster_addr":"172.21.15.112:6819/830628191","heartbeat_back_addr":"172.21.15.112:6823/830628191","heartbeat_front_addr":"172.21.15.112:6821/830628191","state":["exists","up"]},{"osd":8,"uuid":"2733f9dd-3872-4bec-9c22-bcdb64828ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6817","nonce":3634470540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6819","nonce":3634470540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6823","nonce":3634470540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6821","nonce":3634470540}]},"public_addr":"172.21.15.145:6817/3634470540","cluster_addr":"172.21.15.145:6819/3634470540","heartbeat_back_addr":"172.21.15.145:6823/3634470540","heartbeat_front_addr":"172.21.15.145:6821/3634470540","state":["exists","up"]},{"osd":9,"uuid":"bd1f4a4a-547c-43a9-859a-75b37b06905f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6827","nonce":1417377702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6829","nonce":1417377702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6833","nonce":1417377702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6831","nonce":1417377702}]},"public_addr":"172.21.15.2:6827/1417377702","cluster_addr":"172.21.15.2:6829/1417377702","heartbeat_back_addr":"172.21.15.2:6833/1417377702","heartbeat_front_addr":"172.21.15.2:6831/1417377702","state":["exists","up"]},{"osd":10,"uuid":"f8b895e8-39f5-4753-9343-03f96da12246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6825","nonce":105615908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6827","nonce":105615908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6831","nonce":105615908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6829","nonce":105615908}]},"public_addr":"172.21.15.112:6825/105615908","cluster_addr":"172.21.15.112:6827/105615908","heartbeat_back_addr":"172.21.15.112:6831/105615908","heartbeat_front_addr":"172.21.15.112:6829/105615908","state":["exists","up"]},{"osd":11,"uuid":"dc018bfc-bc13-4ef2-a712-5cd406a56cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6825","nonce":430484289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6827","nonce":430484289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6831","nonce":430484289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6829","nonce":430484289}]},"public_addr":"172.21.15.145:6825/430484289","cluster_addr":"172.21.15.145:6827/430484289","heartbeat_back_addr":"172.21.15.145:6831/430484289","heartbeat_front_addr":"172.21.15.145:6829/430484289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:03.938207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:29.814740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:54.853802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:20.802021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:47.028090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:13.226130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:39.003023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:04.465156+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:29.321331+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:55.992585+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:21.623406+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:48.269840+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/2956732837":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6800/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/896502743":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/3802152324":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/1891095221":"2024-09-16T23:05:17.756048+0000","172.21.15.2:6800/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/236781836":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/2404111366":"2024-09-16T23:05:17.756048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:13:12.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.800+0000 7ff81b540640 1 -- 172.21.15.2:0/3800483788 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff8000a32d0 msgr2=0x7ff8000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:12.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.800+0000 7ff81b540640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff8000a32d0 0x7ff8000a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff8100058c0 tx=0x7ff81000a2d0 comp rx=0 tx=0).stop 2024-09-15T23:13:12.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.800+0000 7ff81b540640 1 -- 172.21.15.2:0/3800483788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff814074f40 msgr2=0x7ff81419aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:12.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.800+0000 7ff81b540640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff814074f40 0x7ff81419aab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff80400b4a0 tx=0x7ff80400b960 comp rx=0 tx=0).stop 2024-09-15T23:13:12.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.800+0000 7ff81b540640 1 -- 172.21.15.2:0/3800483788 shutdown_connections 2024-09-15T23:13:12.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.800+0000 7ff81b540640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff8000a32d0 0x7ff8000a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:12.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.800+0000 7ff81b540640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff81410e3c0 0x7ff81419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:12.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.800+0000 7ff81b540640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff814074f40 0x7ff81419aab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:12.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.800+0000 7ff81b540640 1 --2- 172.21.15.2:0/3800483788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff814074620 0x7ff81419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:12.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.800+0000 7ff81b540640 1 -- 172.21.15.2:0/3800483788 >> 172.21.15.2:0/3800483788 conn(0x7ff8140fd8c0 msgr2=0x7ff8140ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:12.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.800+0000 7ff81b540640 1 -- 172.21.15.2:0/3800483788 shutdown_connections 2024-09-15T23:13:12.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:12.800+0000 7ff81b540640 1 -- 172.21.15.2:0/3800483788 wait complete. 2024-09-15T23:13:13.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:13 smithi112 ceph-mon[34367]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.5 KiB/s wr, 3 op/s 2024-09-15T23:13:13.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:13 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3800483788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:13:13.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:13 smithi002 ceph-mon[31019]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.5 KiB/s wr, 3 op/s 2024-09-15T23:13:13.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:13 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3800483788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:13:13.630 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-15T23:13:13.631 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:13:13.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:13 smithi145 ceph-mon[34901]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.5 KiB/s wr, 3 op/s 2024-09-15T23:13:13.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:13 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3800483788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:13:13.895 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:14.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.379+0000 7f20a187f640 1 -- 172.21.15.2:0/2411296915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f209c101de0 msgr2=0x7f209c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:14.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.379+0000 7f20a187f640 1 --2- 172.21.15.2:0/2411296915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f209c101de0 0x7f209c1021c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f208c009900 tx=0x7f208c02a410 comp rx=0 tx=0).stop 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.379+0000 7f20a187f640 1 -- 172.21.15.2:0/2411296915 shutdown_connections 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.379+0000 7f20a187f640 1 --2- 172.21.15.2:0/2411296915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f209c106f10 0x7f209c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.379+0000 7f20a187f640 1 --2- 172.21.15.2:0/2411296915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f209c102790 0x7f209c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.379+0000 7f20a187f640 1 --2- 172.21.15.2:0/2411296915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f209c101de0 0x7f209c1021c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.379+0000 7f20a187f640 1 -- 172.21.15.2:0/2411296915 >> 172.21.15.2:0/2411296915 conn(0x7f209c0fd8c0 msgr2=0x7f209c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.379+0000 7f20a187f640 1 -- 172.21.15.2:0/2411296915 shutdown_connections 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.379+0000 7f20a187f640 1 -- 172.21.15.2:0/2411296915 wait complete. 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.379+0000 7f20a187f640 1 Processor -- start 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.379+0000 7f20a187f640 1 -- start start 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f20a187f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f209c101de0 0x7f209c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f20a187f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f209c102790 0x7f209c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f20a187f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f209c106f10 0x7f209c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f20a187f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f209c111f10 con 0x7f209c106f10 2024-09-15T23:13:14.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f20a187f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f209c111d90 con 0x7f209c101de0 2024-09-15T23:13:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f20a187f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f209c112090 con 0x7f209c102790 2024-09-15T23:13:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f209b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f209c106f10 0x7f209c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f209b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f209c106f10 0x7f209c19cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56784/0 (socket says 172.21.15.2:56784) 2024-09-15T23:13:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f209b7fe640 1 -- 172.21.15.2:0/2265178868 learned_addr learned my addr 172.21.15.2:0/2265178868 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f209affd640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f209c101de0 0x7f209c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f209a7fc640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f209c102790 0x7f209c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f209b7fe640 1 -- 172.21.15.2:0/2265178868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f209c102790 msgr2=0x7f209c198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f209b7fe640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f209c102790 0x7f209c198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f209b7fe640 1 -- 172.21.15.2:0/2265178868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f209c101de0 msgr2=0x7f209c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f209b7fe640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f209c101de0 0x7f209c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f209b7fe640 1 -- 172.21.15.2:0/2265178868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c19d480 con 0x7f209c106f10 2024-09-15T23:13:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f209a7fc640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f209c102790 0x7f209c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:14.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f209b7fe640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f209c106f10 0x7f209c19cda0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f209400b970 tx=0x7f209400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.380+0000 7f20a087d640 1 -- 172.21.15.2:0/2265178868 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2094019070 con 0x7f209c106f10 2024-09-15T23:13:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.381+0000 7f20a187f640 1 -- 172.21.15.2:0/2265178868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c19d770 con 0x7f209c106f10 2024-09-15T23:13:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.381+0000 7f20a087d640 1 -- 172.21.15.2:0/2265178868 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2094014440 con 0x7f209c106f10 2024-09-15T23:13:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.381+0000 7f20a087d640 1 -- 172.21.15.2:0/2265178868 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20940075d0 con 0x7f209c106f10 2024-09-15T23:13:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.381+0000 7f20a187f640 1 -- 172.21.15.2:0/2265178868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c1a5050 con 0x7f209c106f10 2024-09-15T23:13:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.382+0000 7f20a187f640 1 -- 172.21.15.2:0/2265178868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c102240 con 0x7f209c106f10 2024-09-15T23:13:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.383+0000 7f20a087d640 1 -- 172.21.15.2:0/2265178868 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f209401c070 con 0x7f209c106f10 2024-09-15T23:13:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.383+0000 7f20a087d640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f20840a32d0 0x7f20840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.384+0000 7f20a087d640 1 -- 172.21.15.2:0/2265178868 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f20940cedb0 con 0x7f209c106f10 2024-09-15T23:13:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.384+0000 7f209affd640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f20840a32d0 0x7f20840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.384+0000 7f209affd640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f20840a32d0 0x7f20840a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f208c005ab0 tx=0x7f208c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:14.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.388+0000 7f20a087d640 1 -- 172.21.15.2:0/2265178868 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f209409b5e0 con 0x7f209c106f10 2024-09-15T23:13:14.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.563+0000 7f20a187f640 1 -- 172.21.15.2:0/2265178868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f209c02d7c0 con 0x7f209c106f10 2024-09-15T23:13:14.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.565+0000 7f20a087d640 1 -- 172.21.15.2:0/2265178868 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22195 (secure 0 0 0) 0x7f209409f8e0 con 0x7f209c106f10 2024-09-15T23:13:14.566 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:14.566 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","created":"2024-09-15T23:04:45.101432+0000","modified":"2024-09-15T23:12:42.434365+0000","last_up_change":"2024-09-15T23:11:49.566858+0000","last_in_change":"2024-09-15T23:11:25.723093+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:07:57.919291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:38.100522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:40.716254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40ff4fd9-3904-4178-a9cb-51f4647be540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6803","nonce":280991401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6805","nonce":280991401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6809","nonce":280991401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6807","nonce":280991401}]},"public_addr":"172.21.15.2:6803/280991401","cluster_addr":"172.21.15.2:6805/280991401","heartbeat_back_addr":"172.21.15.2:6809/280991401","heartbeat_front_addr":"172.21.15.2:6807/280991401","state":["exists","up"]},{"osd":1,"uuid":"af5e265d-fe45-4d9c-a34c-6f0b103d75d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6801","nonce":2649210970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6803","nonce":2649210970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6807","nonce":2649210970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6805","nonce":2649210970}]},"public_addr":"172.21.15.112:6801/2649210970","cluster_addr":"172.21.15.112:6803/2649210970","heartbeat_back_addr":"172.21.15.112:6807/2649210970","heartbeat_front_addr":"172.21.15.112:6805/2649210970","state":["exists","up"]},{"osd":2,"uuid":"8df9e644-fc51-4626-a1a7-6ac4448a5b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6801","nonce":3485615437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6803","nonce":3485615437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6807","nonce":3485615437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6805","nonce":3485615437}]},"public_addr":"172.21.15.145:6801/3485615437","cluster_addr":"172.21.15.145:6803/3485615437","heartbeat_back_addr":"172.21.15.145:6807/3485615437","heartbeat_front_addr":"172.21.15.145:6805/3485615437","state":["exists","up"]},{"osd":3,"uuid":"dbab372a-8fdd-4b0c-bee3-16cd75b35ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6811","nonce":113061968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6813","nonce":113061968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6817","nonce":113061968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6815","nonce":113061968}]},"public_addr":"172.21.15.2:6811/113061968","cluster_addr":"172.21.15.2:6813/113061968","heartbeat_back_addr":"172.21.15.2:6817/113061968","heartbeat_front_addr":"172.21.15.2:6815/113061968","state":["exists","up"]},{"osd":4,"uuid":"73bab8af-3973-4beb-a034-d00bcf0c572f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6809","nonce":2519162767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6811","nonce":2519162767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6815","nonce":2519162767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6813","nonce":2519162767}]},"public_addr":"172.21.15.112:6809/2519162767","cluster_addr":"172.21.15.112:6811/2519162767","heartbeat_back_addr":"172.21.15.112:6815/2519162767","heartbeat_front_addr":"172.21.15.112:6813/2519162767","state":["exists","up"]},{"osd":5,"uuid":"2d163e61-5891-46c1-b1c2-39d50a3b6f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6809","nonce":712427242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6811","nonce":712427242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6815","nonce":712427242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6813","nonce":712427242}]},"public_addr":"172.21.15.145:6809/712427242","cluster_addr":"172.21.15.145:6811/712427242","heartbeat_back_addr":"172.21.15.145:6815/712427242","heartbeat_front_addr":"172.21.15.145:6813/712427242","state":["exists","up"]},{"osd":6,"uuid":"bca02c96-10de-4953-96e9-42fc9ddf7c1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6819","nonce":2930673197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6821","nonce":2930673197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6825","nonce":2930673197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6823","nonce":2930673197}]},"public_addr":"172.21.15.2:6819/2930673197","cluster_addr":"172.21.15.2:6821/2930673197","heartbeat_back_addr":"172.21.15.2:6825/2930673197","heartbeat_front_addr":"172.21.15.2:6823/2930673197","state":["exists","up"]},{"osd":7,"uuid":"4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6817","nonce":830628191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6819","nonce":830628191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6823","nonce":830628191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6821","nonce":830628191}]},"public_addr":"172.21.15.112:6817/830628191","cluster_addr":"172.21.15.112:6819/830628191","heartbeat_back_addr":"172.21.15.112:6823/830628191","heartbeat_front_addr":"172.21.15.112:6821/830628191","state":["exists","up"]},{"osd":8,"uuid":"2733f9dd-3872-4bec-9c22-bcdb64828ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6817","nonce":3634470540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6819","nonce":3634470540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6823","nonce":3634470540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6821","nonce":3634470540}]},"public_addr":"172.21.15.145:6817/3634470540","cluster_addr":"172.21.15.145:6819/3634470540","heartbeat_back_addr":"172.21.15.145:6823/3634470540","heartbeat_front_addr":"172.21.15.145:6821/3634470540","state":["exists","up"]},{"osd":9,"uuid":"bd1f4a4a-547c-43a9-859a-75b37b06905f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6827","nonce":1417377702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6829","nonce":1417377702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6833","nonce":1417377702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6831","nonce":1417377702}]},"public_addr":"172.21.15.2:6827/1417377702","cluster_addr":"172.21.15.2:6829/1417377702","heartbeat_back_addr":"172.21.15.2:6833/1417377702","heartbeat_front_addr":"172.21.15.2:6831/1417377702","state":["exists","up"]},{"osd":10,"uuid":"f8b895e8-39f5-4753-9343-03f96da12246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6825","nonce":105615908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6827","nonce":105615908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6831","nonce":105615908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6829","nonce":105615908}]},"public_addr":"172.21.15.112:6825/105615908","cluster_addr":"172.21.15.112:6827/105615908","heartbeat_back_addr":"172.21.15.112:6831/105615908","heartbeat_front_addr":"172.21.15.112:6829/105615908","state":["exists","up"]},{"osd":11,"uuid":"dc018bfc-bc13-4ef2-a712-5cd406a56cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6825","nonce":430484289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6827","nonce":430484289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6831","nonce":430484289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6829","nonce":430484289}]},"public_addr":"172.21.15.145:6825/430484289","cluster_addr":"172.21.15.145:6827/430484289","heartbeat_back_addr":"172.21.15.145:6831/430484289","heartbeat_front_addr":"172.21.15.145:6829/430484289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:03.938207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:29.814740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:54.853802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:20.802021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:47.028090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:13.226130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:39.003023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:04.465156+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:29.321331+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:55.992585+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:21.623406+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:48.269840+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/2956732837":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6800/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/896502743":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/3802152324":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/1891095221":"2024-09-16T23:05:17.756048+0000","172.21.15.2:6800/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/236781836":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/2404111366":"2024-09-16T23:05:17.756048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:13:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.567+0000 7f20a187f640 1 -- 172.21.15.2:0/2265178868 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f20840a32d0 msgr2=0x7f20840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.567+0000 7f20a187f640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f20840a32d0 0x7f20840a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f208c005ab0 tx=0x7f208c005a20 comp rx=0 tx=0).stop 2024-09-15T23:13:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.567+0000 7f20a187f640 1 -- 172.21.15.2:0/2265178868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f209c106f10 msgr2=0x7f209c19cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.567+0000 7f20a187f640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f209c106f10 0x7f209c19cda0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f209400b970 tx=0x7f209400be30 comp rx=0 tx=0).stop 2024-09-15T23:13:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.567+0000 7f20a187f640 1 -- 172.21.15.2:0/2265178868 shutdown_connections 2024-09-15T23:13:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.567+0000 7f20a187f640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f20840a32d0 0x7f20840a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:14.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.567+0000 7f20a187f640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f209c106f10 0x7f209c19cda0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.567+0000 7f20a187f640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f209c102790 0x7f209c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.567+0000 7f20a187f640 1 --2- 172.21.15.2:0/2265178868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f209c101de0 0x7f209c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.567+0000 7f20a187f640 1 -- 172.21.15.2:0/2265178868 >> 172.21.15.2:0/2265178868 conn(0x7f209c0fd8c0 msgr2=0x7f209c0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.567+0000 7f20a187f640 1 -- 172.21.15.2:0/2265178868 shutdown_connections 2024-09-15T23:13:14.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:14.567+0000 7f20a187f640 1 -- 172.21.15.2:0/2265178868 wait complete. 2024-09-15T23:13:15.387 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-15T23:13:15.387 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-15T23:13:15.388 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-15T23:13:15.388 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-15T23:13:15.389 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-15T23:13:15.390 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-15T23:13:15.390 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-15T23:13:15.391 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-15T23:13:15.391 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-15T23:13:15.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-15T23:13:15.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-15T23:13:15.393 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-15T23:13:15.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:15 smithi112 ceph-mon[34367]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.6 KiB/s wr, 4 op/s 2024-09-15T23:13:15.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:15 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2265178868' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:13:15.507 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:15 smithi002 ceph-mon[31019]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.6 KiB/s wr, 4 op/s 2024-09-15T23:13:15.507 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:15 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2265178868' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:13:15.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:15 smithi145 ceph-mon[34901]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.6 KiB/s wr, 4 op/s 2024-09-15T23:13:15.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:15 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2265178868' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:13:16.156 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:16.171 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:16.171 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:16.175 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:16.182 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:16.189 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:16.190 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:16.236 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:16.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.960+0000 7fcbd9965640 1 -- 172.21.15.2:0/3293954139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd4100a80 msgr2=0x7fcbd4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:16.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.960+0000 7fcbd9965640 1 --2- 172.21.15.2:0/3293954139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd4100a80 0x7fcbd4100ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009930 tx=0x7fcbc802a420 comp rx=0 tx=0).stop 2024-09-15T23:13:16.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.960+0000 7fcbd9965640 1 -- 172.21.15.2:0/3293954139 shutdown_connections 2024-09-15T23:13:16.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.960+0000 7fcbd9965640 1 --2- 172.21.15.2:0/3293954139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd4101420 0x7fcbd410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:16.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.960+0000 7fcbd9965640 1 --2- 172.21.15.2:0/3293954139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd4100a80 0x7fcbd4100ee0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:16.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.961+0000 7fcbd9965640 1 --2- 172.21.15.2:0/3293954139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbd4106a80 0x7fcbd4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:16.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.961+0000 7fcbd9965640 1 -- 172.21.15.2:0/3293954139 >> 172.21.15.2:0/3293954139 conn(0x7fcbd40fc7a0 msgr2=0x7fcbd40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:16.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.961+0000 7fcbd9965640 1 -- 172.21.15.2:0/3293954139 shutdown_connections 2024-09-15T23:13:16.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.961+0000 7fcbd9965640 1 -- 172.21.15.2:0/3293954139 wait complete. 2024-09-15T23:13:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.961+0000 7fcbd9965640 1 Processor -- start 2024-09-15T23:13:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd9965640 1 -- start start 2024-09-15T23:13:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd9965640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd4100a80 0x7fcbd419e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd9965640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbd4101420 0x7fcbd419e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd9965640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd4106a80 0x7fcbd41983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd9965640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd4110d30 con 0x7fcbd4106a80 2024-09-15T23:13:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd9965640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd4110bb0 con 0x7fcbd4100a80 2024-09-15T23:13:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd9965640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd4110eb0 con 0x7fcbd4101420 2024-09-15T23:13:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd4106a80 0x7fcbd41983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd4106a80 0x7fcbd41983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33846/0 (socket says 172.21.15.2:33846) 2024-09-15T23:13:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd37fe640 1 -- 172.21.15.2:0/918037242 learned_addr learned my addr 172.21.15.2:0/918037242 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd2ffd640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd4100a80 0x7fcbd419e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:16.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd27fc640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbd4101420 0x7fcbd419e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd37fe640 1 -- 172.21.15.2:0/918037242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbd4101420 msgr2=0x7fcbd419e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd37fe640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbd4101420 0x7fcbd419e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd37fe640 1 -- 172.21.15.2:0/918037242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd4100a80 msgr2=0x7fcbd419e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd37fe640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbd4100a80 0x7fcbd419e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd37fe640 1 -- 172.21.15.2:0/918037242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd4198b50 con 0x7fcbd4106a80 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.962+0000 7fcbd37fe640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd4106a80 0x7fcbd41983d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009fd0 tx=0x7fcbcc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.963+0000 7fcbd8963640 1 -- 172.21.15.2:0/918037242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc017070 con 0x7fcbd4106a80 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.963+0000 7fcbd8963640 1 -- 172.21.15.2:0/918037242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbcc003e20 con 0x7fcbd4106a80 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.963+0000 7fcbd9965640 1 -- 172.21.15.2:0/918037242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd4198e40 con 0x7fcbd4106a80 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.963+0000 7fcbd8963640 1 -- 172.21.15.2:0/918037242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc010460 con 0x7fcbd4106a80 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.963+0000 7fcbd9965640 1 -- 172.21.15.2:0/918037242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd41a4f50 con 0x7fcbd4106a80 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.964+0000 7fcbd9965640 1 -- 172.21.15.2:0/918037242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcbd40fced0 con 0x7fcbd4106a80 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.965+0000 7fcbd8963640 1 -- 172.21.15.2:0/918037242 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fcbcc003970 con 0x7fcbd4106a80 2024-09-15T23:13:16.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.965+0000 7fcbd8963640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcbbc0a32d0 0x7fcbbc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:16.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.966+0000 7fcbd2ffd640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcbbc0a32d0 0x7fcbbc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:16.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.966+0000 7fcbd8963640 1 -- 172.21.15.2:0/918037242 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fcbcc0cf7d0 con 0x7fcbd4106a80 2024-09-15T23:13:16.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.966+0000 7fcbd8963640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197] conn(0x7fcbbc0acb20 0x7fcbbc0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:16.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.966+0000 7fcbd8963640 1 -- 172.21.15.2:0/918037242 --> [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcbcc0090b0 con 0x7fcbbc0acb20 2024-09-15T23:13:16.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.966+0000 7fcbd8963640 1 -- 172.21.15.2:0/918037242 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fcbcc0d42c0 con 0x7fcbd4106a80 2024-09-15T23:13:16.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.966+0000 7fcbd27fc640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197] conn(0x7fcbbc0acb20 0x7fcbbc0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:16.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.966+0000 7fcbd2ffd640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcbbc0a32d0 0x7fcbbc0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4005d70 tx=0x7fcbc4005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:16.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.966+0000 7fcbd27fc640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197] conn(0x7fcbbc0acb20 0x7fcbbc0aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:16.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.967+0000 7fcbd8963640 1 -- 172.21.15.2:0/918037242 <== osd.6 v2:172.21.15.2:6818/2930673197 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcbcc0090b0 con 0x7fcbbc0acb20 2024-09-15T23:13:16.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.981+0000 7fcbd9965640 1 -- 172.21.15.2:0/918037242 --> [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcbd41021c0 con 0x7fcbbc0acb20 2024-09-15T23:13:16.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.981+0000 7fcbd8963640 1 -- 172.21.15.2:0/918037242 <== osd.6 v2:172.21.15.2:6818/2930673197 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcbd41021c0 con 0x7fcbbc0acb20 2024-09-15T23:13:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.981+0000 7fcbd9965640 1 -- 172.21.15.2:0/918037242 >> [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197] conn(0x7fcbbc0acb20 msgr2=0x7fcbbc0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.981+0000 7fcbd9965640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197] conn(0x7fcbbc0acb20 0x7fcbbc0aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.981+0000 7fcbd9965640 1 -- 172.21.15.2:0/918037242 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcbbc0a32d0 msgr2=0x7fcbbc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.981+0000 7fcbd9965640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcbbc0a32d0 0x7fcbbc0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4005d70 tx=0x7fcbc4005d00 comp rx=0 tx=0).stop 2024-09-15T23:13:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.981+0000 7fcbd9965640 1 -- 172.21.15.2:0/918037242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd4106a80 msgr2=0x7fcbd41983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.981+0000 7fcbd9965640 1 --2- 172.21.15.2:0/918037242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbd4106a80 0x7fcbd41983d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009fd0 tx=0x7fcbcc00b260 comp rx=0 tx=0).stop 2024-09-15T23:13:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.981+0000 7fcbd37fe640 1 -- 172.21.15.2:0/918037242 reap_dead start 2024-09-15T23:13:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.981+0000 7fcbd9965640 1 -- 172.21.15.2:0/918037242 shutdown_connections 2024-09-15T23:13:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.981+0000 7fcbd9965640 1 -- 172.21.15.2:0/918037242 >> 172.21.15.2:0/918037242 conn(0x7fcbd40fc7a0 msgr2=0x7fcbd40fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.982+0000 7fcbd9965640 1 -- 172.21.15.2:0/918037242 shutdown_connections 2024-09-15T23:13:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:16.982+0000 7fcbd9965640 1 -- 172.21.15.2:0/918037242 wait complete. 2024-09-15T23:13:17.457 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:17 smithi002 ceph-mon[31019]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-15T23:13:17.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:17 smithi112 ceph-mon[34367]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-15T23:13:17.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:17 smithi145 ceph-mon[34901]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-15T23:13:18.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.373+0000 7f96ff223640 1 -- 172.21.15.2:0/2582361387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f8103720 msgr2=0x7f96f810bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:18.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.373+0000 7f96ff223640 1 --2- 172.21.15.2:0/2582361387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f8103720 0x7f96f810bc10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009900 tx=0x7f96e402a480 comp rx=0 tx=0).stop 2024-09-15T23:13:18.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.373+0000 7f96ff223640 1 -- 172.21.15.2:0/2582361387 shutdown_connections 2024-09-15T23:13:18.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.373+0000 7f96ff223640 1 --2- 172.21.15.2:0/2582361387 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f810c1a0 0x7f96f810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:18.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.373+0000 7f96ff223640 1 --2- 172.21.15.2:0/2582361387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f8103720 0x7f96f810bc10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:18.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.373+0000 7f96ff223640 1 --2- 172.21.15.2:0/2582361387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f8102e00 0x7f96f81031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:18.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.373+0000 7f96ff223640 1 -- 172.21.15.2:0/2582361387 >> 172.21.15.2:0/2582361387 conn(0x7f96f80fc7a0 msgr2=0x7f96f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:18.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.373+0000 7f96ff223640 1 -- 172.21.15.2:0/2582361387 shutdown_connections 2024-09-15T23:13:18.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.373+0000 7f96ff223640 1 -- 172.21.15.2:0/2582361387 wait complete. 2024-09-15T23:13:18.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.374+0000 7f96ff223640 1 Processor -- start 2024-09-15T23:13:18.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.374+0000 7f96ff223640 1 -- start start 2024-09-15T23:13:18.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.374+0000 7f96ff223640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f8102e00 0x7f96f81982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:18.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.374+0000 7f96ff223640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f8103720 0x7f96f8198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:18.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.374+0000 7f96ff223640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f810c1a0 0x7f96f819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:18.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.374+0000 7f96ff223640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f96f8111e20 con 0x7f96f810c1a0 2024-09-15T23:13:18.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.374+0000 7f96ff223640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f96f8111ca0 con 0x7f96f8102e00 2024-09-15T23:13:18.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.374+0000 7f96ff223640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f96f8111fa0 con 0x7f96f8103720 2024-09-15T23:13:18.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.374+0000 7f96fd7c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f810c1a0 0x7f96f819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:18.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.374+0000 7f96fd7c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f810c1a0 0x7f96f819cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33880/0 (socket says 172.21.15.2:33880) 2024-09-15T23:13:18.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.374+0000 7f96fd7c0640 1 -- 172.21.15.2:0/1103952751 learned_addr learned my addr 172.21.15.2:0/1103952751 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.375+0000 7f96fcfbf640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f8102e00 0x7f96f81982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.375+0000 7f96f7fff640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f8103720 0x7f96f8198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.375+0000 7f96fd7c0640 1 -- 172.21.15.2:0/1103952751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f8103720 msgr2=0x7f96f8198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.375+0000 7f96fd7c0640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96f8103720 0x7f96f8198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.375+0000 7f96fd7c0640 1 -- 172.21.15.2:0/1103952751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f8102e00 msgr2=0x7f96f81982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.375+0000 7f96fd7c0640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96f8102e00 0x7f96f81982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.375+0000 7f96fd7c0640 1 -- 172.21.15.2:0/1103952751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f819d2a0 con 0x7f96f810c1a0 2024-09-15T23:13:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.375+0000 7f96fd7c0640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f810c1a0 0x7f96f819cbc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f96f000cce0 tx=0x7f96f000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.375+0000 7f96f5ffb640 1 -- 172.21.15.2:0/1103952751 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f000f450 con 0x7f96f810c1a0 2024-09-15T23:13:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.375+0000 7f96ff223640 1 -- 172.21.15.2:0/1103952751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f819d590 con 0x7f96f810c1a0 2024-09-15T23:13:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.375+0000 7f96f5ffb640 1 -- 172.21.15.2:0/1103952751 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96f000faa0 con 0x7f96f810c1a0 2024-09-15T23:13:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.375+0000 7f96f5ffb640 1 -- 172.21.15.2:0/1103952751 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f0018b70 con 0x7f96f810c1a0 2024-09-15T23:13:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.375+0000 7f96ff223640 1 -- 172.21.15.2:0/1103952751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f81a4e70 con 0x7f96f810c1a0 2024-09-15T23:13:18.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.376+0000 7f96ff223640 1 -- 172.21.15.2:0/1103952751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96f8062980 con 0x7f96f810c1a0 2024-09-15T23:13:18.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.377+0000 7f96f5ffb640 1 -- 172.21.15.2:0/1103952751 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f96f0018d10 con 0x7f96f810c1a0 2024-09-15T23:13:18.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.378+0000 7f96f5ffb640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f96e80a32d0 0x7f96e80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:18.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.378+0000 7f96fcfbf640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f96e80a32d0 0x7f96e80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:18.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.378+0000 7f96f5ffb640 1 -- 172.21.15.2:0/1103952751 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f96f00cffc0 con 0x7f96f810c1a0 2024-09-15T23:13:18.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.378+0000 7f96f5ffb640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702] conn(0x7f96e80acb20 0x7f96e80aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:18.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.378+0000 7f96f5ffb640 1 -- 172.21.15.2:0/1103952751 --> [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96f0015e70 con 0x7f96e80acb20 2024-09-15T23:13:18.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.378+0000 7f96f5ffb640 1 -- 172.21.15.2:0/1103952751 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f96f00d0370 con 0x7f96f810c1a0 2024-09-15T23:13:18.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.379+0000 7f96f7fff640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702] conn(0x7f96e80acb20 0x7f96e80aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:18.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.379+0000 7f96fcfbf640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f96e80a32d0 0x7f96e80a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00bbe0 tx=0x7f96ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:18.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.379+0000 7f96f7fff640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702] conn(0x7f96e80acb20 0x7f96e80aef40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:18.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.380+0000 7f96f5ffb640 1 -- 172.21.15.2:0/1103952751 <== osd.9 v2:172.21.15.2:6826/1417377702 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96f0015e70 con 0x7f96e80acb20 2024-09-15T23:13:18.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.393+0000 7f96ff223640 1 -- 172.21.15.2:0/1103952751 --> [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f96f8062e00 con 0x7f96e80acb20 2024-09-15T23:13:18.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.394+0000 7f96f5ffb640 1 -- 172.21.15.2:0/1103952751 <== osd.9 v2:172.21.15.2:6826/1417377702 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f96f8062e00 con 0x7f96e80acb20 2024-09-15T23:13:18.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.394+0000 7f96ff223640 1 -- 172.21.15.2:0/1103952751 >> [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702] conn(0x7f96e80acb20 msgr2=0x7f96e80aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:18.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.394+0000 7f96ff223640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702] conn(0x7f96e80acb20 0x7f96e80aef40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:18.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.394+0000 7f96ff223640 1 -- 172.21.15.2:0/1103952751 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f96e80a32d0 msgr2=0x7f96e80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:18.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.394+0000 7f96ff223640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f96e80a32d0 0x7f96e80a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00bbe0 tx=0x7f96ec00b390 comp rx=0 tx=0).stop 2024-09-15T23:13:18.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.394+0000 7f96ff223640 1 -- 172.21.15.2:0/1103952751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f810c1a0 msgr2=0x7f96f819cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:18.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.394+0000 7f96ff223640 1 --2- 172.21.15.2:0/1103952751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f810c1a0 0x7f96f819cbc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f96f000cce0 tx=0x7f96f000a620 comp rx=0 tx=0).stop 2024-09-15T23:13:18.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.394+0000 7f96fd7c0640 1 -- 172.21.15.2:0/1103952751 reap_dead start 2024-09-15T23:13:18.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.394+0000 7f96ff223640 1 -- 172.21.15.2:0/1103952751 shutdown_connections 2024-09-15T23:13:18.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.394+0000 7f96ff223640 1 -- 172.21.15.2:0/1103952751 >> 172.21.15.2:0/1103952751 conn(0x7f96f80fc7a0 msgr2=0x7f96f80fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:18.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.394+0000 7f96ff223640 1 -- 172.21.15.2:0/1103952751 shutdown_connections 2024-09-15T23:13:18.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.394+0000 7f96ff223640 1 -- 172.21.15.2:0/1103952751 wait complete. 2024-09-15T23:13:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.903+0000 7fcd73c56640 1 -- 172.21.15.2:0/4072722142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd6c106f10 msgr2=0x7fcd6c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.903+0000 7fcd73c56640 1 --2- 172.21.15.2:0/4072722142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd6c106f10 0x7fcd6c10ea90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009ca0 tx=0x7fcd5c02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:13:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.903+0000 7fcd73c56640 1 -- 172.21.15.2:0/4072722142 shutdown_connections 2024-09-15T23:13:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.903+0000 7fcd73c56640 1 --2- 172.21.15.2:0/4072722142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd6c106f10 0x7fcd6c10ea90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.903+0000 7fcd73c56640 1 --2- 172.21.15.2:0/4072722142 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd6c102790 0x7fcd6c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.903+0000 7fcd73c56640 1 --2- 172.21.15.2:0/4072722142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c101de0 0x7fcd6c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.903+0000 7fcd73c56640 1 -- 172.21.15.2:0/4072722142 >> 172.21.15.2:0/4072722142 conn(0x7fcd6c0fd8c0 msgr2=0x7fcd6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.903+0000 7fcd73c56640 1 -- 172.21.15.2:0/4072722142 shutdown_connections 2024-09-15T23:13:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.903+0000 7fcd73c56640 1 -- 172.21.15.2:0/4072722142 wait complete. 2024-09-15T23:13:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.904+0000 7fcd73c56640 1 Processor -- start 2024-09-15T23:13:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.904+0000 7fcd73c56640 1 -- start start 2024-09-15T23:13:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.904+0000 7fcd73c56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd6c101de0 0x7fcd6c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.904+0000 7fcd73c56640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd6c102790 0x7fcd6c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.904+0000 7fcd73c56640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c106f10 0x7fcd6c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.904+0000 7fcd73c56640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c111e20 con 0x7fcd6c101de0 2024-09-15T23:13:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.904+0000 7fcd73c56640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c111ca0 con 0x7fcd6c106f10 2024-09-15T23:13:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.904+0000 7fcd73c56640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c111fa0 con 0x7fcd6c102790 2024-09-15T23:13:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.904+0000 7fcd719f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd6c101de0 0x7fcd6c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.904+0000 7fcd719f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd6c101de0 0x7fcd6c198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33900/0 (socket says 172.21.15.2:33900) 2024-09-15T23:13:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.904+0000 7fcd719f2640 1 -- 172.21.15.2:0/1594314751 learned_addr learned my addr 172.21.15.2:0/1594314751 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd711f1640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd6c102790 0x7fcd6c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd721f3640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c106f10 0x7fcd6c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd719f2640 1 -- 172.21.15.2:0/1594314751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd6c102790 msgr2=0x7fcd6c1988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd719f2640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd6c102790 0x7fcd6c1988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd719f2640 1 -- 172.21.15.2:0/1594314751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c106f10 msgr2=0x7fcd6c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd719f2640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c106f10 0x7fcd6c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd719f2640 1 -- 172.21.15.2:0/1594314751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6c19d330 con 0x7fcd6c101de0 2024-09-15T23:13:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd721f3640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcd6c106f10 0x7fcd6c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd719f2640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd6c101de0 0x7fcd6c198380 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400c890 tx=0x7fcd6400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd6affd640 1 -- 172.21.15.2:0/1594314751 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd64004220 con 0x7fcd6c101de0 2024-09-15T23:13:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd73c56640 1 -- 172.21.15.2:0/1594314751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6c19d620 con 0x7fcd6c101de0 2024-09-15T23:13:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd6affd640 1 -- 172.21.15.2:0/1594314751 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd640043c0 con 0x7fcd6c101de0 2024-09-15T23:13:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd6affd640 1 -- 172.21.15.2:0/1594314751 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd64004a00 con 0x7fcd6c101de0 2024-09-15T23:13:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.905+0000 7fcd73c56640 1 -- 172.21.15.2:0/1594314751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd6c1a4f00 con 0x7fcd6c101de0 2024-09-15T23:13:19.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.906+0000 7fcd73c56640 1 -- 172.21.15.2:0/1594314751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcd6c062900 con 0x7fcd6c101de0 2024-09-15T23:13:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.907+0000 7fcd6affd640 1 -- 172.21.15.2:0/1594314751 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fcd64004ba0 con 0x7fcd6c101de0 2024-09-15T23:13:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.908+0000 7fcd6affd640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcd540a32d0 0x7fcd540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.908+0000 7fcd711f1640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcd540a32d0 0x7fcd540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.908+0000 7fcd6affd640 1 -- 172.21.15.2:0/1594314751 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fcd640cfbd0 con 0x7fcd6c101de0 2024-09-15T23:13:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.908+0000 7fcd6affd640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970] conn(0x7fcd540acb20 0x7fcd540aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.908+0000 7fcd6affd640 1 -- 172.21.15.2:0/1594314751 --> [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd64023ef0 con 0x7fcd540acb20 2024-09-15T23:13:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.908+0000 7fcd6affd640 1 -- 172.21.15.2:0/1594314751 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fcd640cff80 con 0x7fcd6c101de0 2024-09-15T23:13:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.908+0000 7fcd711f1640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcd540a32d0 0x7fcd540a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcd60005d70 tx=0x7fcd60005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.909+0000 7fcd721f3640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970] conn(0x7fcd540acb20 0x7fcd540aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.909+0000 7fcd721f3640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970] conn(0x7fcd540acb20 0x7fcd540aef40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.910+0000 7fcd6affd640 1 -- 172.21.15.2:0/1594314751 <== osd.1 v2:172.21.15.112:6800/2649210970 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcd64023ef0 con 0x7fcd540acb20 2024-09-15T23:13:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.923+0000 7fcd73c56640 1 -- 172.21.15.2:0/1594314751 --> [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcd6c062d00 con 0x7fcd540acb20 2024-09-15T23:13:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.924+0000 7fcd6affd640 1 -- 172.21.15.2:0/1594314751 <== osd.1 v2:172.21.15.112:6800/2649210970 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcd6c062d00 con 0x7fcd540acb20 2024-09-15T23:13:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.924+0000 7fcd73c56640 1 -- 172.21.15.2:0/1594314751 >> [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970] conn(0x7fcd540acb20 msgr2=0x7fcd540aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.924+0000 7fcd73c56640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970] conn(0x7fcd540acb20 0x7fcd540aef40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.925+0000 7fcd73c56640 1 -- 172.21.15.2:0/1594314751 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcd540a32d0 msgr2=0x7fcd540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.925+0000 7fcd73c56640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fcd540a32d0 0x7fcd540a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcd60005d70 tx=0x7fcd60005d00 comp rx=0 tx=0).stop 2024-09-15T23:13:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.925+0000 7fcd73c56640 1 -- 172.21.15.2:0/1594314751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd6c101de0 msgr2=0x7fcd6c198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.925+0000 7fcd73c56640 1 --2- 172.21.15.2:0/1594314751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd6c101de0 0x7fcd6c198380 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400c890 tx=0x7fcd6400cd50 comp rx=0 tx=0).stop 2024-09-15T23:13:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.925+0000 7fcd721f3640 1 -- 172.21.15.2:0/1594314751 reap_dead start 2024-09-15T23:13:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.925+0000 7fcd73c56640 1 -- 172.21.15.2:0/1594314751 shutdown_connections 2024-09-15T23:13:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.925+0000 7fcd73c56640 1 -- 172.21.15.2:0/1594314751 >> 172.21.15.2:0/1594314751 conn(0x7fcd6c0fd8c0 msgr2=0x7fcd6c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.925+0000 7fcd73c56640 1 -- 172.21.15.2:0/1594314751 shutdown_connections 2024-09-15T23:13:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:18.925+0000 7fcd73c56640 1 -- 172.21.15.2:0/1594314751 wait complete. 2024-09-15T23:13:19.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:19 smithi112 ceph-mon[34367]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-15T23:13:19.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:19 smithi002 ceph-mon[31019]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-15T23:13:19.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:19 smithi145 ceph-mon[34901]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-15T23:13:20.024 INFO:teuthology.orchestra.run.smithi002.stdout:270582939679 2024-09-15T23:13:20.024 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-15T23:13:20.857 INFO:teuthology.orchestra.run.smithi002.stdout:55834574921 2024-09-15T23:13:20.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-15T23:13:21.539 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:21 smithi002 ceph-mon[31019]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:13:21.571 INFO:teuthology.orchestra.run.smithi002.stdout:184683593775 2024-09-15T23:13:21.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-15T23:13:21.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:21 smithi145 ceph-mon[34901]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:13:21.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:21 smithi112 ceph-mon[34367]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:13:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.119+0000 7fe88e985640 1 -- 172.21.15.2:0/1534087824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe888102790 msgr2=0x7fe8881067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.119+0000 7fe88e985640 1 --2- 172.21.15.2:0/1534087824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe888102790 0x7fe8881067e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009900 tx=0x7fe87c02a410 comp rx=0 tx=0).stop 2024-09-15T23:13:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.119+0000 7fe88e985640 1 -- 172.21.15.2:0/1534087824 shutdown_connections 2024-09-15T23:13:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.119+0000 7fe88e985640 1 --2- 172.21.15.2:0/1534087824 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe888106f10 0x7fe88810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.119+0000 7fe88e985640 1 --2- 172.21.15.2:0/1534087824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe888102790 0x7fe8881067e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.119+0000 7fe88e985640 1 --2- 172.21.15.2:0/1534087824 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe888101de0 0x7fe8881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.119+0000 7fe88e985640 1 -- 172.21.15.2:0/1534087824 >> 172.21.15.2:0/1534087824 conn(0x7fe8880fd8c0 msgr2=0x7fe8880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.119+0000 7fe88e985640 1 -- 172.21.15.2:0/1534087824 shutdown_connections 2024-09-15T23:13:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.119+0000 7fe88e985640 1 -- 172.21.15.2:0/1534087824 wait complete. 2024-09-15T23:13:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.120+0000 7fe88e985640 1 Processor -- start 2024-09-15T23:13:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.120+0000 7fe88e985640 1 -- start start 2024-09-15T23:13:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.120+0000 7fe88e985640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe888101de0 0x7fe8880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.120+0000 7fe88e985640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe888102790 0x7fe888074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.120+0000 7fe88e985640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe888106f10 0x7fe888074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.120+0000 7fe88e985640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe888111ec0 con 0x7fe888101de0 2024-09-15T23:13:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.120+0000 7fe88e985640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe888111d40 con 0x7fe888102790 2024-09-15T23:13:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.120+0000 7fe88e985640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe888112040 con 0x7fe888106f10 2024-09-15T23:13:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.120+0000 7fe887fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe888101de0 0x7fe8880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.120+0000 7fe887fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe888101de0 0x7fe8880744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33914/0 (socket says 172.21.15.2:33914) 2024-09-15T23:13:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.120+0000 7fe887fff640 1 -- 172.21.15.2:0/418582352 learned_addr learned my addr 172.21.15.2:0/418582352 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.120+0000 7fe88cf22640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe888106f10 0x7fe888074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.121+0000 7fe887fff640 1 -- 172.21.15.2:0/418582352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe888106f10 msgr2=0x7fe888074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.121+0000 7fe887fff640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe888106f10 0x7fe888074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.121+0000 7fe8877fe640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe888102790 0x7fe888074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.121+0000 7fe887fff640 1 -- 172.21.15.2:0/418582352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe888102790 msgr2=0x7fe888074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.121+0000 7fe887fff640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe888102790 0x7fe888074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.121+0000 7fe887fff640 1 -- 172.21.15.2:0/418582352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8881aaed0 con 0x7fe888101de0 2024-09-15T23:13:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.121+0000 7fe88cf22640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe888106f10 0x7fe888074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.121+0000 7fe887fff640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe888101de0 0x7fe8880744f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe87800b4a0 tx=0x7fe87800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.121+0000 7fe8857fa640 1 -- 172.21.15.2:0/418582352 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878014070 con 0x7fe888101de0 2024-09-15T23:13:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.121+0000 7fe88e985640 1 -- 172.21.15.2:0/418582352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8881ab100 con 0x7fe888101de0 2024-09-15T23:13:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.121+0000 7fe8857fa640 1 -- 172.21.15.2:0/418582352 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe878010ac0 con 0x7fe888101de0 2024-09-15T23:13:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.121+0000 7fe8857fa640 1 -- 172.21.15.2:0/418582352 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878017c30 con 0x7fe888101de0 2024-09-15T23:13:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.121+0000 7fe88e985640 1 -- 172.21.15.2:0/418582352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8881ab690 con 0x7fe888101de0 2024-09-15T23:13:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.122+0000 7fe88e985640 1 -- 172.21.15.2:0/418582352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe888062900 con 0x7fe888101de0 2024-09-15T23:13:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.123+0000 7fe8857fa640 1 -- 172.21.15.2:0/418582352 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe878017070 con 0x7fe888101de0 2024-09-15T23:13:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.124+0000 7fe8857fa640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe8700a32d0 0x7fe8700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.124+0000 7fe8877fe640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe8700a32d0 0x7fe8700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.124+0000 7fe8857fa640 1 -- 172.21.15.2:0/418582352 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fe8780cf070 con 0x7fe888101de0 2024-09-15T23:13:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.124+0000 7fe8857fa640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401] conn(0x7fe8700acb20 0x7fe8700aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.124+0000 7fe8857fa640 1 -- 172.21.15.2:0/418582352 --> [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe87800ee50 con 0x7fe8700acb20 2024-09-15T23:13:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.124+0000 7fe8857fa640 1 -- 172.21.15.2:0/418582352 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fe8780cf550 con 0x7fe888101de0 2024-09-15T23:13:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.124+0000 7fe88cf22640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401] conn(0x7fe8700acb20 0x7fe8700aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.124+0000 7fe8877fe640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe8700a32d0 0x7fe8700a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe87c006010 tx=0x7fe87c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.125+0000 7fe88cf22640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401] conn(0x7fe8700acb20 0x7fe8700aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.126+0000 7fe8857fa640 1 -- 172.21.15.2:0/418582352 <== osd.0 v2:172.21.15.2:6802/280991401 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe87800ee50 con 0x7fe8700acb20 2024-09-15T23:13:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.139+0000 7fe88e985640 1 -- 172.21.15.2:0/418582352 --> [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe888062d00 con 0x7fe8700acb20 2024-09-15T23:13:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.139+0000 7fe8857fa640 1 -- 172.21.15.2:0/418582352 <== osd.0 v2:172.21.15.2:6802/280991401 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe888062d00 con 0x7fe8700acb20 2024-09-15T23:13:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.140+0000 7fe88e985640 1 -- 172.21.15.2:0/418582352 >> [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401] conn(0x7fe8700acb20 msgr2=0x7fe8700aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.140+0000 7fe88e985640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401] conn(0x7fe8700acb20 0x7fe8700aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.140+0000 7fe88e985640 1 -- 172.21.15.2:0/418582352 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe8700a32d0 msgr2=0x7fe8700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.140+0000 7fe88e985640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe8700a32d0 0x7fe8700a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe87c006010 tx=0x7fe87c000bc0 comp rx=0 tx=0).stop 2024-09-15T23:13:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.140+0000 7fe88e985640 1 -- 172.21.15.2:0/418582352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe888101de0 msgr2=0x7fe8880744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.140+0000 7fe88e985640 1 --2- 172.21.15.2:0/418582352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe888101de0 0x7fe8880744f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe87800b4a0 tx=0x7fe87800b960 comp rx=0 tx=0).stop 2024-09-15T23:13:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.140+0000 7fe88cf22640 1 -- 172.21.15.2:0/418582352 reap_dead start 2024-09-15T23:13:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.140+0000 7fe88e985640 1 -- 172.21.15.2:0/418582352 shutdown_connections 2024-09-15T23:13:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.140+0000 7fe88e985640 1 -- 172.21.15.2:0/418582352 >> 172.21.15.2:0/418582352 conn(0x7fe8880fd8c0 msgr2=0x7fe8880fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.140+0000 7fe88e985640 1 -- 172.21.15.2:0/418582352 shutdown_connections 2024-09-15T23:13:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.140+0000 7fe88e985640 1 -- 172.21.15.2:0/418582352 wait complete. 2024-09-15T23:13:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.766+0000 7fa771ef1640 1 -- 172.21.15.2:0/4137686722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76c101de0 msgr2=0x7fa76c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.766+0000 7fa771ef1640 1 --2- 172.21.15.2:0/4137686722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76c101de0 0x7fa76c1021c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009900 tx=0x7fa75c02a410 comp rx=0 tx=0).stop 2024-09-15T23:13:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.766+0000 7fa771ef1640 1 -- 172.21.15.2:0/4137686722 shutdown_connections 2024-09-15T23:13:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.766+0000 7fa771ef1640 1 --2- 172.21.15.2:0/4137686722 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa76c106f10 0x7fa76c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.766+0000 7fa771ef1640 1 --2- 172.21.15.2:0/4137686722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c102790 0x7fa76c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.766+0000 7fa771ef1640 1 --2- 172.21.15.2:0/4137686722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76c101de0 0x7fa76c1021c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.766+0000 7fa771ef1640 1 -- 172.21.15.2:0/4137686722 >> 172.21.15.2:0/4137686722 conn(0x7fa76c0fd8c0 msgr2=0x7fa76c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.766+0000 7fa771ef1640 1 -- 172.21.15.2:0/4137686722 shutdown_connections 2024-09-15T23:13:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.766+0000 7fa771ef1640 1 -- 172.21.15.2:0/4137686722 wait complete. 2024-09-15T23:13:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.766+0000 7fa771ef1640 1 Processor -- start 2024-09-15T23:13:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa771ef1640 1 -- start start 2024-09-15T23:13:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa771ef1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76c101de0 0x7fa76c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa771ef1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa76c102790 0x7fa76c1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa771ef1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c106f10 0x7fa76c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa771ef1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c111de0 con 0x7fa76c101de0 2024-09-15T23:13:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa771ef1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c111c60 con 0x7fa76c106f10 2024-09-15T23:13:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa771ef1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c111f60 con 0x7fa76c102790 2024-09-15T23:13:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa76b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76c101de0 0x7fa76c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa76b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76c101de0 0x7fa76c198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33944/0 (socket says 172.21.15.2:33944) 2024-09-15T23:13:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa76b7fe640 1 -- 172.21.15.2:0/1399422786 learned_addr learned my addr 172.21.15.2:0/1399422786 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa76affd640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa76c102790 0x7fa76c1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa76bfff640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c106f10 0x7fa76c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa76b7fe640 1 -- 172.21.15.2:0/1399422786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa76c102790 msgr2=0x7fa76c1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa76b7fe640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa76c102790 0x7fa76c1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa76b7fe640 1 -- 172.21.15.2:0/1399422786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c106f10 msgr2=0x7fa76c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa76b7fe640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa76c106f10 0x7fa76c19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa76b7fe640 1 -- 172.21.15.2:0/1399422786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c19d310 con 0x7fa76c101de0 2024-09-15T23:13:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa76affd640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa76c102790 0x7fa76c1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.767+0000 7fa76b7fe640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76c101de0 0x7fa76c198360 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa75c005940 tx=0x7fa75c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.768+0000 7fa768ff9640 1 -- 172.21.15.2:0/1399422786 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c03f030 con 0x7fa76c101de0 2024-09-15T23:13:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.768+0000 7fa768ff9640 1 -- 172.21.15.2:0/1399422786 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa75c003aa0 con 0x7fa76c101de0 2024-09-15T23:13:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.768+0000 7fa768ff9640 1 -- 172.21.15.2:0/1399422786 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c035070 con 0x7fa76c101de0 2024-09-15T23:13:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.768+0000 7fa771ef1640 1 -- 172.21.15.2:0/1399422786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76c19d5a0 con 0x7fa76c101de0 2024-09-15T23:13:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.768+0000 7fa771ef1640 1 -- 172.21.15.2:0/1399422786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76c19da30 con 0x7fa76c101de0 2024-09-15T23:13:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.769+0000 7fa771ef1640 1 -- 172.21.15.2:0/1399422786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa76c062980 con 0x7fa76c101de0 2024-09-15T23:13:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.770+0000 7fa768ff9640 1 -- 172.21.15.2:0/1399422786 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa75c042030 con 0x7fa76c101de0 2024-09-15T23:13:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.771+0000 7fa768ff9640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa7540a3350 0x7fa7540a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:22.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.771+0000 7fa76affd640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa7540a3350 0x7fa7540a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:22.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.771+0000 7fa768ff9640 1 -- 172.21.15.2:0/1399422786 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fa75c0f0740 con 0x7fa76c101de0 2024-09-15T23:13:22.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.771+0000 7fa768ff9640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242] conn(0x7fa7540acba0 0x7fa7540aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:22.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.771+0000 7fa768ff9640 1 -- 172.21.15.2:0/1399422786 --> [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7540af670 con 0x7fa7540acba0 2024-09-15T23:13:22.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.771+0000 7fa768ff9640 1 -- 172.21.15.2:0/1399422786 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fa75c0f0c20 con 0x7fa76c101de0 2024-09-15T23:13:22.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.771+0000 7fa76affd640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa7540a3350 0x7fa7540a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa7600058c0 tx=0x7fa760005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:22.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.771+0000 7fa76bfff640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242] conn(0x7fa7540acba0 0x7fa7540aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:22.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.772+0000 7fa76bfff640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242] conn(0x7fa7540acba0 0x7fa7540aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:22.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.772+0000 7fa768ff9640 1 -- 172.21.15.2:0/1399422786 <== osd.5 v2:172.21.15.145:6808/712427242 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa7540af670 con 0x7fa7540acba0 2024-09-15T23:13:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.789+0000 7fa771ef1640 1 -- 172.21.15.2:0/1399422786 --> [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa76c062e50 con 0x7fa7540acba0 2024-09-15T23:13:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.790+0000 7fa768ff9640 1 -- 172.21.15.2:0/1399422786 <== osd.5 v2:172.21.15.145:6808/712427242 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa76c062e50 con 0x7fa7540acba0 2024-09-15T23:13:22.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.790+0000 7fa771ef1640 1 -- 172.21.15.2:0/1399422786 >> [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242] conn(0x7fa7540acba0 msgr2=0x7fa7540aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.790+0000 7fa771ef1640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242] conn(0x7fa7540acba0 0x7fa7540aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.790+0000 7fa771ef1640 1 -- 172.21.15.2:0/1399422786 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa7540a3350 msgr2=0x7fa7540a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.790+0000 7fa771ef1640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fa7540a3350 0x7fa7540a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa7600058c0 tx=0x7fa760005850 comp rx=0 tx=0).stop 2024-09-15T23:13:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.790+0000 7fa771ef1640 1 -- 172.21.15.2:0/1399422786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76c101de0 msgr2=0x7fa76c198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.790+0000 7fa771ef1640 1 --2- 172.21.15.2:0/1399422786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa76c101de0 0x7fa76c198360 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa75c005940 tx=0x7fa75c004270 comp rx=0 tx=0).stop 2024-09-15T23:13:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.790+0000 7fa76bfff640 1 -- 172.21.15.2:0/1399422786 reap_dead start 2024-09-15T23:13:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.790+0000 7fa771ef1640 1 -- 172.21.15.2:0/1399422786 shutdown_connections 2024-09-15T23:13:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.790+0000 7fa771ef1640 1 -- 172.21.15.2:0/1399422786 >> 172.21.15.2:0/1399422786 conn(0x7fa76c0fd8c0 msgr2=0x7fa76c0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.791+0000 7fa771ef1640 1 -- 172.21.15.2:0/1399422786 shutdown_connections 2024-09-15T23:13:22.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:22.791+0000 7fa771ef1640 1 -- 172.21.15.2:0/1399422786 wait complete. 2024-09-15T23:13:23.419 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:23 smithi002 ceph-mon[31019]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-15T23:13:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.418+0000 7f3889f71640 1 -- 172.21.15.2:0/417253344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3884108300 msgr2=0x7f388410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.418+0000 7f3889f71640 1 --2- 172.21.15.2:0/417253344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3884108300 0x7f388410ec70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f387c009cd0 tx=0x7f387c02a8f0 comp rx=0 tx=0).stop 2024-09-15T23:13:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.418+0000 7f3889f71640 1 -- 172.21.15.2:0/417253344 shutdown_connections 2024-09-15T23:13:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.418+0000 7f3889f71640 1 --2- 172.21.15.2:0/417253344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3884108300 0x7f388410ec70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.418+0000 7f3889f71640 1 --2- 172.21.15.2:0/417253344 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3884103780 0x7f3884107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.418+0000 7f3889f71640 1 --2- 172.21.15.2:0/417253344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3884102dd0 0x7f38841031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.418+0000 7f3889f71640 1 -- 172.21.15.2:0/417253344 >> 172.21.15.2:0/417253344 conn(0x7f38840fc7d0 msgr2=0x7f38840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.418+0000 7f3889f71640 1 -- 172.21.15.2:0/417253344 shutdown_connections 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.418+0000 7f3889f71640 1 -- 172.21.15.2:0/417253344 wait complete. 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.419+0000 7f3889f71640 1 Processor -- start 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.419+0000 7f3889f71640 1 -- start start 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.419+0000 7f3889f71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3884102dd0 0x7f3884198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.419+0000 7f3889f71640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3884103780 0x7f3884198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.419+0000 7f3889f71640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3884108300 0x7f388419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.419+0000 7f3889f71640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3884111fa0 con 0x7f3884102dd0 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.419+0000 7f3889f71640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3884111e20 con 0x7f3884108300 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.419+0000 7f3889f71640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3884112120 con 0x7f3884103780 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.419+0000 7f38837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3884102dd0 0x7f3884198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.419+0000 7f38837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3884102dd0 0x7f3884198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33982/0 (socket says 172.21.15.2:33982) 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.419+0000 7f38837fe640 1 -- 172.21.15.2:0/206148139 learned_addr learned my addr 172.21.15.2:0/206148139 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.419+0000 7f3883fff640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3884108300 0x7f388419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:23.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.420+0000 7f3882ffd640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3884103780 0x7f3884198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:23.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.420+0000 7f38837fe640 1 -- 172.21.15.2:0/206148139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3884103780 msgr2=0x7f3884198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:23.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.420+0000 7f38837fe640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3884103780 0x7f3884198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:23.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.420+0000 7f38837fe640 1 -- 172.21.15.2:0/206148139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3884108300 msgr2=0x7f388419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:23.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.420+0000 7f38837fe640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3884108300 0x7f388419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:23.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.420+0000 7f38837fe640 1 -- 172.21.15.2:0/206148139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388419d400 con 0x7f3884102dd0 2024-09-15T23:13:23.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.420+0000 7f38837fe640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3884102dd0 0x7f3884198450 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f387400c920 tx=0x7f387400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:23.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.420+0000 7f3880ff9640 1 -- 172.21.15.2:0/206148139 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3874007c70 con 0x7f3884102dd0 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.420+0000 7f3880ff9640 1 -- 172.21.15.2:0/206148139 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3874007e10 con 0x7f3884102dd0 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.420+0000 7f3889f71640 1 -- 172.21.15.2:0/206148139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388419d6f0 con 0x7f3884102dd0 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.420+0000 7f3880ff9640 1 -- 172.21.15.2:0/206148139 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3874018820 con 0x7f3884102dd0 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.420+0000 7f3889f71640 1 -- 172.21.15.2:0/206148139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38841a4fd0 con 0x7f3884102dd0 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.421+0000 7f3889f71640 1 -- 172.21.15.2:0/206148139 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3884062940 con 0x7f3884102dd0 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.422+0000 7f3880ff9640 1 -- 172.21.15.2:0/206148139 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f38740189c0 con 0x7f3884102dd0 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.423+0000 7f3880ff9640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f386c0a32d0 0x7f386c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.423+0000 7f3882ffd640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f386c0a32d0 0x7f386c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.423+0000 7f3880ff9640 1 -- 172.21.15.2:0/206148139 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f38740cfea0 con 0x7f3884102dd0 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.423+0000 7f3880ff9640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968] conn(0x7f386c0acb20 0x7f386c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.423+0000 7f3880ff9640 1 -- 172.21.15.2:0/206148139 --> [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3874015e70 con 0x7f386c0acb20 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.423+0000 7f3880ff9640 1 -- 172.21.15.2:0/206148139 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f38740d0380 con 0x7f3884102dd0 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.423+0000 7f3883fff640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968] conn(0x7f386c0acb20 0x7f386c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.423+0000 7f3882ffd640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f386c0a32d0 0x7f386c0a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38840fee40 tx=0x7f3878008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.424+0000 7f3883fff640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968] conn(0x7f386c0acb20 0x7f386c0aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.424+0000 7f3880ff9640 1 -- 172.21.15.2:0/206148139 <== osd.3 v2:172.21.15.2:6810/113061968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3874015e70 con 0x7f386c0acb20 2024-09-15T23:13:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.441+0000 7f3889f71640 1 -- 172.21.15.2:0/206148139 --> [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3884062d40 con 0x7f386c0acb20 2024-09-15T23:13:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.441+0000 7f3880ff9640 1 -- 172.21.15.2:0/206148139 <== osd.3 v2:172.21.15.2:6810/113061968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3884062d40 con 0x7f386c0acb20 2024-09-15T23:13:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.442+0000 7f3889f71640 1 -- 172.21.15.2:0/206148139 >> [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968] conn(0x7f386c0acb20 msgr2=0x7f386c0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.442+0000 7f3889f71640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968] conn(0x7f386c0acb20 0x7f386c0aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.442+0000 7f3889f71640 1 -- 172.21.15.2:0/206148139 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f386c0a32d0 msgr2=0x7f386c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.442+0000 7f3889f71640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f386c0a32d0 0x7f386c0a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38840fee40 tx=0x7f3878008040 comp rx=0 tx=0).stop 2024-09-15T23:13:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.442+0000 7f3889f71640 1 -- 172.21.15.2:0/206148139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3884102dd0 msgr2=0x7f3884198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:23.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.442+0000 7f3889f71640 1 --2- 172.21.15.2:0/206148139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3884102dd0 0x7f3884198450 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f387400c920 tx=0x7f387400cde0 comp rx=0 tx=0).stop 2024-09-15T23:13:23.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.442+0000 7f3883fff640 1 -- 172.21.15.2:0/206148139 reap_dead start 2024-09-15T23:13:23.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.442+0000 7f3889f71640 1 -- 172.21.15.2:0/206148139 shutdown_connections 2024-09-15T23:13:23.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.442+0000 7f3889f71640 1 -- 172.21.15.2:0/206148139 >> 172.21.15.2:0/206148139 conn(0x7f38840fc7d0 msgr2=0x7f3884105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:23.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.442+0000 7f3889f71640 1 -- 172.21.15.2:0/206148139 shutdown_connections 2024-09-15T23:13:23.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.442+0000 7f3889f71640 1 -- 172.21.15.2:0/206148139 wait complete. 2024-09-15T23:13:23.509 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:23 smithi145 ceph-mon[34901]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-15T23:13:23.548 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:23 smithi112 ceph-mon[34367]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-15T23:13:23.872 INFO:teuthology.orchestra.run.smithi002.stdout:34359738447 2024-09-15T23:13:23.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-15T23:13:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.200+0000 7f094db36640 1 -- 172.21.15.2:0/904529598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0948101420 msgr2=0x7f094810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.200+0000 7f094db36640 1 --2- 172.21.15.2:0/904529598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0948101420 0x7f094810d950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0940009cd0 tx=0x7f094002a8e0 comp rx=0 tx=0).stop 2024-09-15T23:13:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.200+0000 7f094db36640 1 -- 172.21.15.2:0/904529598 shutdown_connections 2024-09-15T23:13:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.200+0000 7f094db36640 1 --2- 172.21.15.2:0/904529598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0948101420 0x7f094810d950 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.200+0000 7f094db36640 1 --2- 172.21.15.2:0/904529598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0948100a80 0x7f0948100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.200+0000 7f094db36640 1 --2- 172.21.15.2:0/904529598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0948106a80 0x7f0948106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.200+0000 7f094db36640 1 -- 172.21.15.2:0/904529598 >> 172.21.15.2:0/904529598 conn(0x7f09480fc7a0 msgr2=0x7f09480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.200+0000 7f094db36640 1 -- 172.21.15.2:0/904529598 shutdown_connections 2024-09-15T23:13:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.200+0000 7f094db36640 1 -- 172.21.15.2:0/904529598 wait complete. 2024-09-15T23:13:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f094db36640 1 Processor -- start 2024-09-15T23:13:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f094db36640 1 -- start start 2024-09-15T23:13:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f094db36640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0948100a80 0x7f09480fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f094db36640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0948101420 0x7f09480fd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f094db36640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0948106a80 0x7f09480fd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f094db36640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0948110d30 con 0x7f0948100a80 2024-09-15T23:13:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f094db36640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0948110bb0 con 0x7f0948106a80 2024-09-15T23:13:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f094db36640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0948110eb0 con 0x7f0948101420 2024-09-15T23:13:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f09477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0948100a80 0x7f09480fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f09477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0948100a80 0x7f09480fcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33966/0 (socket says 172.21.15.2:33966) 2024-09-15T23:13:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f09477fe640 1 -- 172.21.15.2:0/1624201178 learned_addr learned my addr 172.21.15.2:0/1624201178 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f0947fff640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0948106a80 0x7f09480fd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f0946ffd640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0948101420 0x7f09480fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.201+0000 7f09477fe640 1 -- 172.21.15.2:0/1624201178 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0948101420 msgr2=0x7f09480fd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.202+0000 7f09477fe640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0948101420 0x7f09480fd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.202+0000 7f09477fe640 1 -- 172.21.15.2:0/1624201178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0948106a80 msgr2=0x7f09480fd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.202+0000 7f09477fe640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0948106a80 0x7f09480fd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.202+0000 7f09477fe640 1 -- 172.21.15.2:0/1624201178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09481a67f0 con 0x7f0948100a80 2024-09-15T23:13:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.202+0000 7f0947fff640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0948106a80 0x7f09480fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.202+0000 7f09477fe640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0948100a80 0x7f09480fcdc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f093800d950 tx=0x7f093800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.202+0000 7f0944ff9640 1 -- 172.21.15.2:0/1624201178 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938017070 con 0x7f0948100a80 2024-09-15T23:13:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.202+0000 7f0944ff9640 1 -- 172.21.15.2:0/1624201178 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0938009c30 con 0x7f0948100a80 2024-09-15T23:13:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.202+0000 7f094db36640 1 -- 172.21.15.2:0/1624201178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09481a6ae0 con 0x7f0948100a80 2024-09-15T23:13:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.202+0000 7f0944ff9640 1 -- 172.21.15.2:0/1624201178 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093800f620 con 0x7f0948100a80 2024-09-15T23:13:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.202+0000 7f094db36640 1 -- 172.21.15.2:0/1624201178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09481a7070 con 0x7f0948100a80 2024-09-15T23:13:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.203+0000 7f094db36640 1 -- 172.21.15.2:0/1624201178 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09480628c0 con 0x7f0948100a80 2024-09-15T23:13:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.204+0000 7f0944ff9640 1 -- 172.21.15.2:0/1624201178 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f09380109a0 con 0x7f0948100a80 2024-09-15T23:13:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.205+0000 7f0944ff9640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f09300a3350 0x7f09300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.205+0000 7f0946ffd640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f09300a3350 0x7f09300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.205+0000 7f0944ff9640 1 -- 172.21.15.2:0/1624201178 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f09380cf8b0 con 0x7f0948100a80 2024-09-15T23:13:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.205+0000 7f0944ff9640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767] conn(0x7f09300acba0 0x7f09300aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.205+0000 7f0944ff9640 1 -- 172.21.15.2:0/1624201178 --> [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09300af670 con 0x7f09300acba0 2024-09-15T23:13:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.205+0000 7f0944ff9640 1 -- 172.21.15.2:0/1624201178 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f09380cfd90 con 0x7f0948100a80 2024-09-15T23:13:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.205+0000 7f0946ffd640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f09300a3350 0x7f09300a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f093c005fd0 tx=0x7f093c005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.205+0000 7f0947fff640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767] conn(0x7f09300acba0 0x7f09300aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.206+0000 7f0947fff640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767] conn(0x7f09300acba0 0x7f09300aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.206+0000 7f0944ff9640 1 -- 172.21.15.2:0/1624201178 <== osd.4 v2:172.21.15.112:6808/2519162767 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f09300af670 con 0x7f09300acba0 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.221+0000 7f094db36640 1 -- 172.21.15.2:0/1624201178 --> [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0948062cc0 con 0x7f09300acba0 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.221+0000 7f0944ff9640 1 -- 172.21.15.2:0/1624201178 <== osd.4 v2:172.21.15.112:6808/2519162767 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0948062cc0 con 0x7f09300acba0 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.222+0000 7f094db36640 1 -- 172.21.15.2:0/1624201178 >> [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767] conn(0x7f09300acba0 msgr2=0x7f09300aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.222+0000 7f094db36640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767] conn(0x7f09300acba0 0x7f09300aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.222+0000 7f094db36640 1 -- 172.21.15.2:0/1624201178 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f09300a3350 msgr2=0x7f09300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.222+0000 7f094db36640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f09300a3350 0x7f09300a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f093c005fd0 tx=0x7f093c005e20 comp rx=0 tx=0).stop 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.222+0000 7f094db36640 1 -- 172.21.15.2:0/1624201178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0948100a80 msgr2=0x7f09480fcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.222+0000 7f094db36640 1 --2- 172.21.15.2:0/1624201178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0948100a80 0x7f09480fcdc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f093800d950 tx=0x7f093800de10 comp rx=0 tx=0).stop 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.222+0000 7f0947fff640 1 -- 172.21.15.2:0/1624201178 reap_dead start 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.222+0000 7f094db36640 1 -- 172.21.15.2:0/1624201178 shutdown_connections 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.222+0000 7f094db36640 1 -- 172.21.15.2:0/1624201178 >> 172.21.15.2:0/1624201178 conn(0x7f09480fc7a0 msgr2=0x7f094806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.222+0000 7f094db36640 1 -- 172.21.15.2:0/1624201178 shutdown_connections 2024-09-15T23:13:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:23.222+0000 7f094db36640 1 -- 172.21.15.2:0/1624201178 wait complete. 2024-09-15T23:13:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:133143986234 2024-09-15T23:13:25.338 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-15T23:13:25.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.957+0000 7fbc349d6640 1 -- 172.21.15.2:0/63863903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc30102d90 msgr2=0x7fbc30103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:25.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.957+0000 7fbc349d6640 1 --2- 172.21.15.2:0/63863903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc30102d90 0x7fbc30103170 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbc20009cd0 tx=0x7fbc2002a8e0 comp rx=0 tx=0).stop 2024-09-15T23:13:25.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.957+0000 7fbc349d6640 1 -- 172.21.15.2:0/63863903 shutdown_connections 2024-09-15T23:13:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.957+0000 7fbc349d6640 1 --2- 172.21.15.2:0/63863903 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc30108290 0x7fbc3010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.957+0000 7fbc349d6640 1 --2- 172.21.15.2:0/63863903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc30103740 0x7fbc30107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.957+0000 7fbc349d6640 1 --2- 172.21.15.2:0/63863903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc30102d90 0x7fbc30103170 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.957+0000 7fbc349d6640 1 -- 172.21.15.2:0/63863903 >> 172.21.15.2:0/63863903 conn(0x7fbc300fc7d0 msgr2=0x7fbc300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.957+0000 7fbc349d6640 1 -- 172.21.15.2:0/63863903 shutdown_connections 2024-09-15T23:13:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.957+0000 7fbc349d6640 1 -- 172.21.15.2:0/63863903 wait complete. 2024-09-15T23:13:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc349d6640 1 Processor -- start 2024-09-15T23:13:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc349d6640 1 -- start start 2024-09-15T23:13:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc349d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc30102d90 0x7fbc301009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc349d6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc30103740 0x7fbc30100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc349d6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc30108290 0x7fbc30101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc349d6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbc30111f40 con 0x7fbc30102d90 2024-09-15T23:13:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc349d6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbc30111dc0 con 0x7fbc30108290 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc349d6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbc301120c0 con 0x7fbc30103740 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc2e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc30102d90 0x7fbc301009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc2e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc30102d90 0x7fbc301009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33866/0 (socket says 172.21.15.2:33866) 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc2e59c640 1 -- 172.21.15.2:0/2534198559 learned_addr learned my addr 172.21.15.2:0/2534198559 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc2dd9b640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc30103740 0x7fbc30100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc2ed9d640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc30108290 0x7fbc30101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc2e59c640 1 -- 172.21.15.2:0/2534198559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc30103740 msgr2=0x7fbc30100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc2e59c640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc30103740 0x7fbc30100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc2e59c640 1 -- 172.21.15.2:0/2534198559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc30108290 msgr2=0x7fbc30101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc2e59c640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc30108290 0x7fbc30101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc2e59c640 1 -- 172.21.15.2:0/2534198559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc301a6940 con 0x7fbc30102d90 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.958+0000 7fbc2e59c640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc30102d90 0x7fbc301009f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbc2002ae00 tx=0x7fbc20003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.959+0000 7fbc1f7fe640 1 -- 172.21.15.2:0/2534198559 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20004240 con 0x7fbc30102d90 2024-09-15T23:13:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.959+0000 7fbc1f7fe640 1 -- 172.21.15.2:0/2534198559 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc200305a0 con 0x7fbc30102d90 2024-09-15T23:13:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.959+0000 7fbc349d6640 1 -- 172.21.15.2:0/2534198559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc301a6bd0 con 0x7fbc30102d90 2024-09-15T23:13:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.959+0000 7fbc1f7fe640 1 -- 172.21.15.2:0/2534198559 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2003b640 con 0x7fbc30102d90 2024-09-15T23:13:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.959+0000 7fbc349d6640 1 -- 172.21.15.2:0/2534198559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc301a7160 con 0x7fbc30102d90 2024-09-15T23:13:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.960+0000 7fbc349d6640 1 -- 172.21.15.2:0/2534198559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc300628c0 con 0x7fbc30102d90 2024-09-15T23:13:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.961+0000 7fbc1f7fe640 1 -- 172.21.15.2:0/2534198559 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fbc20030ac0 con 0x7fbc30102d90 2024-09-15T23:13:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.962+0000 7fbc1f7fe640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbc180a3350 0x7fbc180a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.962+0000 7fbc2dd9b640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbc180a3350 0x7fbc180a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.962+0000 7fbc1f7fe640 1 -- 172.21.15.2:0/2534198559 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fbc2002e030 con 0x7fbc30102d90 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.962+0000 7fbc1f7fe640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908] conn(0x7fbc180acba0 0x7fbc180aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.962+0000 7fbc1f7fe640 1 -- 172.21.15.2:0/2534198559 --> [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc180af670 con 0x7fbc180acba0 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.962+0000 7fbc1f7fe640 1 -- 172.21.15.2:0/2534198559 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fbc200f11d0 con 0x7fbc30102d90 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.962+0000 7fbc2dd9b640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbc180a3350 0x7fbc180a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc24005e10 tx=0x7fbc24005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.962+0000 7fbc2ed9d640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908] conn(0x7fbc180acba0 0x7fbc180aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.963+0000 7fbc2ed9d640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908] conn(0x7fbc180acba0 0x7fbc180aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.964+0000 7fbc1f7fe640 1 -- 172.21.15.2:0/2534198559 <== osd.10 v2:172.21.15.112:6824/105615908 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc180af670 con 0x7fbc180acba0 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.977+0000 7fbc349d6640 1 -- 172.21.15.2:0/2534198559 --> [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbc30062cc0 con 0x7fbc180acba0 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.978+0000 7fbc1f7fe640 1 -- 172.21.15.2:0/2534198559 <== osd.10 v2:172.21.15.112:6824/105615908 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbc30062cc0 con 0x7fbc180acba0 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.978+0000 7fbc349d6640 1 -- 172.21.15.2:0/2534198559 >> [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908] conn(0x7fbc180acba0 msgr2=0x7fbc180aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.978+0000 7fbc349d6640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908] conn(0x7fbc180acba0 0x7fbc180aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.978+0000 7fbc349d6640 1 -- 172.21.15.2:0/2534198559 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbc180a3350 msgr2=0x7fbc180a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:25.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.978+0000 7fbc349d6640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbc180a3350 0x7fbc180a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc24005e10 tx=0x7fbc24005da0 comp rx=0 tx=0).stop 2024-09-15T23:13:25.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.978+0000 7fbc349d6640 1 -- 172.21.15.2:0/2534198559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc30102d90 msgr2=0x7fbc301009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:25.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.978+0000 7fbc349d6640 1 --2- 172.21.15.2:0/2534198559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc30102d90 0x7fbc301009f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbc2002ae00 tx=0x7fbc20003ba0 comp rx=0 tx=0).stop 2024-09-15T23:13:25.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.979+0000 7fbc2ed9d640 1 -- 172.21.15.2:0/2534198559 reap_dead start 2024-09-15T23:13:25.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.979+0000 7fbc349d6640 1 -- 172.21.15.2:0/2534198559 shutdown_connections 2024-09-15T23:13:25.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.979+0000 7fbc349d6640 1 -- 172.21.15.2:0/2534198559 >> 172.21.15.2:0/2534198559 conn(0x7fbc300fc7d0 msgr2=0x7fbc30106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:25.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.979+0000 7fbc349d6640 1 -- 172.21.15.2:0/2534198559 shutdown_connections 2024-09-15T23:13:25.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:17.979+0000 7fbc349d6640 1 -- 172.21.15.2:0/2534198559 wait complete. 2024-09-15T23:13:25.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:25 smithi002 ceph-mon[31019]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-15T23:13:25.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:25 smithi145 ceph-mon[34901]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-15T23:13:25.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:25 smithi112 ceph-mon[34367]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-15T23:13:26.187 INFO:teuthology.orchestra.run.smithi002.stdout:154618822708 2024-09-15T23:13:26.187 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-15T23:13:26.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.356+0000 7f39c0745640 1 -- 172.21.15.2:0/4006960204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39b81036e0 msgr2=0x7f39b8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:26.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.356+0000 7f39c0745640 1 --2- 172.21.15.2:0/4006960204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39b81036e0 0x7f39b8107b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009930 tx=0x7f39ac02a420 comp rx=0 tx=0).stop 2024-09-15T23:13:26.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.356+0000 7f39c0745640 1 -- 172.21.15.2:0/4006960204 shutdown_connections 2024-09-15T23:13:26.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.356+0000 7f39c0745640 1 --2- 172.21.15.2:0/4006960204 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39b81082a0 0x7f39b810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:26.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.356+0000 7f39c0745640 1 --2- 172.21.15.2:0/4006960204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39b81036e0 0x7f39b8107b90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:26.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.356+0000 7f39c0745640 1 --2- 172.21.15.2:0/4006960204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39b8102d30 0x7f39b8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:26.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.356+0000 7f39c0745640 1 -- 172.21.15.2:0/4006960204 >> 172.21.15.2:0/4006960204 conn(0x7f39b80fc7d0 msgr2=0x7f39b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:26.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.356+0000 7f39c0745640 1 -- 172.21.15.2:0/4006960204 shutdown_connections 2024-09-15T23:13:26.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.356+0000 7f39c0745640 1 -- 172.21.15.2:0/4006960204 wait complete. 2024-09-15T23:13:26.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39c0745640 1 Processor -- start 2024-09-15T23:13:26.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39c0745640 1 -- start start 2024-09-15T23:13:26.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39c0745640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39b8102d30 0x7f39b81985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:26.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39c0745640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39b81036e0 0x7f39b8198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:26.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39c0745640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39b81082a0 0x7f39b819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:26.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39c0745640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39b8111f70 con 0x7f39b8102d30 2024-09-15T23:13:26.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39c0745640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f39b8111df0 con 0x7f39b81036e0 2024-09-15T23:13:26.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39c0745640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f39b81120f0 con 0x7f39b81082a0 2024-09-15T23:13:26.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39be4e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39b8102d30 0x7f39b81985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39be4e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39b8102d30 0x7f39b81985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34006/0 (socket says 172.21.15.2:34006) 2024-09-15T23:13:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39be4e1640 1 -- 172.21.15.2:0/1978376808 learned_addr learned my addr 172.21.15.2:0/1978376808 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39bdce0640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39b81036e0 0x7f39b8198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39be4e1640 1 -- 172.21.15.2:0/1978376808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39b81082a0 msgr2=0x7f39b819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.357+0000 7f39bece2640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39b81082a0 0x7f39b819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.358+0000 7f39be4e1640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39b81082a0 0x7f39b819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.358+0000 7f39be4e1640 1 -- 172.21.15.2:0/1978376808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39b81036e0 msgr2=0x7f39b8198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.358+0000 7f39be4e1640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39b81036e0 0x7f39b8198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.358+0000 7f39be4e1640 1 -- 172.21.15.2:0/1978376808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b819d570 con 0x7f39b8102d30 2024-09-15T23:13:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.358+0000 7f39bece2640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39b81082a0 0x7f39b819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.358+0000 7f39bdce0640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f39b81036e0 0x7f39b8198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.358+0000 7f39be4e1640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39b8102d30 0x7f39b81985c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f39b400eab0 tx=0x7f39b400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.358+0000 7f39ab7fe640 1 -- 172.21.15.2:0/1978376808 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b400ce40 con 0x7f39b8102d30 2024-09-15T23:13:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.358+0000 7f39c0745640 1 -- 172.21.15.2:0/1978376808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b819d860 con 0x7f39b8102d30 2024-09-15T23:13:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.358+0000 7f39ab7fe640 1 -- 172.21.15.2:0/1978376808 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39b4011920 con 0x7f39b8102d30 2024-09-15T23:13:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.358+0000 7f39ab7fe640 1 -- 172.21.15.2:0/1978376808 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4010a00 con 0x7f39b8102d30 2024-09-15T23:13:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.358+0000 7f39c0745640 1 -- 172.21.15.2:0/1978376808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b81a5140 con 0x7f39b8102d30 2024-09-15T23:13:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.359+0000 7f39c0745640 1 -- 172.21.15.2:0/1978376808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39b80628c0 con 0x7f39b8102d30 2024-09-15T23:13:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.360+0000 7f39ab7fe640 1 -- 172.21.15.2:0/1978376808 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f39b4011ad0 con 0x7f39b8102d30 2024-09-15T23:13:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.361+0000 7f39ab7fe640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f39a40a32d0 0x7f39a40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.361+0000 7f39ab7fe640 1 -- 172.21.15.2:0/1978376808 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f39b40cffa0 con 0x7f39b8102d30 2024-09-15T23:13:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.361+0000 7f39bdce0640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f39a40a32d0 0x7f39a40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.361+0000 7f39ab7fe640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289] conn(0x7f39a40acb20 0x7f39a40aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.361+0000 7f39ab7fe640 1 -- 172.21.15.2:0/1978376808 --> [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39a40af5f0 con 0x7f39a40acb20 2024-09-15T23:13:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.361+0000 7f39ab7fe640 1 -- 172.21.15.2:0/1978376808 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f39b40d0480 con 0x7f39b8102d30 2024-09-15T23:13:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.362+0000 7f39bece2640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289] conn(0x7f39a40acb20 0x7f39a40aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.362+0000 7f39bdce0640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f39a40a32d0 0x7f39a40a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009900 tx=0x7f39ac032d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.362+0000 7f39bece2640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289] conn(0x7f39a40acb20 0x7f39a40aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.363+0000 7f39ab7fe640 1 -- 172.21.15.2:0/1978376808 <== osd.11 v2:172.21.15.145:6824/430484289 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f39a40af5f0 con 0x7f39a40acb20 2024-09-15T23:13:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.377+0000 7f39c0745640 1 -- 172.21.15.2:0/1978376808 --> [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f39b8062cc0 con 0x7f39a40acb20 2024-09-15T23:13:26.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.377+0000 7f39ab7fe640 1 -- 172.21.15.2:0/1978376808 <== osd.11 v2:172.21.15.145:6824/430484289 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f39b8062cc0 con 0x7f39a40acb20 2024-09-15T23:13:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.378+0000 7f39c0745640 1 -- 172.21.15.2:0/1978376808 >> [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289] conn(0x7f39a40acb20 msgr2=0x7f39a40aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.378+0000 7f39c0745640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289] conn(0x7f39a40acb20 0x7f39a40aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.378+0000 7f39c0745640 1 -- 172.21.15.2:0/1978376808 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f39a40a32d0 msgr2=0x7f39a40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.378+0000 7f39c0745640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f39a40a32d0 0x7f39a40a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009900 tx=0x7f39ac032d00 comp rx=0 tx=0).stop 2024-09-15T23:13:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.378+0000 7f39c0745640 1 -- 172.21.15.2:0/1978376808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39b8102d30 msgr2=0x7f39b81985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.378+0000 7f39c0745640 1 --2- 172.21.15.2:0/1978376808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39b8102d30 0x7f39b81985c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f39b400eab0 tx=0x7f39b400ef70 comp rx=0 tx=0).stop 2024-09-15T23:13:26.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.378+0000 7f39bece2640 1 -- 172.21.15.2:0/1978376808 reap_dead start 2024-09-15T23:13:26.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.378+0000 7f39c0745640 1 -- 172.21.15.2:0/1978376808 shutdown_connections 2024-09-15T23:13:26.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.378+0000 7f39c0745640 1 -- 172.21.15.2:0/1978376808 >> 172.21.15.2:0/1978376808 conn(0x7f39b80fc7d0 msgr2=0x7f39b8105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:26.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.378+0000 7f39c0745640 1 -- 172.21.15.2:0/1978376808 shutdown_connections 2024-09-15T23:13:26.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.378+0000 7f39c0745640 1 -- 172.21.15.2:0/1978376808 wait complete. 2024-09-15T23:13:26.723 INFO:teuthology.orchestra.run.smithi002.stdout:292057776153 2024-09-15T23:13:26.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-15T23:13:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.877+0000 7f70c0cf1640 1 -- 172.21.15.2:0/458421740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70bc100e20 msgr2=0x7f70bc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.877+0000 7f70c0cf1640 1 --2- 172.21.15.2:0/458421740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70bc100e20 0x7f70bc101200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009900 tx=0x7f70ac02a480 comp rx=0 tx=0).stop 2024-09-15T23:13:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.877+0000 7f70c0cf1640 1 -- 172.21.15.2:0/458421740 shutdown_connections 2024-09-15T23:13:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.877+0000 7f70c0cf1640 1 --2- 172.21.15.2:0/458421740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70bc102ef0 0x7f70bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.877+0000 7f70c0cf1640 1 --2- 172.21.15.2:0/458421740 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70bc102570 0x7f70bc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.877+0000 7f70c0cf1640 1 --2- 172.21.15.2:0/458421740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70bc100e20 0x7f70bc101200 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.877+0000 7f70c0cf1640 1 -- 172.21.15.2:0/458421740 >> 172.21.15.2:0/458421740 conn(0x7f70bc0fc7d0 msgr2=0x7f70bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.877+0000 7f70c0cf1640 1 -- 172.21.15.2:0/458421740 shutdown_connections 2024-09-15T23:13:26.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.877+0000 7f70c0cf1640 1 -- 172.21.15.2:0/458421740 wait complete. 2024-09-15T23:13:26.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.878+0000 7f70c0cf1640 1 Processor -- start 2024-09-15T23:13:26.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.878+0000 7f70c0cf1640 1 -- start start 2024-09-15T23:13:26.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.878+0000 7f70c0cf1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70bc100e20 0x7f70bc0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:26.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.878+0000 7f70c0cf1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70bc102570 0x7f70bc0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:26.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.878+0000 7f70c0cf1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70bc102ef0 0x7f70bc0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:26.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.878+0000 7f70c0cf1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc110e00 con 0x7f70bc100e20 2024-09-15T23:13:26.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.878+0000 7f70c0cf1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc110c80 con 0x7f70bc102570 2024-09-15T23:13:26.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.878+0000 7f70c0cf1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc110f80 con 0x7f70bc102ef0 2024-09-15T23:13:26.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.878+0000 7f70ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70bc100e20 0x7f70bc0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:26.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70ba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70bc100e20 0x7f70bc0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44790/0 (socket says 172.21.15.2:44790) 2024-09-15T23:13:26.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70ba59c640 1 -- 172.21.15.2:0/472076861 learned_addr learned my addr 172.21.15.2:0/472076861 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:26.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70b9d9b640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70bc102570 0x7f70bc0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:26.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70bad9d640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70bc102ef0 0x7f70bc0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:26.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70ba59c640 1 -- 172.21.15.2:0/472076861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70bc102ef0 msgr2=0x7f70bc0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:26.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70ba59c640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70bc102ef0 0x7f70bc0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:26.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70ba59c640 1 -- 172.21.15.2:0/472076861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70bc102570 msgr2=0x7f70bc0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:26.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70ba59c640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f70bc102570 0x7f70bc0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:26.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70ba59c640 1 -- 172.21.15.2:0/472076861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc1a68c0 con 0x7f70bc100e20 2024-09-15T23:13:26.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70bad9d640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70bc102ef0 0x7f70bc0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:26.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70ba59c640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70bc100e20 0x7f70bc0fcc80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f70ac006010 tx=0x7f70ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:26.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70ab7fe640 1 -- 172.21.15.2:0/472076861 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac03f030 con 0x7f70bc100e20 2024-09-15T23:13:26.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70ab7fe640 1 -- 172.21.15.2:0/472076861 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70ac003cb0 con 0x7f70bc100e20 2024-09-15T23:13:26.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70ab7fe640 1 -- 172.21.15.2:0/472076861 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac035070 con 0x7f70bc100e20 2024-09-15T23:13:26.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70c0cf1640 1 -- 172.21.15.2:0/472076861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70bc1a6b50 con 0x7f70bc100e20 2024-09-15T23:13:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.879+0000 7f70c0cf1640 1 -- 172.21.15.2:0/472076861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70bc1a6fe0 con 0x7f70bc100e20 2024-09-15T23:13:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.880+0000 7f70c0cf1640 1 -- 172.21.15.2:0/472076861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f70bc107260 con 0x7f70bc100e20 2024-09-15T23:13:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.882+0000 7f70ab7fe640 1 -- 172.21.15.2:0/472076861 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f70ac042030 con 0x7f70bc100e20 2024-09-15T23:13:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.883+0000 7f70ab7fe640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f70a40a32d0 0x7f70a40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.883+0000 7f70b9d9b640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f70a40a32d0 0x7f70a40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.883+0000 7f70ab7fe640 1 -- 172.21.15.2:0/472076861 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f70ac0f05b0 con 0x7f70bc100e20 2024-09-15T23:13:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.883+0000 7f70ab7fe640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540] conn(0x7f70a40acb20 0x7f70a40aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.883+0000 7f70ab7fe640 1 -- 172.21.15.2:0/472076861 --> [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70ac007e80 con 0x7f70a40acb20 2024-09-15T23:13:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.883+0000 7f70ab7fe640 1 -- 172.21.15.2:0/472076861 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f70ac0f0960 con 0x7f70bc100e20 2024-09-15T23:13:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.883+0000 7f70b9d9b640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f70a40a32d0 0x7f70a40a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0fe710 tx=0x7f70b000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.883+0000 7f70bad9d640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540] conn(0x7f70a40acb20 0x7f70a40aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.884+0000 7f70bad9d640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540] conn(0x7f70a40acb20 0x7f70a40aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.885+0000 7f70ab7fe640 1 -- 172.21.15.2:0/472076861 <== osd.8 v2:172.21.15.145:6816/3634470540 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f70ac007e80 con 0x7f70a40acb20 2024-09-15T23:13:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.898+0000 7f70c0cf1640 1 -- 172.21.15.2:0/472076861 --> [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f70bc1021b0 con 0x7f70a40acb20 2024-09-15T23:13:26.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.899+0000 7f70ab7fe640 1 -- 172.21.15.2:0/472076861 <== osd.8 v2:172.21.15.145:6816/3634470540 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f70bc1021b0 con 0x7f70a40acb20 2024-09-15T23:13:26.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.899+0000 7f70c0cf1640 1 -- 172.21.15.2:0/472076861 >> [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540] conn(0x7f70a40acb20 msgr2=0x7f70a40aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:26.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.899+0000 7f70c0cf1640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540] conn(0x7f70a40acb20 0x7f70a40aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:26.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.900+0000 7f70c0cf1640 1 -- 172.21.15.2:0/472076861 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f70a40a32d0 msgr2=0x7f70a40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:26.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.900+0000 7f70c0cf1640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f70a40a32d0 0x7f70a40a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0fe710 tx=0x7f70b000b410 comp rx=0 tx=0).stop 2024-09-15T23:13:26.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.900+0000 7f70c0cf1640 1 -- 172.21.15.2:0/472076861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70bc100e20 msgr2=0x7f70bc0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:26.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.900+0000 7f70c0cf1640 1 --2- 172.21.15.2:0/472076861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70bc100e20 0x7f70bc0fcc80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f70ac006010 tx=0x7f70ac0042f0 comp rx=0 tx=0).stop 2024-09-15T23:13:26.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.900+0000 7f70bad9d640 1 -- 172.21.15.2:0/472076861 reap_dead start 2024-09-15T23:13:26.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.900+0000 7f70c0cf1640 1 -- 172.21.15.2:0/472076861 shutdown_connections 2024-09-15T23:13:26.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.900+0000 7f70c0cf1640 1 -- 172.21.15.2:0/472076861 >> 172.21.15.2:0/472076861 conn(0x7f70bc0fc7d0 msgr2=0x7f70bc069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:26.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.900+0000 7f70c0cf1640 1 -- 172.21.15.2:0/472076861 shutdown_connections 2024-09-15T23:13:26.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:26.900+0000 7f70c0cf1640 1 -- 172.21.15.2:0/472076861 wait complete. 2024-09-15T23:13:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:27 smithi002 ceph-mon[31019]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:27.614 INFO:teuthology.orchestra.run.smithi002.stdout:103079215168 2024-09-15T23:13:27.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-15T23:13:27.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:27 smithi145 ceph-mon[34901]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:27 smithi112 ceph-mon[34367]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:28.290 INFO:teuthology.orchestra.run.smithi002.stdout:322122547223 2024-09-15T23:13:28.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-15T23:13:28.753 INFO:teuthology.orchestra.run.smithi002.stdout:236223201318 2024-09-15T23:13:28.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-15T23:13:28.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.950+0000 7fc26d787640 1 -- 172.21.15.2:0/2497513222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc268074510 msgr2=0x7fc2680748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:28.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.950+0000 7fc26d787640 1 --2- 172.21.15.2:0/2497513222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc268074510 0x7fc2680748f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc250009900 tx=0x7fc25002a480 comp rx=0 tx=0).stop 2024-09-15T23:13:28.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.951+0000 7fc26d787640 1 -- 172.21.15.2:0/2497513222 shutdown_connections 2024-09-15T23:13:28.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.951+0000 7fc26d787640 1 --2- 172.21.15.2:0/2497513222 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc26810e450 0x7fc268110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:28.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.951+0000 7fc26d787640 1 --2- 172.21.15.2:0/2497513222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc268074e30 0x7fc26810df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:28.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.951+0000 7fc26d787640 1 --2- 172.21.15.2:0/2497513222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc268074510 0x7fc2680748f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:28.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.951+0000 7fc26d787640 1 -- 172.21.15.2:0/2497513222 >> 172.21.15.2:0/2497513222 conn(0x7fc2680fd8f0 msgr2=0x7fc2680ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:28.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.951+0000 7fc26d787640 1 -- 172.21.15.2:0/2497513222 shutdown_connections 2024-09-15T23:13:28.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.951+0000 7fc26d787640 1 -- 172.21.15.2:0/2497513222 wait complete. 2024-09-15T23:13:28.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.951+0000 7fc26d787640 1 Processor -- start 2024-09-15T23:13:28.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc26d787640 1 -- start start 2024-09-15T23:13:28.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc26d787640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc268074510 0x7fc26819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc26d787640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc268074e30 0x7fc26819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc26d787640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc26810e450 0x7fc26819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc26d787640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc268114080 con 0x7fc268074e30 2024-09-15T23:13:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc26d787640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc268113f00 con 0x7fc26810e450 2024-09-15T23:13:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc26d787640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc268114200 con 0x7fc268074510 2024-09-15T23:13:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc2667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc268074e30 0x7fc26819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc2667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc268074e30 0x7fc26819ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44812/0 (socket says 172.21.15.2:44812) 2024-09-15T23:13:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc2667fc640 1 -- 172.21.15.2:0/991247783 learned_addr learned my addr 172.21.15.2:0/991247783 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc266ffd640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc268074510 0x7fc26819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc2677fe640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc26810e450 0x7fc26819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc2667fc640 1 -- 172.21.15.2:0/991247783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc268074510 msgr2=0x7fc26819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc2667fc640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc268074510 0x7fc26819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:28.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc2667fc640 1 -- 172.21.15.2:0/991247783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc26810e450 msgr2=0x7fc26819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc2667fc640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc26810e450 0x7fc26819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.952+0000 7fc2667fc640 1 -- 172.21.15.2:0/991247783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26819f570 con 0x7fc268074e30 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.953+0000 7fc2667fc640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc268074e30 0x7fc26819ab00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc25800b4a0 tx=0x7fc25800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.953+0000 7fc25ffff640 1 -- 172.21.15.2:0/991247783 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc258014070 con 0x7fc268074e30 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.953+0000 7fc25ffff640 1 -- 172.21.15.2:0/991247783 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc258010ac0 con 0x7fc268074e30 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.953+0000 7fc26d787640 1 -- 172.21.15.2:0/991247783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26819f860 con 0x7fc268074e30 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.953+0000 7fc25ffff640 1 -- 172.21.15.2:0/991247783 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc258017c30 con 0x7fc268074e30 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.953+0000 7fc26d787640 1 -- 172.21.15.2:0/991247783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2681a7140 con 0x7fc268074e30 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.954+0000 7fc26d787640 1 -- 172.21.15.2:0/991247783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc268062980 con 0x7fc268074e30 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.955+0000 7fc25ffff640 1 -- 172.21.15.2:0/991247783 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc258017070 con 0x7fc268074e30 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.956+0000 7fc25ffff640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc2540a3350 0x7fc2540a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.956+0000 7fc266ffd640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc2540a3350 0x7fc2540a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.956+0000 7fc25ffff640 1 -- 172.21.15.2:0/991247783 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fc2580cef40 con 0x7fc268074e30 2024-09-15T23:13:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.956+0000 7fc25ffff640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191] conn(0x7fc2540acba0 0x7fc2540aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.956+0000 7fc25ffff640 1 -- 172.21.15.2:0/991247783 --> [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2540af670 con 0x7fc2540acba0 2024-09-15T23:13:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.956+0000 7fc25ffff640 1 -- 172.21.15.2:0/991247783 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fc2580cf2f0 con 0x7fc268074e30 2024-09-15T23:13:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.956+0000 7fc266ffd640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc2540a3350 0x7fc2540a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc250031440 tx=0x7fc250005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.957+0000 7fc2677fe640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191] conn(0x7fc2540acba0 0x7fc2540aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.957+0000 7fc2677fe640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191] conn(0x7fc2540acba0 0x7fc2540aefc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.958+0000 7fc25ffff640 1 -- 172.21.15.2:0/991247783 <== osd.7 v2:172.21.15.112:6816/830628191 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2540af670 con 0x7fc2540acba0 2024-09-15T23:13:28.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.975+0000 7fc26d787640 1 -- 172.21.15.2:0/991247783 --> [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc268062d80 con 0x7fc2540acba0 2024-09-15T23:13:28.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.975+0000 7fc25ffff640 1 -- 172.21.15.2:0/991247783 <== osd.7 v2:172.21.15.112:6816/830628191 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc268062d80 con 0x7fc2540acba0 2024-09-15T23:13:28.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.976+0000 7fc26d787640 1 -- 172.21.15.2:0/991247783 >> [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191] conn(0x7fc2540acba0 msgr2=0x7fc2540aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:28.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.976+0000 7fc26d787640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191] conn(0x7fc2540acba0 0x7fc2540aefc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:28.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.976+0000 7fc26d787640 1 -- 172.21.15.2:0/991247783 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc2540a3350 msgr2=0x7fc2540a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:28.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.976+0000 7fc26d787640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc2540a3350 0x7fc2540a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc250031440 tx=0x7fc250005e80 comp rx=0 tx=0).stop 2024-09-15T23:13:28.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.976+0000 7fc26d787640 1 -- 172.21.15.2:0/991247783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc268074e30 msgr2=0x7fc26819ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:28.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.976+0000 7fc26d787640 1 --2- 172.21.15.2:0/991247783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc268074e30 0x7fc26819ab00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc25800b4a0 tx=0x7fc25800b960 comp rx=0 tx=0).stop 2024-09-15T23:13:28.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.976+0000 7fc2677fe640 1 -- 172.21.15.2:0/991247783 reap_dead start 2024-09-15T23:13:28.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.976+0000 7fc26d787640 1 -- 172.21.15.2:0/991247783 shutdown_connections 2024-09-15T23:13:28.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.976+0000 7fc26d787640 1 -- 172.21.15.2:0/991247783 >> 172.21.15.2:0/991247783 conn(0x7fc2680fd8f0 msgr2=0x7fc2680ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:28.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.976+0000 7fc26d787640 1 -- 172.21.15.2:0/991247783 shutdown_connections 2024-09-15T23:13:28.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:28.976+0000 7fc26d787640 1 -- 172.21.15.2:0/991247783 wait complete. 2024-09-15T23:13:29.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.419+0000 7f5177b54640 1 -- 172.21.15.2:0/374049922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51701082a0 msgr2=0x7f517010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:29.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.419+0000 7f5177b54640 1 --2- 172.21.15.2:0/374049922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51701082a0 0x7f517010ec40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5168009930 tx=0x7f516802a420 comp rx=0 tx=0).stop 2024-09-15T23:13:29.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.419+0000 7f5177b54640 1 -- 172.21.15.2:0/374049922 shutdown_connections 2024-09-15T23:13:29.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 --2- 172.21.15.2:0/374049922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51701082a0 0x7f517010ec40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:29.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 --2- 172.21.15.2:0/374049922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51701036e0 0x7f5170107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:29.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 --2- 172.21.15.2:0/374049922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5170102d30 0x7f5170103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:29.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 -- 172.21.15.2:0/374049922 >> 172.21.15.2:0/374049922 conn(0x7f51700fc7d0 msgr2=0x7f51700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:29.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 -- 172.21.15.2:0/374049922 shutdown_connections 2024-09-15T23:13:29.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 -- 172.21.15.2:0/374049922 wait complete. 2024-09-15T23:13:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 Processor -- start 2024-09-15T23:13:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 -- start start 2024-09-15T23:13:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5170102d30 0x7f5170198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51701036e0 0x7f5170198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51701082a0 0x7f517019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5170111f50 con 0x7f5170102d30 2024-09-15T23:13:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5170111dd0 con 0x7f51701036e0 2024-09-15T23:13:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.420+0000 7f5177b54640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f51701120d0 con 0x7f51701082a0 2024-09-15T23:13:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f51758f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5170102d30 0x7f5170198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f51758f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5170102d30 0x7f5170198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44830/0 (socket says 172.21.15.2:44830) 2024-09-15T23:13:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f51758f0640 1 -- 172.21.15.2:0/636095644 learned_addr learned my addr 172.21.15.2:0/636095644 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f51750ef640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51701036e0 0x7f5170198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:29.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f51760f1640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51701082a0 0x7f517019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f51758f0640 1 -- 172.21.15.2:0/636095644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51701082a0 msgr2=0x7f517019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f51758f0640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51701082a0 0x7f517019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f51758f0640 1 -- 172.21.15.2:0/636095644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51701036e0 msgr2=0x7f5170198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f51758f0640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51701036e0 0x7f5170198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f51758f0640 1 -- 172.21.15.2:0/636095644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f517019d3d0 con 0x7f5170102d30 2024-09-15T23:13:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f51750ef640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51701036e0 0x7f5170198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f51760f1640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51701082a0 0x7f517019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f51758f0640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5170102d30 0x7f5170198420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f516000cce0 tx=0x7f516000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f516effd640 1 -- 172.21.15.2:0/636095644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160004b20 con 0x7f5170102d30 2024-09-15T23:13:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f516effd640 1 -- 172.21.15.2:0/636095644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5160004cc0 con 0x7f5170102d30 2024-09-15T23:13:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f5177b54640 1 -- 172.21.15.2:0/636095644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f517019d6c0 con 0x7f5170102d30 2024-09-15T23:13:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f516effd640 1 -- 172.21.15.2:0/636095644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516000f6b0 con 0x7f5170102d30 2024-09-15T23:13:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.421+0000 7f5177b54640 1 -- 172.21.15.2:0/636095644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51701a4fa0 con 0x7f5170102d30 2024-09-15T23:13:29.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.422+0000 7f5177b54640 1 -- 172.21.15.2:0/636095644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5170062940 con 0x7f5170102d30 2024-09-15T23:13:29.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.423+0000 7f516effd640 1 -- 172.21.15.2:0/636095644 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f516000f850 con 0x7f5170102d30 2024-09-15T23:13:29.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.424+0000 7f516effd640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f51580a32d0 0x7f51580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:29.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.424+0000 7f51750ef640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f51580a32d0 0x7f51580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:29.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.424+0000 7f516effd640 1 -- 172.21.15.2:0/636095644 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f51600cfed0 con 0x7f5170102d30 2024-09-15T23:13:29.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.424+0000 7f516effd640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437] conn(0x7f51580acb20 0x7f51580aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:29.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.424+0000 7f516effd640 1 -- 172.21.15.2:0/636095644 --> [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51580af5f0 con 0x7f51580acb20 2024-09-15T23:13:29.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.424+0000 7f516effd640 1 -- 172.21.15.2:0/636095644 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f51600d0280 con 0x7f5170102d30 2024-09-15T23:13:29.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.425+0000 7f51750ef640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f51580a32d0 0x7f51580a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f51700fee80 tx=0x7f5164005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:29.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.425+0000 7f51760f1640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437] conn(0x7f51580acb20 0x7f51580aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:29.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.425+0000 7f51760f1640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437] conn(0x7f51580acb20 0x7f51580aef40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:29.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.426+0000 7f516effd640 1 -- 172.21.15.2:0/636095644 <== osd.2 v2:172.21.15.145:6800/3485615437 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f51580af5f0 con 0x7f51580acb20 2024-09-15T23:13:29.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.442+0000 7f5177b54640 1 -- 172.21.15.2:0/636095644 --> [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5170062dc0 con 0x7f51580acb20 2024-09-15T23:13:29.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.442+0000 7f516effd640 1 -- 172.21.15.2:0/636095644 <== osd.2 v2:172.21.15.145:6800/3485615437 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5170062dc0 con 0x7f51580acb20 2024-09-15T23:13:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.443+0000 7f5177b54640 1 -- 172.21.15.2:0/636095644 >> [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437] conn(0x7f51580acb20 msgr2=0x7f51580aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.443+0000 7f5177b54640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437] conn(0x7f51580acb20 0x7f51580aef40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.443+0000 7f5177b54640 1 -- 172.21.15.2:0/636095644 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f51580a32d0 msgr2=0x7f51580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.443+0000 7f5177b54640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f51580a32d0 0x7f51580a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f51700fee80 tx=0x7f5164005cb0 comp rx=0 tx=0).stop 2024-09-15T23:13:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.443+0000 7f5177b54640 1 -- 172.21.15.2:0/636095644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5170102d30 msgr2=0x7f5170198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.443+0000 7f5177b54640 1 --2- 172.21.15.2:0/636095644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5170102d30 0x7f5170198420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f516000cce0 tx=0x7f516000a620 comp rx=0 tx=0).stop 2024-09-15T23:13:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.443+0000 7f51760f1640 1 -- 172.21.15.2:0/636095644 reap_dead start 2024-09-15T23:13:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.443+0000 7f5177b54640 1 -- 172.21.15.2:0/636095644 shutdown_connections 2024-09-15T23:13:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.443+0000 7f5177b54640 1 -- 172.21.15.2:0/636095644 >> 172.21.15.2:0/636095644 conn(0x7f51700fc7d0 msgr2=0x7f5170105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.443+0000 7f5177b54640 1 -- 172.21.15.2:0/636095644 shutdown_connections 2024-09-15T23:13:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:29.443+0000 7f5177b54640 1 -- 172.21.15.2:0/636095644 wait complete. 2024-09-15T23:13:29.447 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:29 smithi002 ceph-mon[31019]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:29 smithi145 ceph-mon[34901]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:29.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:29 smithi112 ceph-mon[34367]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:30.393 INFO:teuthology.orchestra.run.smithi002.stdout:73014444102 2024-09-15T23:13:30.393 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-15T23:13:30.792 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:30.839 INFO:teuthology.orchestra.run.smithi002.stdout:206158430251 2024-09-15T23:13:30.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-15T23:13:31.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.119+0000 7ff3dc734640 1 -- 172.21.15.2:0/376866396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d4106a80 msgr2=0x7ff3d4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.119+0000 7ff3dc734640 1 --2- 172.21.15.2:0/376866396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d4106a80 0x7ff3d4106e60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0009930 tx=0x7ff3d002a420 comp rx=0 tx=0).stop 2024-09-15T23:13:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.119+0000 7ff3dc734640 1 -- 172.21.15.2:0/376866396 shutdown_connections 2024-09-15T23:13:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.119+0000 7ff3dc734640 1 --2- 172.21.15.2:0/376866396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3d4101420 0x7ff3d410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.119+0000 7ff3dc734640 1 --2- 172.21.15.2:0/376866396 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3d4100a80 0x7ff3d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.119+0000 7ff3dc734640 1 --2- 172.21.15.2:0/376866396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d4106a80 0x7ff3d4106e60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.119+0000 7ff3dc734640 1 -- 172.21.15.2:0/376866396 >> 172.21.15.2:0/376866396 conn(0x7ff3d40fc7a0 msgr2=0x7ff3d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.119+0000 7ff3dc734640 1 -- 172.21.15.2:0/376866396 shutdown_connections 2024-09-15T23:13:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.119+0000 7ff3dc734640 1 -- 172.21.15.2:0/376866396 wait complete. 2024-09-15T23:13:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.120+0000 7ff3dc734640 1 Processor -- start 2024-09-15T23:13:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.120+0000 7ff3dc734640 1 -- start start 2024-09-15T23:13:31.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.120+0000 7ff3dc734640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3d4100a80 0x7ff3d410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.120+0000 7ff3dc734640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3d4101420 0x7ff3d410e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.120+0000 7ff3dc734640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d4106a80 0x7ff3d410ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.120+0000 7ff3dc734640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d4111e10 con 0x7ff3d4106a80 2024-09-15T23:13:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.120+0000 7ff3dc734640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d4111c90 con 0x7ff3d4100a80 2024-09-15T23:13:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.120+0000 7ff3dc734640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d4111f90 con 0x7ff3d4101420 2024-09-15T23:13:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.120+0000 7ff3dacd1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d4106a80 0x7ff3d410ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.120+0000 7ff3dacd1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d4106a80 0x7ff3d410ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44858/0 (socket says 172.21.15.2:44858) 2024-09-15T23:13:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.120+0000 7ff3dacd1640 1 -- 172.21.15.2:0/2186155027 learned_addr learned my addr 172.21.15.2:0/2186155027 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:31.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.120+0000 7ff3da4d0640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3d4100a80 0x7ff3d410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.120+0000 7ff3d9ccf640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3d4101420 0x7ff3d410e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.121+0000 7ff3dacd1640 1 -- 172.21.15.2:0/2186155027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3d4101420 msgr2=0x7ff3d410e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.121+0000 7ff3dacd1640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3d4101420 0x7ff3d410e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.121+0000 7ff3dacd1640 1 -- 172.21.15.2:0/2186155027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3d4100a80 msgr2=0x7ff3d410e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.121+0000 7ff3dacd1640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3d4100a80 0x7ff3d410e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.121+0000 7ff3dacd1640 1 -- 172.21.15.2:0/2186155027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d41a67f0 con 0x7ff3d4106a80 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.121+0000 7ff3dacd1640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d4106a80 0x7ff3d410ee60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00eaa0 tx=0x7ff3cc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.121+0000 7ff3cb7fe640 1 -- 172.21.15.2:0/2186155027 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc00cdb0 con 0x7ff3d4106a80 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.121+0000 7ff3dc734640 1 -- 172.21.15.2:0/2186155027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d41a6ae0 con 0x7ff3d4106a80 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.121+0000 7ff3cb7fe640 1 -- 172.21.15.2:0/2186155027 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3cc005020 con 0x7ff3d4106a80 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.121+0000 7ff3cb7fe640 1 -- 172.21.15.2:0/2186155027 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0116d0 con 0x7ff3d4106a80 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.121+0000 7ff3dc734640 1 -- 172.21.15.2:0/2186155027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d41a7020 con 0x7ff3d4106a80 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.122+0000 7ff3dc734640 1 -- 172.21.15.2:0/2186155027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d4100ee0 con 0x7ff3d4106a80 2024-09-15T23:13:31.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.123+0000 7ff3cb7fe640 1 -- 172.21.15.2:0/2186155027 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff3cc0051d0 con 0x7ff3d4106a80 2024-09-15T23:13:31.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.124+0000 7ff3cb7fe640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff3c00a32d0 0x7ff3c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:31.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.124+0000 7ff3da4d0640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff3c00a32d0 0x7ff3c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:31.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.124+0000 7ff3cb7fe640 1 -- 172.21.15.2:0/2186155027 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7ff3cc0cfa80 con 0x7ff3d4106a80 2024-09-15T23:13:31.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.124+0000 7ff3da4d0640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff3c00a32d0 0x7ff3c00a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0009900 tx=0x7ff3d0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:31.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.128+0000 7ff3cb7fe640 1 -- 172.21.15.2:0/2186155027 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3cc016030 con 0x7ff3d4106a80 2024-09-15T23:13:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:31.301 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:31.302 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:31.303 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:31.307 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:31.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:31 smithi002 ceph-mon[31019]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:13:31.315 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:31.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.355+0000 7ff3dc734640 1 -- 172.21.15.2:0/2186155027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7ff3d402d7c0 con 0x7ff3d4106a80 2024-09-15T23:13:31.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.355+0000 7ff3cb7fe640 1 -- 172.21.15.2:0/2186155027 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff3cc09c7f0 con 0x7ff3d4106a80 2024-09-15T23:13:31.356 INFO:teuthology.orchestra.run.smithi002.stdout:270582939682 2024-09-15T23:13:31.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.358+0000 7ff3dc734640 1 -- 172.21.15.2:0/2186155027 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff3c00a32d0 msgr2=0x7ff3c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:31.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.358+0000 7ff3dc734640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff3c00a32d0 0x7ff3c00a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0009900 tx=0x7ff3d0000bc0 comp rx=0 tx=0).stop 2024-09-15T23:13:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.358+0000 7ff3dc734640 1 -- 172.21.15.2:0/2186155027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d4106a80 msgr2=0x7ff3d410ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.358+0000 7ff3dc734640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d4106a80 0x7ff3d410ee60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00eaa0 tx=0x7ff3cc00ef60 comp rx=0 tx=0).stop 2024-09-15T23:13:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.358+0000 7ff3dc734640 1 -- 172.21.15.2:0/2186155027 shutdown_connections 2024-09-15T23:13:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.358+0000 7ff3dc734640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff3c00a32d0 0x7ff3c00a5790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.358+0000 7ff3dc734640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3d4106a80 0x7ff3d410ee60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.358+0000 7ff3dc734640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3d4101420 0x7ff3d410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.358+0000 7ff3dc734640 1 --2- 172.21.15.2:0/2186155027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3d4100a80 0x7ff3d410e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.358+0000 7ff3dc734640 1 -- 172.21.15.2:0/2186155027 >> 172.21.15.2:0/2186155027 conn(0x7ff3d40fc7a0 msgr2=0x7ff3d40fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.358+0000 7ff3dc734640 1 -- 172.21.15.2:0/2186155027 shutdown_connections 2024-09-15T23:13:31.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:31.358+0000 7ff3dc734640 1 -- 172.21.15.2:0/2186155027 wait complete. 2024-09-15T23:13:31.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:31 smithi145 ceph-mon[34901]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:13:31.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:31 smithi112 ceph-mon[34367]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:13:32.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.016+0000 7f953899b640 1 -- 172.21.15.2:0/3000699430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95341036e0 msgr2=0x7f9534107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.016+0000 7f953899b640 1 --2- 172.21.15.2:0/3000699430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95341036e0 0x7f9534107b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9528009930 tx=0x7f952802a420 comp rx=0 tx=0).stop 2024-09-15T23:13:32.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.016+0000 7f953899b640 1 -- 172.21.15.2:0/3000699430 shutdown_connections 2024-09-15T23:13:32.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.016+0000 7f953899b640 1 --2- 172.21.15.2:0/3000699430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95341082a0 0x7f953410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.016+0000 7f953899b640 1 --2- 172.21.15.2:0/3000699430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95341036e0 0x7f9534107b90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.016+0000 7f953899b640 1 --2- 172.21.15.2:0/3000699430 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9534102d30 0x7f9534103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.016+0000 7f953899b640 1 -- 172.21.15.2:0/3000699430 >> 172.21.15.2:0/3000699430 conn(0x7f95340fc7d0 msgr2=0x7f95340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.016+0000 7f953899b640 1 -- 172.21.15.2:0/3000699430 shutdown_connections 2024-09-15T23:13:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.016+0000 7f953899b640 1 -- 172.21.15.2:0/3000699430 wait complete. 2024-09-15T23:13:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953899b640 1 Processor -- start 2024-09-15T23:13:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953899b640 1 -- start start 2024-09-15T23:13:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953899b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102d30 0x7f95341983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953899b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95341036e0 0x7f9534198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953899b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95341082a0 0x7f953419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953899b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9534111f10 con 0x7f9534102d30 2024-09-15T23:13:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953899b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9534111d90 con 0x7f95341036e0 2024-09-15T23:13:32.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953899b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9534112090 con 0x7f95341082a0 2024-09-15T23:13:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102d30 0x7f95341983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102d30 0x7f95341983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44878/0 (socket says 172.21.15.2:44878) 2024-09-15T23:13:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953259c640 1 -- 172.21.15.2:0/2896497150 learned_addr learned my addr 172.21.15.2:0/2896497150 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f9531d9b640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95341036e0 0x7f9534198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f9532d9d640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95341082a0 0x7f953419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953259c640 1 -- 172.21.15.2:0/2896497150 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95341082a0 msgr2=0x7f953419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953259c640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95341082a0 0x7f953419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953259c640 1 -- 172.21.15.2:0/2896497150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95341036e0 msgr2=0x7f9534198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953259c640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95341036e0 0x7f9534198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.017+0000 7f953259c640 1 -- 172.21.15.2:0/2896497150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953419d390 con 0x7f9534102d30 2024-09-15T23:13:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.018+0000 7f953259c640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102d30 0x7f95341983e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f952400cce0 tx=0x7f952400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.018+0000 7f95237fe640 1 -- 172.21.15.2:0/2896497150 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952400f650 con 0x7f9534102d30 2024-09-15T23:13:32.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.018+0000 7f95237fe640 1 -- 172.21.15.2:0/2896497150 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f952400fca0 con 0x7f9534102d30 2024-09-15T23:13:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.018+0000 7f953899b640 1 -- 172.21.15.2:0/2896497150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953419d680 con 0x7f9534102d30 2024-09-15T23:13:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.018+0000 7f95237fe640 1 -- 172.21.15.2:0/2896497150 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524018b90 con 0x7f9534102d30 2024-09-15T23:13:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.018+0000 7f953899b640 1 -- 172.21.15.2:0/2896497150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95341a4f60 con 0x7f9534102d30 2024-09-15T23:13:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.019+0000 7f953899b640 1 -- 172.21.15.2:0/2896497150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9534103110 con 0x7f9534102d30 2024-09-15T23:13:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.020+0000 7f95237fe640 1 -- 172.21.15.2:0/2896497150 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f952400f7f0 con 0x7f9534102d30 2024-09-15T23:13:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.021+0000 7f95237fe640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f951c0a3350 0x7f951c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.021+0000 7f95237fe640 1 -- 172.21.15.2:0/2896497150 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f95240d01c0 con 0x7f9534102d30 2024-09-15T23:13:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.021+0000 7f9531d9b640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f951c0a3350 0x7f951c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.022+0000 7f9531d9b640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f951c0a3350 0x7f951c0a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9528009900 tx=0x7f9528031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:32.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.025+0000 7f95237fe640 1 -- 172.21.15.2:0/2896497150 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9524014030 con 0x7f9534102d30 2024-09-15T23:13:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.202+0000 7f953899b640 1 -- 172.21.15.2:0/2896497150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f953410a2b0 con 0x7f9534102d30 2024-09-15T23:13:32.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.203+0000 7f95237fe640 1 -- 172.21.15.2:0/2896497150 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f952409cf40 con 0x7f9534102d30 2024-09-15T23:13:32.204 INFO:teuthology.orchestra.run.smithi002.stdout:55834574923 2024-09-15T23:13:32.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.205+0000 7f953899b640 1 -- 172.21.15.2:0/2896497150 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f951c0a3350 msgr2=0x7f951c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.205+0000 7f953899b640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f951c0a3350 0x7f951c0a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9528009900 tx=0x7f9528031400 comp rx=0 tx=0).stop 2024-09-15T23:13:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.205+0000 7f953899b640 1 -- 172.21.15.2:0/2896497150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102d30 msgr2=0x7f95341983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.205+0000 7f953899b640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102d30 0x7f95341983e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f952400cce0 tx=0x7f952400a620 comp rx=0 tx=0).stop 2024-09-15T23:13:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.205+0000 7f953899b640 1 -- 172.21.15.2:0/2896497150 shutdown_connections 2024-09-15T23:13:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.205+0000 7f953899b640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f951c0a3350 0x7f951c0a5810 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.205+0000 7f953899b640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95341082a0 0x7f953419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.205+0000 7f953899b640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f95341036e0 0x7f9534198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.205+0000 7f953899b640 1 --2- 172.21.15.2:0/2896497150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102d30 0x7f95341983e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.205+0000 7f953899b640 1 -- 172.21.15.2:0/2896497150 >> 172.21.15.2:0/2896497150 conn(0x7f95340fc7d0 msgr2=0x7f9534105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.205+0000 7f953899b640 1 -- 172.21.15.2:0/2896497150 shutdown_connections 2024-09-15T23:13:32.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.205+0000 7f953899b640 1 -- 172.21.15.2:0/2896497150 wait complete. 2024-09-15T23:13:32.454 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:32 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2186155027' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T23:13:32.455 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:32 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2896497150' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T23:13:32.586 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:32.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:32 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2186155027' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T23:13:32.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:32 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2896497150' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T23:13:32.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:32 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2186155027' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T23:13:32.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:32 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2896497150' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T23:13:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.756+0000 7f76909bd640 1 -- 172.21.15.2:0/1196381040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c103740 msgr2=0x7f768c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.756+0000 7f76909bd640 1 --2- 172.21.15.2:0/1196381040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c103740 0x7f768c107b80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7674009930 tx=0x7f767402a420 comp rx=0 tx=0).stop 2024-09-15T23:13:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.757+0000 7f76909bd640 1 -- 172.21.15.2:0/1196381040 shutdown_connections 2024-09-15T23:13:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.757+0000 7f76909bd640 1 --2- 172.21.15.2:0/1196381040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f768c108290 0x7f768c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.757+0000 7f76909bd640 1 --2- 172.21.15.2:0/1196381040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c103740 0x7f768c107b80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.757+0000 7f76909bd640 1 --2- 172.21.15.2:0/1196381040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f768c102d90 0x7f768c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.757+0000 7f76909bd640 1 -- 172.21.15.2:0/1196381040 >> 172.21.15.2:0/1196381040 conn(0x7f768c0fc7d0 msgr2=0x7f768c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.757+0000 7f76909bd640 1 -- 172.21.15.2:0/1196381040 shutdown_connections 2024-09-15T23:13:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.757+0000 7f76909bd640 1 -- 172.21.15.2:0/1196381040 wait complete. 2024-09-15T23:13:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.757+0000 7f76909bd640 1 Processor -- start 2024-09-15T23:13:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f76909bd640 1 -- start start 2024-09-15T23:13:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f76909bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c102d90 0x7f768c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f76909bd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f768c103740 0x7f768c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f76909bd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f768c108290 0x7f768c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f76909bd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f768c111f60 con 0x7f768c102d90 2024-09-15T23:13:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f76909bd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f768c111de0 con 0x7f768c103740 2024-09-15T23:13:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f76909bd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f768c1120e0 con 0x7f768c108290 2024-09-15T23:13:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f768a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c102d90 0x7f768c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:32.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f768a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c102d90 0x7f768c198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44906/0 (socket says 172.21.15.2:44906) 2024-09-15T23:13:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f768a59c640 1 -- 172.21.15.2:0/3524398010 learned_addr learned my addr 172.21.15.2:0/3524398010 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f768ad9d640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f768c108290 0x7f768c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f7689d9b640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f768c103740 0x7f768c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f768a59c640 1 -- 172.21.15.2:0/3524398010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f768c108290 msgr2=0x7f768c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f768a59c640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f768c108290 0x7f768c19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f768a59c640 1 -- 172.21.15.2:0/3524398010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f768c103740 msgr2=0x7f768c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f768a59c640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f768c103740 0x7f768c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f768a59c640 1 -- 172.21.15.2:0/3524398010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768c19d4f0 con 0x7f768c102d90 2024-09-15T23:13:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.758+0000 7f768a59c640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c102d90 0x7f768c198540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c890 tx=0x7f767c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.759+0000 7f76837fe640 1 -- 172.21.15.2:0/3524398010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c004220 con 0x7f768c102d90 2024-09-15T23:13:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.759+0000 7f76837fe640 1 -- 172.21.15.2:0/3524398010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f767c0043c0 con 0x7f768c102d90 2024-09-15T23:13:32.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.759+0000 7f76909bd640 1 -- 172.21.15.2:0/3524398010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768c19d7e0 con 0x7f768c102d90 2024-09-15T23:13:32.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.759+0000 7f76837fe640 1 -- 172.21.15.2:0/3524398010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c004a00 con 0x7f768c102d90 2024-09-15T23:13:32.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.759+0000 7f76909bd640 1 -- 172.21.15.2:0/3524398010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f768c1a50c0 con 0x7f768c102d90 2024-09-15T23:13:32.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.760+0000 7f76909bd640 1 -- 172.21.15.2:0/3524398010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f768c103170 con 0x7f768c102d90 2024-09-15T23:13:32.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.761+0000 7f76837fe640 1 -- 172.21.15.2:0/3524398010 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f767c004ba0 con 0x7f768c102d90 2024-09-15T23:13:32.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.762+0000 7f76837fe640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f76780a32d0 0x7f76780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:32.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.762+0000 7f7689d9b640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f76780a32d0 0x7f76780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:32.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.762+0000 7f76837fe640 1 -- 172.21.15.2:0/3524398010 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f767c0cf990 con 0x7f768c102d90 2024-09-15T23:13:32.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.763+0000 7f7689d9b640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f76780a32d0 0x7f76780a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7674006010 tx=0x7f7674000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:32.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.765+0000 7f76837fe640 1 -- 172.21.15.2:0/3524398010 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f767c014030 con 0x7f768c102d90 2024-09-15T23:13:32.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.949+0000 7f76909bd640 1 -- 172.21.15.2:0/3524398010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f768c1998a0 con 0x7f768c102d90 2024-09-15T23:13:32.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.950+0000 7f76837fe640 1 -- 172.21.15.2:0/3524398010 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f768c1998a0 con 0x7f768c102d90 2024-09-15T23:13:32.951 INFO:teuthology.orchestra.run.smithi002.stdout:103079215169 2024-09-15T23:13:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.952+0000 7f76909bd640 1 -- 172.21.15.2:0/3524398010 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f76780a32d0 msgr2=0x7f76780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.952+0000 7f76909bd640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f76780a32d0 0x7f76780a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7674006010 tx=0x7f7674000bc0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.952+0000 7f76909bd640 1 -- 172.21.15.2:0/3524398010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c102d90 msgr2=0x7f768c198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.952+0000 7f76909bd640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c102d90 0x7f768c198540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c890 tx=0x7f767c00cd50 comp rx=0 tx=0).stop 2024-09-15T23:13:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.952+0000 7f76909bd640 1 -- 172.21.15.2:0/3524398010 shutdown_connections 2024-09-15T23:13:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.952+0000 7f76909bd640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f76780a32d0 0x7f76780a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.952+0000 7f76909bd640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f768c108290 0x7f768c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.952+0000 7f76909bd640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f768c103740 0x7f768c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.952+0000 7f76909bd640 1 --2- 172.21.15.2:0/3524398010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c102d90 0x7f768c198540 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.952+0000 7f76909bd640 1 -- 172.21.15.2:0/3524398010 >> 172.21.15.2:0/3524398010 conn(0x7f768c0fc7d0 msgr2=0x7f768c105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:32.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.952+0000 7f76909bd640 1 -- 172.21.15.2:0/3524398010 shutdown_connections 2024-09-15T23:13:32.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.952+0000 7f76909bd640 1 -- 172.21.15.2:0/3524398010 wait complete. 2024-09-15T23:13:32.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.237+0000 7f75d4739640 1 -- 172.21.15.2:0/3930985779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75cc10c170 msgr2=0x7f75cc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.237+0000 7f75d4739640 1 --2- 172.21.15.2:0/3930985779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75cc10c170 0x7f75cc10e610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009ca0 tx=0x7f75c402a950 comp rx=0 tx=0).stop 2024-09-15T23:13:32.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.237+0000 7f75d4739640 1 -- 172.21.15.2:0/3930985779 shutdown_connections 2024-09-15T23:13:32.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.237+0000 7f75d4739640 1 --2- 172.21.15.2:0/3930985779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75cc10c170 0x7f75cc10e610 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.237+0000 7f75d4739640 1 --2- 172.21.15.2:0/3930985779 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc103660 0x7f75cc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.237+0000 7f75d4739640 1 --2- 172.21.15.2:0/3930985779 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75cc102d40 0x7f75cc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.237+0000 7f75d4739640 1 -- 172.21.15.2:0/3930985779 >> 172.21.15.2:0/3930985779 conn(0x7f75cc0fc7a0 msgr2=0x7f75cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.237+0000 7f75d4739640 1 -- 172.21.15.2:0/3930985779 shutdown_connections 2024-09-15T23:13:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.237+0000 7f75d4739640 1 -- 172.21.15.2:0/3930985779 wait complete. 2024-09-15T23:13:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d4739640 1 Processor -- start 2024-09-15T23:13:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d4739640 1 -- start start 2024-09-15T23:13:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d4739640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc102d40 0x7f75cc1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d4739640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75cc103660 0x7f75cc198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d4739640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75cc10c170 0x7f75cc19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d4739640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc111e20 con 0x7f75cc103660 2024-09-15T23:13:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d4739640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc111ca0 con 0x7f75cc102d40 2024-09-15T23:13:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d4739640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc111fa0 con 0x7f75cc10c170 2024-09-15T23:13:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d1cd4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75cc103660 0x7f75cc198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d1cd4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75cc103660 0x7f75cc198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44890/0 (socket says 172.21.15.2:44890) 2024-09-15T23:13:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d1cd4640 1 -- 172.21.15.2:0/1613423478 learned_addr learned my addr 172.21.15.2:0/1613423478 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:32.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d2cd6640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75cc10c170 0x7f75cc19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:32.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d24d5640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc102d40 0x7f75cc1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:32.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d1cd4640 1 -- 172.21.15.2:0/1613423478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75cc10c170 msgr2=0x7f75cc19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d1cd4640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75cc10c170 0x7f75cc19cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d1cd4640 1 -- 172.21.15.2:0/1613423478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc102d40 msgr2=0x7f75cc1982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.988 INFO:teuthology.orchestra.run.smithi002.stdout:236223201319 2024-09-15T23:13:32.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d1cd4640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc102d40 0x7f75cc1982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.238+0000 7f75d1cd4640 1 -- 172.21.15.2:0/1613423478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75cc19d270 con 0x7f75cc103660 2024-09-15T23:13:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.239+0000 7f75d1cd4640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75cc103660 0x7f75cc198800 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c970 tx=0x7f75c000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.239+0000 7f75bf7fe640 1 -- 172.21.15.2:0/1613423478 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0007bb0 con 0x7f75cc103660 2024-09-15T23:13:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.239+0000 7f75bf7fe640 1 -- 172.21.15.2:0/1613423478 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75c0007d50 con 0x7f75cc103660 2024-09-15T23:13:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.239+0000 7f75d4739640 1 -- 172.21.15.2:0/1613423478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75cc19d560 con 0x7f75cc103660 2024-09-15T23:13:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.239+0000 7f75bf7fe640 1 -- 172.21.15.2:0/1613423478 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0018780 con 0x7f75cc103660 2024-09-15T23:13:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.239+0000 7f75d4739640 1 -- 172.21.15.2:0/1613423478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75cc1008d0 con 0x7f75cc103660 2024-09-15T23:13:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.240+0000 7f75d4739640 1 -- 172.21.15.2:0/1613423478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75cc103120 con 0x7f75cc103660 2024-09-15T23:13:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.241+0000 7f75bf7fe640 1 -- 172.21.15.2:0/1613423478 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f75c000f450 con 0x7f75cc103660 2024-09-15T23:13:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.242+0000 7f75bf7fe640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f75b80a76e0 0x7f75b80a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.242+0000 7f75bf7fe640 1 -- 172.21.15.2:0/1613423478 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f75c00cfa20 con 0x7f75cc103660 2024-09-15T23:13:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.242+0000 7f75d24d5640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f75b80a76e0 0x7f75b80a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.242+0000 7f75d24d5640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f75b80a76e0 0x7f75b80a9ba0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f75c8005fd0 tx=0x7f75c8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.246+0000 7f75bf7fe640 1 -- 172.21.15.2:0/1613423478 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75c0014030 con 0x7f75cc103660 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.425+0000 7f75d4739640 1 -- 172.21.15.2:0/1613423478 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f75cc100b90 con 0x7f75cc103660 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.426+0000 7f75bf7fe640 1 -- 172.21.15.2:0/1613423478 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f75c009c690 con 0x7f75cc103660 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.428+0000 7f75d4739640 1 -- 172.21.15.2:0/1613423478 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f75b80a76e0 msgr2=0x7f75b80a9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.428+0000 7f75d4739640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f75b80a76e0 0x7f75b80a9ba0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f75c8005fd0 tx=0x7f75c8005850 comp rx=0 tx=0).stop 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.428+0000 7f75d4739640 1 -- 172.21.15.2:0/1613423478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75cc103660 msgr2=0x7f75cc198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.428+0000 7f75d4739640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75cc103660 0x7f75cc198800 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c970 tx=0x7f75c000ce30 comp rx=0 tx=0).stop 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.428+0000 7f75d4739640 1 -- 172.21.15.2:0/1613423478 shutdown_connections 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.428+0000 7f75d4739640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f75b80a76e0 0x7f75b80a9ba0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.428+0000 7f75d4739640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75cc10c170 0x7f75cc19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.428+0000 7f75d4739640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75cc103660 0x7f75cc198800 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.428+0000 7f75d4739640 1 --2- 172.21.15.2:0/1613423478 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75cc102d40 0x7f75cc1982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.428+0000 7f75d4739640 1 -- 172.21.15.2:0/1613423478 >> 172.21.15.2:0/1613423478 conn(0x7f75cc0fc7a0 msgr2=0x7f75cc0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.428+0000 7f75d4739640 1 -- 172.21.15.2:0/1613423478 shutdown_connections 2024-09-15T23:13:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:32.428+0000 7f75d4739640 1 -- 172.21.15.2:0/1613423478 wait complete. 2024-09-15T23:13:33.548 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:33 smithi002 ceph-mon[31019]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:33.549 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:33 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1613423478' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T23:13:33.549 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:33 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3524398010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T23:13:33.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:33 smithi145 ceph-mon[34901]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:33.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:33 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1613423478' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T23:13:33.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:33 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3524398010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T23:13:33.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:33 smithi112 ceph-mon[34367]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:33.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:33 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1613423478' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T23:13:33.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:33 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3524398010' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T23:13:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.959+0000 7f3b483be640 1 -- 172.21.15.2:0/2207942104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b40102570 msgr2=0x7f3b401029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.959+0000 7f3b483be640 1 --2- 172.21.15.2:0/2207942104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b40102570 0x7f3b401029b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009900 tx=0x7f3b3002a480 comp rx=0 tx=0).stop 2024-09-15T23:13:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.959+0000 7f3b483be640 1 -- 172.21.15.2:0/2207942104 shutdown_connections 2024-09-15T23:13:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.959+0000 7f3b483be640 1 --2- 172.21.15.2:0/2207942104 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b40102ef0 0x7f3b4010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.959+0000 7f3b483be640 1 --2- 172.21.15.2:0/2207942104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b40102570 0x7f3b401029b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.959+0000 7f3b483be640 1 --2- 172.21.15.2:0/2207942104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b40100e20 0x7f3b40101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.959+0000 7f3b483be640 1 -- 172.21.15.2:0/2207942104 >> 172.21.15.2:0/2207942104 conn(0x7f3b400fc7d0 msgr2=0x7f3b400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.959+0000 7f3b483be640 1 -- 172.21.15.2:0/2207942104 shutdown_connections 2024-09-15T23:13:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.959+0000 7f3b483be640 1 -- 172.21.15.2:0/2207942104 wait complete. 2024-09-15T23:13:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.959+0000 7f3b483be640 1 Processor -- start 2024-09-15T23:13:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b483be640 1 -- start start 2024-09-15T23:13:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b483be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b40100e20 0x7f3b400fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b483be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b40102570 0x7f3b400fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b483be640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b40102ef0 0x7f3b400fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b483be640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40110e30 con 0x7f3b40102570 2024-09-15T23:13:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b483be640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40110cb0 con 0x7f3b40100e20 2024-09-15T23:13:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b483be640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40110fb0 con 0x7f3b40102ef0 2024-09-15T23:13:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b45959640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b40102570 0x7f3b400fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b45959640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b40102570 0x7f3b400fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44936/0 (socket says 172.21.15.2:44936) 2024-09-15T23:13:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b45959640 1 -- 172.21.15.2:0/3836307848 learned_addr learned my addr 172.21.15.2:0/3836307848 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b4695b640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b40102ef0 0x7f3b400fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b4615a640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b40100e20 0x7f3b400fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b45959640 1 -- 172.21.15.2:0/3836307848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b40102ef0 msgr2=0x7f3b400fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b45959640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b40102ef0 0x7f3b400fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b45959640 1 -- 172.21.15.2:0/3836307848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b40100e20 msgr2=0x7f3b400fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b45959640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b40100e20 0x7f3b400fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b45959640 1 -- 172.21.15.2:0/3836307848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b401a6980 con 0x7f3b40102570 2024-09-15T23:13:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b4615a640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b40100e20 0x7f3b400fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.960+0000 7f3b45959640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b40102570 0x7f3b400fd1c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3b30006010 tx=0x7f3b300040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.961+0000 7f3b377fe640 1 -- 172.21.15.2:0/3836307848 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3003f030 con 0x7f3b40102570 2024-09-15T23:13:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.961+0000 7f3b377fe640 1 -- 172.21.15.2:0/3836307848 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b300044c0 con 0x7f3b40102570 2024-09-15T23:13:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.961+0000 7f3b483be640 1 -- 172.21.15.2:0/3836307848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b401a6c10 con 0x7f3b40102570 2024-09-15T23:13:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.961+0000 7f3b377fe640 1 -- 172.21.15.2:0/3836307848 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30035070 con 0x7f3b40102570 2024-09-15T23:13:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.961+0000 7f3b483be640 1 -- 172.21.15.2:0/3836307848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b401a70f0 con 0x7f3b40102570 2024-09-15T23:13:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.962+0000 7f3b483be640 1 -- 172.21.15.2:0/3836307848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b40101200 con 0x7f3b40102570 2024-09-15T23:13:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.963+0000 7f3b377fe640 1 -- 172.21.15.2:0/3836307848 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3b30042030 con 0x7f3b40102570 2024-09-15T23:13:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.964+0000 7f3b377fe640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3b2c0a32d0 0x7f3b2c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.964+0000 7f3b4615a640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3b2c0a32d0 0x7f3b2c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.964+0000 7f3b377fe640 1 -- 172.21.15.2:0/3836307848 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f3b300efd10 con 0x7f3b40102570 2024-09-15T23:13:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.964+0000 7f3b4615a640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3b2c0a32d0 0x7f3b2c0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009c20 tx=0x7f3b3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.968+0000 7f3b377fe640 1 -- 172.21.15.2:0/3836307848 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b300f5020 con 0x7f3b40102570 2024-09-15T23:13:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.151+0000 7f3b483be640 1 -- 172.21.15.2:0/3836307848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3b4010a0a0 con 0x7f3b40102570 2024-09-15T23:13:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.151+0000 7f3b377fe640 1 -- 172.21.15.2:0/3836307848 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3b300bc980 con 0x7f3b40102570 2024-09-15T23:13:34.152 INFO:teuthology.orchestra.run.smithi002.stdout:206158430252 2024-09-15T23:13:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.154+0000 7f3b483be640 1 -- 172.21.15.2:0/3836307848 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3b2c0a32d0 msgr2=0x7f3b2c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.154+0000 7f3b483be640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3b2c0a32d0 0x7f3b2c0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009c20 tx=0x7f3b3c005f90 comp rx=0 tx=0).stop 2024-09-15T23:13:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.154+0000 7f3b483be640 1 -- 172.21.15.2:0/3836307848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b40102570 msgr2=0x7f3b400fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.154+0000 7f3b483be640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b40102570 0x7f3b400fd1c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3b30006010 tx=0x7f3b300040c0 comp rx=0 tx=0).stop 2024-09-15T23:13:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.154+0000 7f3b483be640 1 -- 172.21.15.2:0/3836307848 shutdown_connections 2024-09-15T23:13:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.154+0000 7f3b483be640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3b2c0a32d0 0x7f3b2c0a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.154+0000 7f3b483be640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b40102ef0 0x7f3b400fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.154+0000 7f3b483be640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3b40102570 0x7f3b400fd1c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.154+0000 7f3b483be640 1 --2- 172.21.15.2:0/3836307848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3b40100e20 0x7f3b400fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.154+0000 7f3b483be640 1 -- 172.21.15.2:0/3836307848 >> 172.21.15.2:0/3836307848 conn(0x7f3b400fc7d0 msgr2=0x7f3b4006a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.154+0000 7f3b483be640 1 -- 172.21.15.2:0/3836307848 shutdown_connections 2024-09-15T23:13:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.154+0000 7f3b483be640 1 -- 172.21.15.2:0/3836307848 wait complete. 2024-09-15T23:13:34.550 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:34 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3320754635' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T23:13:34.550 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:34 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3836307848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T23:13:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:34 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3320754635' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T23:13:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:34 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3836307848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T23:13:34.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:34 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3320754635' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T23:13:34.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:34 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3836307848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T23:13:34.971 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939679 got 270582939682 for osd.9 2024-09-15T23:13:34.972 DEBUG:teuthology.parallel:result is None 2024-09-15T23:13:35.500 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430251 got 206158430252 for osd.7 2024-09-15T23:13:35.501 DEBUG:teuthology.parallel:result is None 2024-09-15T23:13:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:35 smithi002 ceph-mon[31019]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:13:35.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:35 smithi145 ceph-mon[34901]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:13:35.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:35 smithi112 ceph-mon[34367]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:13:35.960 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574921 got 55834574923 for osd.1 2024-09-15T23:13:35.960 DEBUG:teuthology.parallel:result is None 2024-09-15T23:13:36.581 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201318 got 236223201319 for osd.8 2024-09-15T23:13:36.581 DEBUG:teuthology.parallel:result is None 2024-09-15T23:13:36.915 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:37.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.858+0000 7f79fb1f5640 1 -- 172.21.15.2:0/1858305812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79f4101de0 msgr2=0x7f79f41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:37.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.858+0000 7f79fb1f5640 1 --2- 172.21.15.2:0/1858305812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79f4101de0 0x7f79f41021c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009900 tx=0x7f79e802a410 comp rx=0 tx=0).stop 2024-09-15T23:13:37.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.858+0000 7f79fb1f5640 1 -- 172.21.15.2:0/1858305812 shutdown_connections 2024-09-15T23:13:37.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.858+0000 7f79fb1f5640 1 --2- 172.21.15.2:0/1858305812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79f4106f10 0x7f79f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.858+0000 7f79fb1f5640 1 --2- 172.21.15.2:0/1858305812 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f4102790 0x7f79f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.858+0000 7f79fb1f5640 1 --2- 172.21.15.2:0/1858305812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79f4101de0 0x7f79f41021c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.858+0000 7f79fb1f5640 1 -- 172.21.15.2:0/1858305812 >> 172.21.15.2:0/1858305812 conn(0x7f79f40fd8c0 msgr2=0x7f79f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.858+0000 7f79fb1f5640 1 -- 172.21.15.2:0/1858305812 shutdown_connections 2024-09-15T23:13:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.858+0000 7f79fb1f5640 1 -- 172.21.15.2:0/1858305812 wait complete. 2024-09-15T23:13:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.858+0000 7f79fb1f5640 1 Processor -- start 2024-09-15T23:13:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.858+0000 7f79fb1f5640 1 -- start start 2024-09-15T23:13:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79fb1f5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f4101de0 0x7f79f4198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79fb1f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79f4102790 0x7f79f41988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79fb1f5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79f4106f10 0x7f79f419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79fb1f5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79f4111e20 con 0x7f79f4102790 2024-09-15T23:13:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79fb1f5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f79f4111ca0 con 0x7f79f4101de0 2024-09-15T23:13:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79fb1f5640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f79f4111fa0 con 0x7f79f4106f10 2024-09-15T23:13:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79f4102790 0x7f79f41988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79f4102790 0x7f79f41988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44922/0 (socket says 172.21.15.2:44922) 2024-09-15T23:13:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f3fff640 1 -- 172.21.15.2:0/3320754635 learned_addr learned my addr 172.21.15.2:0/3320754635 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f9792640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79f4106f10 0x7f79f419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f3fff640 1 -- 172.21.15.2:0/3320754635 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79f4106f10 msgr2=0x7f79f419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f8f91640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f4101de0 0x7f79f4198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f3fff640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79f4106f10 0x7f79f419cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f3fff640 1 -- 172.21.15.2:0/3320754635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f4101de0 msgr2=0x7f79f4198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f3fff640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f4101de0 0x7f79f4198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f3fff640 1 -- 172.21.15.2:0/3320754635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f419d330 con 0x7f79f4102790 2024-09-15T23:13:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f8f91640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f4101de0 0x7f79f4198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f3fff640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79f4102790 0x7f79f41988c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f79e000d950 tx=0x7f79e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f1ffb640 1 -- 172.21.15.2:0/3320754635 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0017030 con 0x7f79f4102790 2024-09-15T23:13:37.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79fb1f5640 1 -- 172.21.15.2:0/3320754635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f419d620 con 0x7f79f4102790 2024-09-15T23:13:37.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f1ffb640 1 -- 172.21.15.2:0/3320754635 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f79e0004020 con 0x7f79f4102790 2024-09-15T23:13:37.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.859+0000 7f79f1ffb640 1 -- 172.21.15.2:0/3320754635 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e00047a0 con 0x7f79f4102790 2024-09-15T23:13:37.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.860+0000 7f79fb1f5640 1 -- 172.21.15.2:0/3320754635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f41a4f00 con 0x7f79f4102790 2024-09-15T23:13:37.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.861+0000 7f79fb1f5640 1 -- 172.21.15.2:0/3320754635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f41021c0 con 0x7f79f4102790 2024-09-15T23:13:37.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.862+0000 7f79f1ffb640 1 -- 172.21.15.2:0/3320754635 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f79e00041d0 con 0x7f79f4102790 2024-09-15T23:13:37.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.862+0000 7f79f1ffb640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f79e40a32d0 0x7f79e40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:37.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.863+0000 7f79f8f91640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f79e40a32d0 0x7f79e40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:37.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.863+0000 7f79f1ffb640 1 -- 172.21.15.2:0/3320754635 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f79e00cf430 con 0x7f79f4102790 2024-09-15T23:13:37.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.863+0000 7f79f8f91640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f79e40a32d0 0x7f79e40a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f79e8000c00 tx=0x7f79e8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:37.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:33.866+0000 7f79f1ffb640 1 -- 172.21.15.2:0/3320754635 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79e009c1a0 con 0x7f79f4102790 2024-09-15T23:13:37.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.044+0000 7f79fb1f5640 1 -- 172.21.15.2:0/3320754635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f79f402d7c0 con 0x7f79f4102790 2024-09-15T23:13:37.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.045+0000 7f79f1ffb640 1 -- 172.21.15.2:0/3320754635 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f79e009baa0 con 0x7f79f4102790 2024-09-15T23:13:37.123 INFO:teuthology.orchestra.run.smithi002.stdout:322122547224 2024-09-15T23:13:37.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.047+0000 7f79fb1f5640 1 -- 172.21.15.2:0/3320754635 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f79e40a32d0 msgr2=0x7f79e40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:37.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.047+0000 7f79fb1f5640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f79e40a32d0 0x7f79e40a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f79e8000c00 tx=0x7f79e8031400 comp rx=0 tx=0).stop 2024-09-15T23:13:37.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.047+0000 7f79fb1f5640 1 -- 172.21.15.2:0/3320754635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79f4102790 msgr2=0x7f79f41988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:37.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.047+0000 7f79fb1f5640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79f4102790 0x7f79f41988c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f79e000d950 tx=0x7f79e000de10 comp rx=0 tx=0).stop 2024-09-15T23:13:37.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.047+0000 7f79fb1f5640 1 -- 172.21.15.2:0/3320754635 shutdown_connections 2024-09-15T23:13:37.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.047+0000 7f79fb1f5640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f79e40a32d0 0x7f79e40a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:37.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.047+0000 7f79fb1f5640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79f4106f10 0x7f79f419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:37.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.047+0000 7f79fb1f5640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79f4102790 0x7f79f41988c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:37.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.047+0000 7f79fb1f5640 1 --2- 172.21.15.2:0/3320754635 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79f4101de0 0x7f79f4198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:37.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.047+0000 7f79fb1f5640 1 -- 172.21.15.2:0/3320754635 >> 172.21.15.2:0/3320754635 conn(0x7f79f40fd8c0 msgr2=0x7f79f40fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:37.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.047+0000 7f79fb1f5640 1 -- 172.21.15.2:0/3320754635 shutdown_connections 2024-09-15T23:13:37.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:34.047+0000 7f79fb1f5640 1 -- 172.21.15.2:0/3320754635 wait complete. 2024-09-15T23:13:37.423 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:37 smithi002 ceph-mon[31019]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:37.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:37 smithi145 ceph-mon[34901]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:37.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:37 smithi112 ceph-mon[34367]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:37.792 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547223 got 322122547224 for osd.11 2024-09-15T23:13:37.792 DEBUG:teuthology.parallel:result is None 2024-09-15T23:13:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.185+0000 7f957de35640 1 -- 172.21.15.2:0/934318985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9578100a80 msgr2=0x7f9578100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.185+0000 7f957de35640 1 --2- 172.21.15.2:0/934318985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9578100a80 0x7f9578100ee0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f956c009930 tx=0x7f956c02a420 comp rx=0 tx=0).stop 2024-09-15T23:13:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.185+0000 7f957de35640 1 -- 172.21.15.2:0/934318985 shutdown_connections 2024-09-15T23:13:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.185+0000 7f957de35640 1 --2- 172.21.15.2:0/934318985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9578101420 0x7f957810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.185+0000 7f957de35640 1 --2- 172.21.15.2:0/934318985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9578100a80 0x7f9578100ee0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.185+0000 7f957de35640 1 --2- 172.21.15.2:0/934318985 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9578106a80 0x7f9578106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.185+0000 7f957de35640 1 -- 172.21.15.2:0/934318985 >> 172.21.15.2:0/934318985 conn(0x7f95780fc7a0 msgr2=0x7f95780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.185+0000 7f957de35640 1 -- 172.21.15.2:0/934318985 shutdown_connections 2024-09-15T23:13:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.185+0000 7f957de35640 1 -- 172.21.15.2:0/934318985 wait complete. 2024-09-15T23:13:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.186+0000 7f957de35640 1 Processor -- start 2024-09-15T23:13:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.186+0000 7f957de35640 1 -- start start 2024-09-15T23:13:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.186+0000 7f957de35640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9578100a80 0x7f95780fcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.186+0000 7f957de35640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9578101420 0x7f95780fd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.186+0000 7f957de35640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9578106a80 0x7f95780fd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.186+0000 7f957de35640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9578110d70 con 0x7f9578101420 2024-09-15T23:13:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.186+0000 7f957de35640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9578110bf0 con 0x7f9578100a80 2024-09-15T23:13:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.186+0000 7f957de35640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9578110ef0 con 0x7f9578106a80 2024-09-15T23:13:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.186+0000 7f9576ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9578101420 0x7f95780fd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.186+0000 7f9576ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9578101420 0x7f95780fd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46094/0 (socket says 172.21.15.2:46094) 2024-09-15T23:13:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.186+0000 7f9576ffd640 1 -- 172.21.15.2:0/2491573857 learned_addr learned my addr 172.21.15.2:0/2491573857 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.186+0000 7f9577fff640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9578106a80 0x7f95780fd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:38.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.186+0000 7f95777fe640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9578100a80 0x7f95780fcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.187+0000 7f9576ffd640 1 -- 172.21.15.2:0/2491573857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9578106a80 msgr2=0x7f95780fd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.187+0000 7f9576ffd640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9578106a80 0x7f95780fd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.187+0000 7f9576ffd640 1 -- 172.21.15.2:0/2491573857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9578100a80 msgr2=0x7f95780fcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.187+0000 7f9576ffd640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9578100a80 0x7f95780fcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.187+0000 7f9576ffd640 1 -- 172.21.15.2:0/2491573857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95781a68e0 con 0x7f9578101420 2024-09-15T23:13:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.187+0000 7f95777fe640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9578100a80 0x7f95780fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.187+0000 7f9576ffd640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9578101420 0x7f95780fd310 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f956c004770 tx=0x7f956c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.187+0000 7f9574ff9640 1 -- 172.21.15.2:0/2491573857 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c03f070 con 0x7f9578101420 2024-09-15T23:13:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.187+0000 7f957de35640 1 -- 172.21.15.2:0/2491573857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95781a6b70 con 0x7f9578101420 2024-09-15T23:13:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.187+0000 7f9574ff9640 1 -- 172.21.15.2:0/2491573857 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f956c03b460 con 0x7f9578101420 2024-09-15T23:13:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.187+0000 7f9574ff9640 1 -- 172.21.15.2:0/2491573857 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c035070 con 0x7f9578101420 2024-09-15T23:13:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.187+0000 7f957de35640 1 -- 172.21.15.2:0/2491573857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95781a70a0 con 0x7f9578101420 2024-09-15T23:13:38.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.188+0000 7f957de35640 1 -- 172.21.15.2:0/2491573857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9578100ee0 con 0x7f9578101420 2024-09-15T23:13:38.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.189+0000 7f9574ff9640 1 -- 172.21.15.2:0/2491573857 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f956c03b610 con 0x7f9578101420 2024-09-15T23:13:38.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.190+0000 7f9574ff9640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f95600a32d0 0x7f95600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:38.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.191+0000 7f95777fe640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f95600a32d0 0x7f95600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:38.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.191+0000 7f9574ff9640 1 -- 172.21.15.2:0/2491573857 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f956c0efc80 con 0x7f9578101420 2024-09-15T23:13:38.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.191+0000 7f95777fe640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f95600a32d0 0x7f95600a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9568009930 tx=0x7f9568008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:38.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.195+0000 7f9574ff9640 1 -- 172.21.15.2:0/2491573857 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f956c0bc9f0 con 0x7f9578101420 2024-09-15T23:13:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.375+0000 7f957de35640 1 -- 172.21.15.2:0/2491573857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f957810a020 con 0x7f9578101420 2024-09-15T23:13:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.375+0000 7f9574ff9640 1 -- 172.21.15.2:0/2491573857 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f956c0bc2f0 con 0x7f9578101420 2024-09-15T23:13:38.377 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:38 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:13:38.377 INFO:teuthology.orchestra.run.smithi002.stdout:292057776157 2024-09-15T23:13:38.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.377+0000 7f957de35640 1 -- 172.21.15.2:0/2491573857 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f95600a32d0 msgr2=0x7f95600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.377+0000 7f957de35640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f95600a32d0 0x7f95600a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9568009930 tx=0x7f9568008040 comp rx=0 tx=0).stop 2024-09-15T23:13:38.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.377+0000 7f957de35640 1 -- 172.21.15.2:0/2491573857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9578101420 msgr2=0x7f95780fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.377+0000 7f957de35640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9578101420 0x7f95780fd310 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f956c004770 tx=0x7f956c0042f0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.377+0000 7f957de35640 1 -- 172.21.15.2:0/2491573857 shutdown_connections 2024-09-15T23:13:38.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.377+0000 7f957de35640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f95600a32d0 0x7f95600a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.377+0000 7f957de35640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9578106a80 0x7f95780fd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.377+0000 7f957de35640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9578101420 0x7f95780fd310 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.377+0000 7f957de35640 1 --2- 172.21.15.2:0/2491573857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9578100a80 0x7f95780fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.377+0000 7f957de35640 1 -- 172.21.15.2:0/2491573857 >> 172.21.15.2:0/2491573857 conn(0x7f95780fc7a0 msgr2=0x7f957806aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:38.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.378+0000 7f957de35640 1 -- 172.21.15.2:0/2491573857 shutdown_connections 2024-09-15T23:13:38.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.378+0000 7f957de35640 1 -- 172.21.15.2:0/2491573857 wait complete. 2024-09-15T23:13:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.554+0000 7fd3dd268640 1 -- 172.21.15.2:0/2252006775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3d810c180 msgr2=0x7fd3d810e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.554+0000 7fd3dd268640 1 --2- 172.21.15.2:0/2252006775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3d810c180 0x7fd3d810e620 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009900 tx=0x7fd3d002a480 comp rx=0 tx=0).stop 2024-09-15T23:13:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.554+0000 7fd3dd268640 1 -- 172.21.15.2:0/2252006775 shutdown_connections 2024-09-15T23:13:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.554+0000 7fd3dd268640 1 --2- 172.21.15.2:0/2252006775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3d810c180 0x7fd3d810e620 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.554+0000 7fd3dd268640 1 --2- 172.21.15.2:0/2252006775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3d8103670 0x7fd3d810bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.554+0000 7fd3dd268640 1 --2- 172.21.15.2:0/2252006775 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3d8102d50 0x7fd3d8103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.554+0000 7fd3dd268640 1 -- 172.21.15.2:0/2252006775 >> 172.21.15.2:0/2252006775 conn(0x7fd3d80fc7d0 msgr2=0x7fd3d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.554+0000 7fd3dd268640 1 -- 172.21.15.2:0/2252006775 shutdown_connections 2024-09-15T23:13:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.554+0000 7fd3dd268640 1 -- 172.21.15.2:0/2252006775 wait complete. 2024-09-15T23:13:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.554+0000 7fd3dd268640 1 Processor -- start 2024-09-15T23:13:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.554+0000 7fd3dd268640 1 -- start start 2024-09-15T23:13:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3dd268640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3d8102d50 0x7fd3d8198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3dd268640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3d8103670 0x7fd3d8198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3dd268640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3d810c180 0x7fd3d819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3dd268640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d8111df0 con 0x7fd3d8103670 2024-09-15T23:13:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3dd268640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d8111c70 con 0x7fd3d8102d50 2024-09-15T23:13:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3dd268640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d8111f70 con 0x7fd3d810c180 2024-09-15T23:13:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3d8103670 0x7fd3d8198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3d67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3d8103670 0x7fd3d8198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46116/0 (socket says 172.21.15.2:46116) 2024-09-15T23:13:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3d6ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3d8102d50 0x7fd3d8198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3d67fc640 1 -- 172.21.15.2:0/2769822136 learned_addr learned my addr 172.21.15.2:0/2769822136 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3d77fe640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3d810c180 0x7fd3d819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3d67fc640 1 -- 172.21.15.2:0/2769822136 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3d810c180 msgr2=0x7fd3d819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3d67fc640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3d810c180 0x7fd3d819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3d67fc640 1 -- 172.21.15.2:0/2769822136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3d8102d50 msgr2=0x7fd3d8198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3d67fc640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3d8102d50 0x7fd3d8198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3d67fc640 1 -- 172.21.15.2:0/2769822136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d819d300 con 0x7fd3d8103670 2024-09-15T23:13:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3d6ffd640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3d8102d50 0x7fd3d8198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:13:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3d67fc640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3d8103670 0x7fd3d8198890 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000e9f0 tx=0x7fd3c000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3cffff640 1 -- 172.21.15.2:0/2769822136 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c000ccc0 con 0x7fd3d8103670 2024-09-15T23:13:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.555+0000 7fd3dd268640 1 -- 172.21.15.2:0/2769822136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d819d5f0 con 0x7fd3d8103670 2024-09-15T23:13:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.556+0000 7fd3cffff640 1 -- 172.21.15.2:0/2769822136 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd3c00108e0 con 0x7fd3d8103670 2024-09-15T23:13:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.556+0000 7fd3cffff640 1 -- 172.21.15.2:0/2769822136 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c00187c0 con 0x7fd3d8103670 2024-09-15T23:13:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.556+0000 7fd3dd268640 1 -- 172.21.15.2:0/2769822136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d81a4ed0 con 0x7fd3d8103670 2024-09-15T23:13:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.556+0000 7fd3dd268640 1 -- 172.21.15.2:0/2769822136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d8103130 con 0x7fd3d8103670 2024-09-15T23:13:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.558+0000 7fd3cffff640 1 -- 172.21.15.2:0/2769822136 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd3c0010430 con 0x7fd3d8103670 2024-09-15T23:13:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.558+0000 7fd3cffff640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fd3c40a32d0 0x7fd3c40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.558+0000 7fd3d6ffd640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fd3c40a32d0 0x7fd3c40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.559+0000 7fd3cffff640 1 -- 172.21.15.2:0/2769822136 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fd3c00d0020 con 0x7fd3d8103670 2024-09-15T23:13:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.559+0000 7fd3d6ffd640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fd3c40a32d0 0x7fd3c40a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009fd0 tx=0x7fd3c8009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.561+0000 7fd3cffff640 1 -- 172.21.15.2:0/2769822136 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3c009c740 con 0x7fd3d8103670 2024-09-15T23:13:38.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:38 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:13:38.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:38 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:13:38.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.745+0000 7fd3dd268640 1 -- 172.21.15.2:0/2769822136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd3d8106c90 con 0x7fd3d8103670 2024-09-15T23:13:38.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.746+0000 7fd3cffff640 1 -- 172.21.15.2:0/2769822136 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd3c00a0a40 con 0x7fd3d8103670 2024-09-15T23:13:38.747 INFO:teuthology.orchestra.run.smithi002.stdout:184683593779 2024-09-15T23:13:38.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.748+0000 7fd3dd268640 1 -- 172.21.15.2:0/2769822136 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fd3c40a32d0 msgr2=0x7fd3c40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.748+0000 7fd3dd268640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fd3c40a32d0 0x7fd3c40a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009fd0 tx=0x7fd3c8009760 comp rx=0 tx=0).stop 2024-09-15T23:13:38.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.748+0000 7fd3dd268640 1 -- 172.21.15.2:0/2769822136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3d8103670 msgr2=0x7fd3d8198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.748+0000 7fd3dd268640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3d8103670 0x7fd3d8198890 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000e9f0 tx=0x7fd3c000eeb0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.748+0000 7fd3dd268640 1 -- 172.21.15.2:0/2769822136 shutdown_connections 2024-09-15T23:13:38.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.748+0000 7fd3dd268640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fd3c40a32d0 0x7fd3c40a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.748+0000 7fd3dd268640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3d810c180 0x7fd3d819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.748+0000 7fd3dd268640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3d8103670 0x7fd3d8198890 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.748+0000 7fd3dd268640 1 --2- 172.21.15.2:0/2769822136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd3d8102d50 0x7fd3d8198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.748+0000 7fd3dd268640 1 -- 172.21.15.2:0/2769822136 >> 172.21.15.2:0/2769822136 conn(0x7fd3d80fc7d0 msgr2=0x7fd3d80fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:38.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.748+0000 7fd3dd268640 1 -- 172.21.15.2:0/2769822136 shutdown_connections 2024-09-15T23:13:38.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.748+0000 7fd3dd268640 1 -- 172.21.15.2:0/2769822136 wait complete. 2024-09-15T23:13:38.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.773+0000 7f539fcc1640 1 -- 172.21.15.2:0/593828436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f539810c160 msgr2=0x7f539810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.773+0000 7f539fcc1640 1 --2- 172.21.15.2:0/593828436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f539810c160 0x7f539810e600 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5390009ca0 tx=0x7f539002a950 comp rx=0 tx=0).stop 2024-09-15T23:13:38.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.773+0000 7f539fcc1640 1 -- 172.21.15.2:0/593828436 shutdown_connections 2024-09-15T23:13:38.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.773+0000 7f539fcc1640 1 --2- 172.21.15.2:0/593828436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f539810c160 0x7f539810e600 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.773+0000 7f539fcc1640 1 --2- 172.21.15.2:0/593828436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5398103650 0x7f539810bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.773+0000 7f539fcc1640 1 --2- 172.21.15.2:0/593828436 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5398102d30 0x7f5398103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.773+0000 7f539fcc1640 1 -- 172.21.15.2:0/593828436 >> 172.21.15.2:0/593828436 conn(0x7f53980fc7d0 msgr2=0x7f53980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.773+0000 7f539fcc1640 1 -- 172.21.15.2:0/593828436 shutdown_connections 2024-09-15T23:13:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.773+0000 7f539fcc1640 1 -- 172.21.15.2:0/593828436 wait complete. 2024-09-15T23:13:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539fcc1640 1 Processor -- start 2024-09-15T23:13:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539fcc1640 1 -- start start 2024-09-15T23:13:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539fcc1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5398102d30 0x7f53981983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539fcc1640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5398103650 0x7f53981988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539fcc1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f539810c160 0x7f539819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539fcc1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5398111dd0 con 0x7f5398102d30 2024-09-15T23:13:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539fcc1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5398111c50 con 0x7f539810c160 2024-09-15T23:13:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539fcc1640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5398111f50 con 0x7f5398103650 2024-09-15T23:13:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539da5d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5398102d30 0x7f53981983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539da5d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5398102d30 0x7f53981983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46134/0 (socket says 172.21.15.2:46134) 2024-09-15T23:13:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539da5d640 1 -- 172.21.15.2:0/2183640319 learned_addr learned my addr 172.21.15.2:0/2183640319 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539e25e640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f539810c160 0x7f539819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539d25c640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5398103650 0x7f53981988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.774+0000 7f539da5d640 1 -- 172.21.15.2:0/2183640319 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5398103650 msgr2=0x7f53981988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.775+0000 7f539da5d640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5398103650 0x7f53981988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.775+0000 7f539da5d640 1 -- 172.21.15.2:0/2183640319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f539810c160 msgr2=0x7f539819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.775+0000 7f539da5d640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f539810c160 0x7f539819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.775+0000 7f539da5d640 1 -- 172.21.15.2:0/2183640319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539819d360 con 0x7f5398102d30 2024-09-15T23:13:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.775+0000 7f539e25e640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f539810c160 0x7f539819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:13:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.775+0000 7f539da5d640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5398102d30 0x7f53981983b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f539400c890 tx=0x7f539400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.775+0000 7f538effd640 1 -- 172.21.15.2:0/2183640319 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394004220 con 0x7f5398102d30 2024-09-15T23:13:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.775+0000 7f539fcc1640 1 -- 172.21.15.2:0/2183640319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f539819d650 con 0x7f5398102d30 2024-09-15T23:13:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.775+0000 7f538effd640 1 -- 172.21.15.2:0/2183640319 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f53940043c0 con 0x7f5398102d30 2024-09-15T23:13:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.775+0000 7f538effd640 1 -- 172.21.15.2:0/2183640319 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394004a00 con 0x7f5398102d30 2024-09-15T23:13:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.775+0000 7f539fcc1640 1 -- 172.21.15.2:0/2183640319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53981a4f30 con 0x7f5398102d30 2024-09-15T23:13:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.776+0000 7f539fcc1640 1 -- 172.21.15.2:0/2183640319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5398103110 con 0x7f5398102d30 2024-09-15T23:13:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.778+0000 7f538effd640 1 -- 172.21.15.2:0/2183640319 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5394004ba0 con 0x7f5398102d30 2024-09-15T23:13:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.779+0000 7f538effd640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f53840a32d0 0x7f53840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.779+0000 7f539d25c640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f53840a32d0 0x7f53840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.779+0000 7f538effd640 1 -- 172.21.15.2:0/2183640319 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f53940cfa30 con 0x7f5398102d30 2024-09-15T23:13:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.780+0000 7f539d25c640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f53840a32d0 0x7f53840a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f53980fedf0 tx=0x7f538800b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.782+0000 7f538effd640 1 -- 172.21.15.2:0/2183640319 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5394014030 con 0x7f5398102d30 2024-09-15T23:13:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.960+0000 7f539fcc1640 1 -- 172.21.15.2:0/2183640319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5398107260 con 0x7f5398102d30 2024-09-15T23:13:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.960+0000 7f538effd640 1 -- 172.21.15.2:0/2183640319 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f539409c050 con 0x7f5398102d30 2024-09-15T23:13:38.961 INFO:teuthology.orchestra.run.smithi002.stdout:154618822711 2024-09-15T23:13:38.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.963+0000 7f539fcc1640 1 -- 172.21.15.2:0/2183640319 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f53840a32d0 msgr2=0x7f53840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.963+0000 7f539fcc1640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f53840a32d0 0x7f53840a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f53980fedf0 tx=0x7f538800b2e0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.963+0000 7f539fcc1640 1 -- 172.21.15.2:0/2183640319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5398102d30 msgr2=0x7f53981983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.963+0000 7f539fcc1640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5398102d30 0x7f53981983b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f539400c890 tx=0x7f539400cd50 comp rx=0 tx=0).stop 2024-09-15T23:13:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.963+0000 7f539fcc1640 1 -- 172.21.15.2:0/2183640319 shutdown_connections 2024-09-15T23:13:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.963+0000 7f539fcc1640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f53840a32d0 0x7f53840a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.963+0000 7f539fcc1640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f539810c160 0x7f539819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.963+0000 7f539fcc1640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5398103650 0x7f53981988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.963+0000 7f539fcc1640 1 --2- 172.21.15.2:0/2183640319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5398102d30 0x7f53981983b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.963+0000 7f539fcc1640 1 -- 172.21.15.2:0/2183640319 >> 172.21.15.2:0/2183640319 conn(0x7f53980fc7d0 msgr2=0x7f53980fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:38.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.963+0000 7f539fcc1640 1 -- 172.21.15.2:0/2183640319 shutdown_connections 2024-09-15T23:13:38.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:38.963+0000 7f539fcc1640 1 -- 172.21.15.2:0/2183640319 wait complete. 2024-09-15T23:13:39.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:39 smithi145 ceph-mon[34901]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:39.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:39 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2491573857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T23:13:39.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:39 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2769822136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T23:13:39.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:39 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2183640319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T23:13:39.523 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593775 got 184683593779 for osd.6 2024-09-15T23:13:39.523 DEBUG:teuthology.parallel:result is None 2024-09-15T23:13:39.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:39 smithi002 ceph-mon[31019]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:39.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:39 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2491573857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T23:13:39.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:39 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2769822136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T23:13:39.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:39 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2183640319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T23:13:39.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:39 smithi112 ceph-mon[34367]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:39.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:39 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2491573857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T23:13:39.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:39 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2769822136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T23:13:39.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:39 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2183640319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T23:13:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:40.391 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776153 got 292057776157 for osd.10 2024-09-15T23:13:40.391 DEBUG:teuthology.parallel:result is None 2024-09-15T23:13:40.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:40 smithi002 ceph-mon[31019]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:13:40.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:40.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:40.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:40.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:40 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:40.893 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822708 got 154618822711 for osd.5 2024-09-15T23:13:40.893 DEBUG:teuthology.parallel:result is None 2024-09-15T23:13:40.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:40 smithi112 ceph-mon[34367]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:13:40.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:40.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:40.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:40.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:40 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:41.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:40 smithi145 ceph-mon[34901]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:13:41.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:41.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:41.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:41.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:40 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:41.317 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215168 got 103079215169 for osd.3 2024-09-15T23:13:41.318 DEBUG:teuthology.parallel:result is None 2024-09-15T23:13:41.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-09-15T23:13:41.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-15T23:13:41.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-15T23:13:41.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-15T23:13:41.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-15T23:13:41.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-09-15T23:13:41.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-15T23:13:41.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-15T23:13:41.910 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-09-15T23:13:41.911 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:41 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-15T23:13:41.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.917+0000 7f232d9d5640 1 -- 172.21.15.2:0/355867669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2328100a60 msgr2=0x7f2328100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.917+0000 7f232d9d5640 1 --2- 172.21.15.2:0/355867669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2328100a60 0x7f2328100ec0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2310009930 tx=0x7f231002a420 comp rx=0 tx=0).stop 2024-09-15T23:13:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.917+0000 7f232d9d5640 1 -- 172.21.15.2:0/355867669 shutdown_connections 2024-09-15T23:13:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.917+0000 7f232d9d5640 1 --2- 172.21.15.2:0/355867669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2328101400 0x7f232810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.917+0000 7f232d9d5640 1 --2- 172.21.15.2:0/355867669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2328100a60 0x7f2328100ec0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.917+0000 7f232d9d5640 1 --2- 172.21.15.2:0/355867669 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2328106a60 0x7f2328106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.917+0000 7f232d9d5640 1 -- 172.21.15.2:0/355867669 >> 172.21.15.2:0/355867669 conn(0x7f23280fc780 msgr2=0x7f23280feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.917+0000 7f232d9d5640 1 -- 172.21.15.2:0/355867669 shutdown_connections 2024-09-15T23:13:41.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.917+0000 7f232d9d5640 1 -- 172.21.15.2:0/355867669 wait complete. 2024-09-15T23:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.918+0000 7f232d9d5640 1 Processor -- start 2024-09-15T23:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.918+0000 7f232d9d5640 1 -- start start 2024-09-15T23:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.918+0000 7f232d9d5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2328100a60 0x7f2328199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.918+0000 7f232d9d5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2328101400 0x7f2328199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.918+0000 7f232d9d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2328106a60 0x7f23281a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.918+0000 7f232d9d5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2328110d10 con 0x7f2328106a60 2024-09-15T23:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.918+0000 7f232d9d5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2328110b90 con 0x7f2328100a60 2024-09-15T23:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.918+0000 7f232d9d5640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2328110e90 con 0x7f2328101400 2024-09-15T23:13:41.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f23277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2328106a60 0x7f23281a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f23277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2328106a60 0x7f23281a42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46166/0 (socket says 172.21.15.2:46166) 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f23277fe640 1 -- 172.21.15.2:0/2086203414 learned_addr learned my addr 172.21.15.2:0/2086203414 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f23267fc640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2328101400 0x7f2328199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f2326ffd640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2328100a60 0x7f2328199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f23277fe640 1 -- 172.21.15.2:0/2086203414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2328101400 msgr2=0x7f2328199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f23277fe640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2328101400 0x7f2328199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f23277fe640 1 -- 172.21.15.2:0/2086203414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2328100a60 msgr2=0x7f2328199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f23277fe640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2328100a60 0x7f2328199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f23277fe640 1 -- 172.21.15.2:0/2086203414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23281a4800 con 0x7f2328106a60 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f23267fc640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2328101400 0x7f2328199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f23277fe640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2328106a60 0x7f23281a42c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f232000eaa0 tx=0x7f232000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f232c9d3640 1 -- 172.21.15.2:0/2086203414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232000cdb0 con 0x7f2328106a60 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f232d9d5640 1 -- 172.21.15.2:0/2086203414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23281a49d0 con 0x7f2328106a60 2024-09-15T23:13:41.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f232c9d3640 1 -- 172.21.15.2:0/2086203414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2320005020 con 0x7f2328106a60 2024-09-15T23:13:41.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f232c9d3640 1 -- 172.21.15.2:0/2086203414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23200116d0 con 0x7f2328106a60 2024-09-15T23:13:41.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.919+0000 7f232d9d5640 1 -- 172.21.15.2:0/2086203414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23281a4e90 con 0x7f2328106a60 2024-09-15T23:13:41.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.920+0000 7f232d9d5640 1 -- 172.21.15.2:0/2086203414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23281021a0 con 0x7f2328106a60 2024-09-15T23:13:41.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.922+0000 7f232c9d3640 1 -- 172.21.15.2:0/2086203414 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f23200051d0 con 0x7f2328106a60 2024-09-15T23:13:41.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.923+0000 7f232c9d3640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23140a32d0 0x7f23140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:41.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.923+0000 7f2326ffd640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23140a32d0 0x7f23140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:41.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.923+0000 7f232c9d3640 1 -- 172.21.15.2:0/2086203414 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f23200d0190 con 0x7f2328106a60 2024-09-15T23:13:41.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.924+0000 7f2326ffd640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23140a32d0 0x7f23140a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2318005d70 tx=0x7f2318005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:41.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:41.926+0000 7f232c9d3640 1 -- 172.21.15.2:0/2086203414 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2320016030 con 0x7f2328106a60 2024-09-15T23:13:41.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-09-15T23:13:41.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-15T23:13:41.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-15T23:13:41.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-15T23:13:41.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-15T23:13:41.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-09-15T23:13:41.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-15T23:13:41.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-15T23:13:41.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-09-15T23:13:41.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:41 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-15T23:13:42.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.103+0000 7f232d9d5640 1 -- 172.21.15.2:0/2086203414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2328100ec0 con 0x7f2328106a60 2024-09-15T23:13:42.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.103+0000 7f232c9d3640 1 -- 172.21.15.2:0/2086203414 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2328100ec0 con 0x7f2328106a60 2024-09-15T23:13:42.105 INFO:teuthology.orchestra.run.smithi002.stdout:133143986238 2024-09-15T23:13:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.105+0000 7f232d9d5640 1 -- 172.21.15.2:0/2086203414 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23140a32d0 msgr2=0x7f23140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.105+0000 7f232d9d5640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23140a32d0 0x7f23140a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2318005d70 tx=0x7f2318005d00 comp rx=0 tx=0).stop 2024-09-15T23:13:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.105+0000 7f232d9d5640 1 -- 172.21.15.2:0/2086203414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2328106a60 msgr2=0x7f23281a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.105+0000 7f232d9d5640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2328106a60 0x7f23281a42c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f232000eaa0 tx=0x7f232000ef60 comp rx=0 tx=0).stop 2024-09-15T23:13:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.105+0000 7f232d9d5640 1 -- 172.21.15.2:0/2086203414 shutdown_connections 2024-09-15T23:13:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.105+0000 7f232d9d5640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23140a32d0 0x7f23140a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.105+0000 7f232d9d5640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2328106a60 0x7f23281a42c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.105+0000 7f232d9d5640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2328101400 0x7f2328199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.105+0000 7f232d9d5640 1 --2- 172.21.15.2:0/2086203414 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2328100a60 0x7f2328199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.106+0000 7f232d9d5640 1 -- 172.21.15.2:0/2086203414 >> 172.21.15.2:0/2086203414 conn(0x7f23280fc780 msgr2=0x7f23280fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:42.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.106+0000 7f232d9d5640 1 -- 172.21.15.2:0/2086203414 shutdown_connections 2024-09-15T23:13:42.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.106+0000 7f232d9d5640 1 -- 172.21.15.2:0/2086203414 wait complete. 2024-09-15T23:13:42.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-09-15T23:13:42.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-15T23:13:42.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-15T23:13:42.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-15T23:13:42.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-15T23:13:42.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-09-15T23:13:42.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-15T23:13:42.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-15T23:13:42.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-09-15T23:13:42.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:41 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-15T23:13:42.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.704+0000 7f2174445640 1 -- 172.21.15.2:0/2231252968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f216c101420 msgr2=0x7f216c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:42.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.704+0000 7f2174445640 1 --2- 172.21.15.2:0/2231252968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f216c101420 0x7f216c10d950 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2164009cd0 tx=0x7f216402a8e0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.704+0000 7f2174445640 1 -- 172.21.15.2:0/2231252968 shutdown_connections 2024-09-15T23:13:42.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.704+0000 7f2174445640 1 --2- 172.21.15.2:0/2231252968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f216c101420 0x7f216c10d950 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.704+0000 7f2174445640 1 --2- 172.21.15.2:0/2231252968 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f216c100a80 0x7f216c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.704+0000 7f2174445640 1 --2- 172.21.15.2:0/2231252968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f216c106a80 0x7f216c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.704+0000 7f2174445640 1 -- 172.21.15.2:0/2231252968 >> 172.21.15.2:0/2231252968 conn(0x7f216c0fc7a0 msgr2=0x7f216c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:42.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.704+0000 7f2174445640 1 -- 172.21.15.2:0/2231252968 shutdown_connections 2024-09-15T23:13:42.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.704+0000 7f2174445640 1 -- 172.21.15.2:0/2231252968 wait complete. 2024-09-15T23:13:42.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.705+0000 7f2174445640 1 Processor -- start 2024-09-15T23:13:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.705+0000 7f2174445640 1 -- start start 2024-09-15T23:13:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.705+0000 7f2174445640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f216c100a80 0x7f216c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.705+0000 7f2174445640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f216c101420 0x7f216c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.705+0000 7f2174445640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f216c106a80 0x7f216c19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.705+0000 7f2174445640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f216c111e60 con 0x7f216c100a80 2024-09-15T23:13:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.705+0000 7f2174445640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f216c111ce0 con 0x7f216c101420 2024-09-15T23:13:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.705+0000 7f2174445640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f216c111fe0 con 0x7f216c106a80 2024-09-15T23:13:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.705+0000 7f21721e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f216c100a80 0x7f216c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.705+0000 7f21721e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f216c100a80 0x7f216c19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46192/0 (socket says 172.21.15.2:46192) 2024-09-15T23:13:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.705+0000 7f21721e1640 1 -- 172.21.15.2:0/1111211541 learned_addr learned my addr 172.21.15.2:0/1111211541 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.705+0000 7f21719e0640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f216c101420 0x7f216c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:42.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.706+0000 7f21729e2640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f216c106a80 0x7f216c19edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.706+0000 7f21721e1640 1 -- 172.21.15.2:0/1111211541 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f216c106a80 msgr2=0x7f216c19edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.706+0000 7f21721e1640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f216c106a80 0x7f216c19edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.706+0000 7f21721e1640 1 -- 172.21.15.2:0/1111211541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f216c101420 msgr2=0x7f216c19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.706+0000 7f21721e1640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f216c101420 0x7f216c19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.706+0000 7f21721e1640 1 -- 172.21.15.2:0/1111211541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216c19f4d0 con 0x7f216c100a80 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.706+0000 7f21719e0640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f216c101420 0x7f216c19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.706+0000 7f21721e1640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f216c100a80 0x7f216c19a520 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f216800b4a0 tx=0x7f216800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.706+0000 7f21637fe640 1 -- 172.21.15.2:0/1111211541 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168014070 con 0x7f216c100a80 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.706+0000 7f21637fe640 1 -- 172.21.15.2:0/1111211541 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2168010ac0 con 0x7f216c100a80 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.706+0000 7f2174445640 1 -- 172.21.15.2:0/1111211541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216c19f7c0 con 0x7f216c100a80 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.706+0000 7f21637fe640 1 -- 172.21.15.2:0/1111211541 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168017c30 con 0x7f216c100a80 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.706+0000 7f2174445640 1 -- 172.21.15.2:0/1111211541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f216c1a70a0 con 0x7f216c100a80 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.707+0000 7f2174445640 1 -- 172.21.15.2:0/1111211541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f216c100ee0 con 0x7f216c100a80 2024-09-15T23:13:42.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.708+0000 7f21637fe640 1 -- 172.21.15.2:0/1111211541 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2168017070 con 0x7f216c100a80 2024-09-15T23:13:42.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.709+0000 7f21637fe640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f21580a3350 0x7f21580a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:42.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.709+0000 7f21719e0640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f21580a3350 0x7f21580a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:42.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.709+0000 7f21637fe640 1 -- 172.21.15.2:0/1111211541 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f21680cf1f0 con 0x7f216c100a80 2024-09-15T23:13:42.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.710+0000 7f21719e0640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f21580a3350 0x7f21580a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f216c111870 tx=0x7f215c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:42.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.712+0000 7f21637fe640 1 -- 172.21.15.2:0/1111211541 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f216809be40 con 0x7f216c100a80 2024-09-15T23:13:42.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-09-15T23:13:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-15T23:13:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-15T23:13:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-15T23:13:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-15T23:13:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-15T23:13:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-15T23:13:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-15T23:13:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-09-15T23:13:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-15T23:13:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T23:13:42.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2086203414' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T23:13:42.878 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:42 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2485971311' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T23:13:42.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.899+0000 7f2174445640 1 -- 172.21.15.2:0/1111211541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f216c19b880 con 0x7f216c100a80 2024-09-15T23:13:42.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.899+0000 7f21637fe640 1 -- 172.21.15.2:0/1111211541 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f216809b740 con 0x7f216c100a80 2024-09-15T23:13:42.900 INFO:teuthology.orchestra.run.smithi002.stdout:73014444104 2024-09-15T23:13:42.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.901+0000 7f2174445640 1 -- 172.21.15.2:0/1111211541 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f21580a3350 msgr2=0x7f21580a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:42.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.901+0000 7f2174445640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f21580a3350 0x7f21580a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f216c111870 tx=0x7f215c00a5c0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.901+0000 7f2174445640 1 -- 172.21.15.2:0/1111211541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f216c100a80 msgr2=0x7f216c19a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:42.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.901+0000 7f2174445640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f216c100a80 0x7f216c19a520 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f216800b4a0 tx=0x7f216800b960 comp rx=0 tx=0).stop 2024-09-15T23:13:42.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.901+0000 7f2174445640 1 -- 172.21.15.2:0/1111211541 shutdown_connections 2024-09-15T23:13:42.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.901+0000 7f2174445640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f21580a3350 0x7f21580a5810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.901+0000 7f2174445640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f216c106a80 0x7f216c19edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.901+0000 7f2174445640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f216c101420 0x7f216c19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.901+0000 7f2174445640 1 --2- 172.21.15.2:0/1111211541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f216c100a80 0x7f216c19a520 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:42.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.901+0000 7f2174445640 1 -- 172.21.15.2:0/1111211541 >> 172.21.15.2:0/1111211541 conn(0x7f216c0fc7a0 msgr2=0x7f216c10c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:42.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.901+0000 7f2174445640 1 -- 172.21.15.2:0/1111211541 shutdown_connections 2024-09-15T23:13:42.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.901+0000 7f2174445640 1 -- 172.21.15.2:0/1111211541 wait complete. 2024-09-15T23:13:42.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:42.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-09-15T23:13:42.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-15T23:13:42.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-15T23:13:42.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-15T23:13:42.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-15T23:13:42.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-15T23:13:42.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-15T23:13:42.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-15T23:13:42.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-09-15T23:13:42.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-15T23:13:42.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T23:13:42.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2086203414' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T23:13:42.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:42 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2485971311' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T23:13:43.204 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986234 got 133143986238 for osd.4 2024-09-15T23:13:43.205 DEBUG:teuthology.parallel:result is None 2024-09-15T23:13:43.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:13:43.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-09-15T23:13:43.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-15T23:13:43.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-15T23:13:43.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-15T23:13:43.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-15T23:13:43.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-15T23:13:43.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-15T23:13:43.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-15T23:13:43.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-09-15T23:13:43.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-15T23:13:43.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T23:13:43.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2086203414' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T23:13:43.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:42 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2485971311' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T23:13:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:34359738451 2024-09-15T23:13:43.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.144+0000 7f34874eb640 1 -- 172.21.15.2:0/2060707578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480102ef0 msgr2=0x7f348010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:43.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.144+0000 7f34874eb640 1 --2- 172.21.15.2:0/2060707578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480102ef0 0x7f348010da40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3478009ca0 tx=0x7f347802a950 comp rx=0 tx=0).stop 2024-09-15T23:13:43.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.144+0000 7f34874eb640 1 -- 172.21.15.2:0/2060707578 shutdown_connections 2024-09-15T23:13:43.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.144+0000 7f34874eb640 1 --2- 172.21.15.2:0/2060707578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480102ef0 0x7f348010da40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.144+0000 7f34874eb640 1 --2- 172.21.15.2:0/2060707578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3480102570 0x7f34801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.144+0000 7f34874eb640 1 --2- 172.21.15.2:0/2060707578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3480100e20 0x7f3480101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.144+0000 7f34874eb640 1 -- 172.21.15.2:0/2060707578 >> 172.21.15.2:0/2060707578 conn(0x7f34800fc7d0 msgr2=0x7f34800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.144+0000 7f34874eb640 1 -- 172.21.15.2:0/2060707578 shutdown_connections 2024-09-15T23:13:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.144+0000 7f34874eb640 1 -- 172.21.15.2:0/2060707578 wait complete. 2024-09-15T23:13:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.144+0000 7f34874eb640 1 Processor -- start 2024-09-15T23:13:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.144+0000 7f34874eb640 1 -- start start 2024-09-15T23:13:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f34874eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480100e20 0x7f34801983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f34874eb640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3480102570 0x7f3480198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f34874eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3480102ef0 0x7f348019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f34874eb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3480110e50 con 0x7f3480100e20 2024-09-15T23:13:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f34874eb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3480110cd0 con 0x7f3480102ef0 2024-09-15T23:13:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f34874eb640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3480110fd0 con 0x7f3480102570 2024-09-15T23:13:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f3485287640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480100e20 0x7f34801983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f3485287640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480100e20 0x7f34801983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46170/0 (socket says 172.21.15.2:46170) 2024-09-15T23:13:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f3485287640 1 -- 172.21.15.2:0/2485971311 learned_addr learned my addr 172.21.15.2:0/2485971311 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f3485a88640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3480102ef0 0x7f348019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f3484a86640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3480102570 0x7f3480198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f3485287640 1 -- 172.21.15.2:0/2485971311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3480102570 msgr2=0x7f3480198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f3485287640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3480102570 0x7f3480198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f3485287640 1 -- 172.21.15.2:0/2485971311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3480102ef0 msgr2=0x7f348019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f3485287640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3480102ef0 0x7f348019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f3485287640 1 -- 172.21.15.2:0/2485971311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348019d390 con 0x7f3480100e20 2024-09-15T23:13:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f3485287640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480100e20 0x7f34801983e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f347c00d950 tx=0x7f347c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.145+0000 7f34767fc640 1 -- 172.21.15.2:0/2485971311 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c017070 con 0x7f3480100e20 2024-09-15T23:13:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.146+0000 7f34767fc640 1 -- 172.21.15.2:0/2485971311 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f347c009c30 con 0x7f3480100e20 2024-09-15T23:13:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.146+0000 7f34874eb640 1 -- 172.21.15.2:0/2485971311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348019d680 con 0x7f3480100e20 2024-09-15T23:13:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.146+0000 7f34767fc640 1 -- 172.21.15.2:0/2485971311 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c00f620 con 0x7f3480100e20 2024-09-15T23:13:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.146+0000 7f34874eb640 1 -- 172.21.15.2:0/2485971311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34801a4f60 con 0x7f3480100e20 2024-09-15T23:13:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.147+0000 7f34874eb640 1 -- 172.21.15.2:0/2485971311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3480101200 con 0x7f3480100e20 2024-09-15T23:13:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.148+0000 7f34767fc640 1 -- 172.21.15.2:0/2485971311 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f347c0109a0 con 0x7f3480100e20 2024-09-15T23:13:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.148+0000 7f34767fc640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f346c0a3350 0x7f346c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.148+0000 7f3484a86640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f346c0a3350 0x7f346c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.149+0000 7f34767fc640 1 -- 172.21.15.2:0/2485971311 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f347c0cf690 con 0x7f3480100e20 2024-09-15T23:13:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.149+0000 7f3484a86640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f346c0a3350 0x7f346c0a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3480100010 tx=0x7f3470008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.153+0000 7f34767fc640 1 -- 172.21.15.2:0/2485971311 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f347c009de0 con 0x7f3480100e20 2024-09-15T23:13:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.334+0000 7f34874eb640 1 -- 172.21.15.2:0/2485971311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f348010a0a0 con 0x7f3480100e20 2024-09-15T23:13:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.334+0000 7f34767fc640 1 -- 172.21.15.2:0/2485971311 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f347c09c230 con 0x7f3480100e20 2024-09-15T23:13:43.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.336+0000 7f34874eb640 1 -- 172.21.15.2:0/2485971311 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f346c0a3350 msgr2=0x7f346c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:43.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.336+0000 7f34874eb640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f346c0a3350 0x7f346c0a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3480100010 tx=0x7f3470008040 comp rx=0 tx=0).stop 2024-09-15T23:13:43.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.336+0000 7f34874eb640 1 -- 172.21.15.2:0/2485971311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480100e20 msgr2=0x7f34801983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:43.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.336+0000 7f34874eb640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480100e20 0x7f34801983e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f347c00d950 tx=0x7f347c00de10 comp rx=0 tx=0).stop 2024-09-15T23:13:43.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.336+0000 7f34874eb640 1 -- 172.21.15.2:0/2485971311 shutdown_connections 2024-09-15T23:13:43.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.336+0000 7f34874eb640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f346c0a3350 0x7f346c0a5810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:43.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.336+0000 7f34874eb640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3480102ef0 0x7f348019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:43.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.336+0000 7f34874eb640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3480102570 0x7f3480198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:43.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.336+0000 7f34874eb640 1 --2- 172.21.15.2:0/2485971311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480100e20 0x7f34801983e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:43.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.336+0000 7f34874eb640 1 -- 172.21.15.2:0/2485971311 >> 172.21.15.2:0/2485971311 conn(0x7f34800fc7d0 msgr2=0x7f348006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:43.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.336+0000 7f34874eb640 1 -- 172.21.15.2:0/2485971311 shutdown_connections 2024-09-15T23:13:43.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:42.336+0000 7f34874eb640 1 -- 172.21.15.2:0/2485971311 wait complete. 2024-09-15T23:13:43.890 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:43 smithi002 ceph-mon[31019]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T23:13:43.891 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:43 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1111211541' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T23:13:43.922 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738447 got 34359738451 for osd.0 2024-09-15T23:13:43.922 DEBUG:teuthology.parallel:result is None 2024-09-15T23:13:43.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:43 smithi112 ceph-mon[34367]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T23:13:43.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:43 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1111211541' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T23:13:44.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:43 smithi145 ceph-mon[34901]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T23:13:44.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:43 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1111211541' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T23:13:44.598 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444102 got 73014444104 for osd.2 2024-09-15T23:13:44.598 DEBUG:teuthology.parallel:result is None 2024-09-15T23:13:44.598 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T23:13:44.599 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T23:13:44.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:44 smithi002 ceph-mon[31019]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:13:44.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:44 smithi112 ceph-mon[34367]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:13:45.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:44 smithi145 ceph-mon[34901]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:13:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.966+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3069919226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f0101420 msgr2=0x7fc3f010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.966+0000 7fc3f4ac4640 1 --2- 172.21.15.2:0/3069919226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f0101420 0x7fc3f010d950 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009cd0 tx=0x7fc3e802a8e0 comp rx=0 tx=0).stop 2024-09-15T23:13:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.966+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3069919226 shutdown_connections 2024-09-15T23:13:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.966+0000 7fc3f4ac4640 1 --2- 172.21.15.2:0/3069919226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f0101420 0x7fc3f010d950 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.966+0000 7fc3f4ac4640 1 --2- 172.21.15.2:0/3069919226 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3f0100a80 0x7fc3f0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.966+0000 7fc3f4ac4640 1 --2- 172.21.15.2:0/3069919226 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f0106a80 0x7fc3f0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.966+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3069919226 >> 172.21.15.2:0/3069919226 conn(0x7fc3f00fc7a0 msgr2=0x7fc3f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.966+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3069919226 shutdown_connections 2024-09-15T23:13:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.966+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3069919226 wait complete. 2024-09-15T23:13:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.967+0000 7fc3f4ac4640 1 Processor -- start 2024-09-15T23:13:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.967+0000 7fc3f4ac4640 1 -- start start 2024-09-15T23:13:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.967+0000 7fc3f4ac4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f0100a80 0x7fc3f0199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.967+0000 7fc3f4ac4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f0101420 0x7fc3f01996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.967+0000 7fc3f4ac4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3f0106a80 0x7fc3f01a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.967+0000 7fc3f4ac4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f0110d30 con 0x7fc3f0100a80 2024-09-15T23:13:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.967+0000 7fc3f4ac4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f0110bb0 con 0x7fc3f0101420 2024-09-15T23:13:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.967+0000 7fc3f4ac4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f0110eb0 con 0x7fc3f0106a80 2024-09-15T23:13:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.967+0000 7fc3ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f0100a80 0x7fc3f0199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.967+0000 7fc3ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f0100a80 0x7fc3f0199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46218/0 (socket says 172.21.15.2:46218) 2024-09-15T23:13:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.967+0000 7fc3ee59c640 1 -- 172.21.15.2:0/3977216467 learned_addr learned my addr 172.21.15.2:0/3977216467 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.967+0000 7fc3e7fff640 1 --2- 172.21.15.2:0/3977216467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f0101420 0x7fc3f01996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.968+0000 7fc3ee59c640 1 -- 172.21.15.2:0/3977216467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3f0106a80 msgr2=0x7fc3f01a41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.968+0000 7fc3ee59c640 1 --2- 172.21.15.2:0/3977216467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3f0106a80 0x7fc3f01a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.968+0000 7fc3ee59c640 1 -- 172.21.15.2:0/3977216467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f0101420 msgr2=0x7fc3f01996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.968+0000 7fc3ee59c640 1 --2- 172.21.15.2:0/3977216467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f0101420 0x7fc3f01996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.968+0000 7fc3ee59c640 1 -- 172.21.15.2:0/3977216467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f01a4720 con 0x7fc3f0100a80 2024-09-15T23:13:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.968+0000 7fc3ee59c640 1 --2- 172.21.15.2:0/3977216467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f0100a80 0x7fc3f0199160 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000d950 tx=0x7fc3e000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.968+0000 7fc3e77fe640 1 -- 172.21.15.2:0/3977216467 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0017070 con 0x7fc3f0100a80 2024-09-15T23:13:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.968+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3977216467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f01a48f0 con 0x7fc3f0100a80 2024-09-15T23:13:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.968+0000 7fc3e77fe640 1 -- 172.21.15.2:0/3977216467 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3e000de80 con 0x7fc3f0100a80 2024-09-15T23:13:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.968+0000 7fc3e77fe640 1 -- 172.21.15.2:0/3977216467 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000f620 con 0x7fc3f0100a80 2024-09-15T23:13:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.968+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3977216467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f01a4e30 con 0x7fc3f0100a80 2024-09-15T23:13:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.969+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3977216467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f0100ee0 con 0x7fc3f0100a80 2024-09-15T23:13:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.970+0000 7fc3e77fe640 1 -- 172.21.15.2:0/3977216467 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc3e0009c30 con 0x7fc3f0100a80 2024-09-15T23:13:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.971+0000 7fc3e77fe640 1 --2- 172.21.15.2:0/3977216467 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc3dc0a32d0 0x7fc3dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.971+0000 7fc3e7fff640 1 --2- 172.21.15.2:0/3977216467 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc3dc0a32d0 0x7fc3dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.971+0000 7fc3e77fe640 1 -- 172.21.15.2:0/3977216467 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fc3e00cf6b0 con 0x7fc3f0100a80 2024-09-15T23:13:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.971+0000 7fc3e7fff640 1 --2- 172.21.15.2:0/3977216467 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc3dc0a32d0 0x7fc3dc0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc3f006b2e0 tx=0x7fc3d800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:45.975+0000 7fc3e77fe640 1 -- 172.21.15.2:0/3977216467 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3e009c250 con 0x7fc3f0100a80 2024-09-15T23:13:46.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.186+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3977216467 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3f0062630 con 0x7fc3dc0a32d0 2024-09-15T23:13:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.197+0000 7fc3e77fe640 1 -- 172.21.15.2:0/3977216467 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258849 (secure 0 0 0) 0x7fc3f0062630 con 0x7fc3dc0a32d0 2024-09-15T23:13:46.201 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-15T23:13:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.200+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3977216467 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc3dc0a32d0 msgr2=0x7fc3dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.200+0000 7fc3f4ac4640 1 --2- 172.21.15.2:0/3977216467 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc3dc0a32d0 0x7fc3dc0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc3f006b2e0 tx=0x7fc3d800a2d0 comp rx=0 tx=0).stop 2024-09-15T23:13:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.200+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3977216467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f0100a80 msgr2=0x7fc3f0199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.200+0000 7fc3f4ac4640 1 --2- 172.21.15.2:0/3977216467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f0100a80 0x7fc3f0199160 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000d950 tx=0x7fc3e000dd50 comp rx=0 tx=0).stop 2024-09-15T23:13:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.200+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3977216467 shutdown_connections 2024-09-15T23:13:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.200+0000 7fc3f4ac4640 1 --2- 172.21.15.2:0/3977216467 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc3dc0a32d0 0x7fc3dc0a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.200+0000 7fc3f4ac4640 1 --2- 172.21.15.2:0/3977216467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3f0106a80 0x7fc3f01a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.200+0000 7fc3f4ac4640 1 --2- 172.21.15.2:0/3977216467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc3f0101420 0x7fc3f01996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.200+0000 7fc3f4ac4640 1 --2- 172.21.15.2:0/3977216467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f0100a80 0x7fc3f0199160 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.200+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3977216467 >> 172.21.15.2:0/3977216467 conn(0x7fc3f00fc7a0 msgr2=0x7fc3f00fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.200+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3977216467 shutdown_connections 2024-09-15T23:13:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:46.200+0000 7fc3f4ac4640 1 -- 172.21.15.2:0/3977216467 wait complete. 2024-09-15T23:13:46.926 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-09-15T23:13:45.518340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":259,"num_read_kb":244,"num_write":267,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368428,"kb_used_data":10800,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573396,"statfs":{"total":1151940427776,"available":1151563157504,"internally_reserved":0,"allocated":11059200,"data_stored":7128638,"data_compressed":140578,"data_compressed_allocated":180224,"data_compressed_original":1859584,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002047"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.733281+0000","last_change":"2024-09-15T23:12:41.750867+0000","last_active":"2024-09-15T23:12:42.733281+0000","last_peered":"2024-09-15T23:12:42.733281+0000","last_clean":"2024-09-15T23:12:42.733281+0000","last_became_active":"2024-09-15T23:12:41.750508+0000","last_became_peered":"2024-09-15T23:12:41.750508+0000","last_unstale":"2024-09-15T23:12:42.733281+0000","last_undegraded":"2024-09-15T23:12:42.733281+0000","last_fullsized":"2024-09-15T23:12:42.733281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:55.104563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740528+0000","last_change":"2024-09-15T23:12:41.752704+0000","last_active":"2024-09-15T23:12:42.740528+0000","last_peered":"2024-09-15T23:12:42.740528+0000","last_clean":"2024-09-15T23:12:42.740528+0000","last_became_active":"2024-09-15T23:12:41.751144+0000","last_became_peered":"2024-09-15T23:12:41.751144+0000","last_unstale":"2024-09-15T23:12:42.740528+0000","last_undegraded":"2024-09-15T23:12:42.740528+0000","last_fullsized":"2024-09-15T23:12:42.740528+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:10.332172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739915+0000","last_change":"2024-09-15T23:12:41.759051+0000","last_active":"2024-09-15T23:12:42.739915+0000","last_peered":"2024-09-15T23:12:42.739915+0000","last_clean":"2024-09-15T23:12:42.739915+0000","last_became_active":"2024-09-15T23:12:41.757243+0000","last_became_peered":"2024-09-15T23:12:41.757243+0000","last_unstale":"2024-09-15T23:12:42.739915+0000","last_undegraded":"2024-09-15T23:12:42.739915+0000","last_fullsized":"2024-09-15T23:12:42.739915+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:44.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739130+0000","last_change":"2024-09-15T23:12:41.751732+0000","last_active":"2024-09-15T23:13:42.739130+0000","last_peered":"2024-09-15T23:13:42.739130+0000","last_clean":"2024-09-15T23:13:42.739130+0000","last_became_active":"2024-09-15T23:12:41.751404+0000","last_became_peered":"2024-09-15T23:12:41.751404+0000","last_unstale":"2024-09-15T23:13:42.739130+0000","last_undegraded":"2024-09-15T23:13:42.739130+0000","last_fullsized":"2024-09-15T23:13:42.739130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:05.724326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739163+0000","last_change":"2024-09-15T23:12:41.750642+0000","last_active":"2024-09-15T23:12:42.739163+0000","last_peered":"2024-09-15T23:12:42.739163+0000","last_clean":"2024-09-15T23:12:42.739163+0000","last_became_active":"2024-09-15T23:12:41.750312+0000","last_became_peered":"2024-09-15T23:12:41.750312+0000","last_unstale":"2024-09-15T23:12:42.739163+0000","last_undegraded":"2024-09-15T23:12:42.739163+0000","last_fullsized":"2024-09-15T23:12:42.739163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:46.168397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854193+0000","last_change":"2024-09-15T23:12:41.744794+0000","last_active":"2024-09-15T23:13:42.854193+0000","last_peered":"2024-09-15T23:13:42.854193+0000","last_clean":"2024-09-15T23:13:42.854193+0000","last_became_active":"2024-09-15T23:12:41.744468+0000","last_became_peered":"2024-09-15T23:12:41.744468+0000","last_unstale":"2024-09-15T23:13:42.854193+0000","last_undegraded":"2024-09-15T23:13:42.854193+0000","last_fullsized":"2024-09-15T23:13:42.854193+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:22.298132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740783+0000","last_change":"2024-09-15T23:12:41.746124+0000","last_active":"2024-09-15T23:12:42.740783+0000","last_peered":"2024-09-15T23:12:42.740783+0000","last_clean":"2024-09-15T23:12:42.740783+0000","last_became_active":"2024-09-15T23:12:41.745756+0000","last_became_peered":"2024-09-15T23:12:41.745756+0000","last_unstale":"2024-09-15T23:12:42.740783+0000","last_undegraded":"2024-09-15T23:12:42.740783+0000","last_fullsized":"2024-09-15T23:12:42.740783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:12.368976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736870+0000","last_change":"2024-09-15T23:12:41.742047+0000","last_active":"2024-09-15T23:13:42.736870+0000","last_peered":"2024-09-15T23:13:42.736870+0000","last_clean":"2024-09-15T23:13:42.736870+0000","last_became_active":"2024-09-15T23:12:41.741730+0000","last_became_peered":"2024-09-15T23:12:41.741730+0000","last_unstale":"2024-09-15T23:13:42.736870+0000","last_undegraded":"2024-09-15T23:13:42.736870+0000","last_fullsized":"2024-09-15T23:13:42.736870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:46.278342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.735299+0000","last_change":"2024-09-15T23:12:41.757117+0000","last_active":"2024-09-15T23:13:42.735299+0000","last_peered":"2024-09-15T23:13:42.735299+0000","last_clean":"2024-09-15T23:13:42.735299+0000","last_became_active":"2024-09-15T23:12:41.756515+0000","last_became_peered":"2024-09-15T23:12:41.756515+0000","last_unstale":"2024-09-15T23:13:42.735299+0000","last_undegraded":"2024-09-15T23:13:42.735299+0000","last_fullsized":"2024-09-15T23:13:42.735299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:37.453454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854406+0000","last_change":"2024-09-15T23:12:41.751118+0000","last_active":"2024-09-15T23:13:42.854406+0000","last_peered":"2024-09-15T23:13:42.854406+0000","last_clean":"2024-09-15T23:13:42.854406+0000","last_became_active":"2024-09-15T23:12:41.750748+0000","last_became_peered":"2024-09-15T23:12:41.750748+0000","last_unstale":"2024-09-15T23:13:42.854406+0000","last_undegraded":"2024-09-15T23:13:42.854406+0000","last_fullsized":"2024-09-15T23:13:42.854406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:55.079937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741321+0000","last_change":"2024-09-15T23:12:41.756539+0000","last_active":"2024-09-15T23:12:42.741321+0000","last_peered":"2024-09-15T23:12:42.741321+0000","last_clean":"2024-09-15T23:12:42.741321+0000","last_became_active":"2024-09-15T23:12:41.756191+0000","last_became_peered":"2024-09-15T23:12:41.756191+0000","last_unstale":"2024-09-15T23:12:42.741321+0000","last_undegraded":"2024-09-15T23:12:42.741321+0000","last_fullsized":"2024-09-15T23:12:42.741321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:52.715699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739482+0000","last_change":"2024-09-15T23:12:41.750681+0000","last_active":"2024-09-15T23:13:42.739482+0000","last_peered":"2024-09-15T23:13:42.739482+0000","last_clean":"2024-09-15T23:13:42.739482+0000","last_became_active":"2024-09-15T23:12:41.750344+0000","last_became_peered":"2024-09-15T23:12:41.750344+0000","last_unstale":"2024-09-15T23:13:42.739482+0000","last_undegraded":"2024-09-15T23:13:42.739482+0000","last_fullsized":"2024-09-15T23:13:42.739482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:13.455792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.742252+0000","last_change":"2024-09-15T23:12:41.752626+0000","last_active":"2024-09-15T23:12:42.742252+0000","last_peered":"2024-09-15T23:12:42.742252+0000","last_clean":"2024-09-15T23:12:42.742252+0000","last_became_active":"2024-09-15T23:12:41.752177+0000","last_became_peered":"2024-09-15T23:12:41.752177+0000","last_unstale":"2024-09-15T23:12:42.742252+0000","last_undegraded":"2024-09-15T23:12:42.742252+0000","last_fullsized":"2024-09-15T23:12:42.742252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:41.180073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740175+0000","last_change":"2024-09-15T23:12:41.750831+0000","last_active":"2024-09-15T23:12:42.740175+0000","last_peered":"2024-09-15T23:12:42.740175+0000","last_clean":"2024-09-15T23:12:42.740175+0000","last_became_active":"2024-09-15T23:12:41.750528+0000","last_became_peered":"2024-09-15T23:12:41.750528+0000","last_unstale":"2024-09-15T23:12:42.740175+0000","last_undegraded":"2024-09-15T23:12:42.740175+0000","last_fullsized":"2024-09-15T23:12:42.740175+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:11.737726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740210+0000","last_change":"2024-09-15T23:12:41.750079+0000","last_active":"2024-09-15T23:12:42.740210+0000","last_peered":"2024-09-15T23:12:42.740210+0000","last_clean":"2024-09-15T23:12:42.740210+0000","last_became_active":"2024-09-15T23:12:41.749551+0000","last_became_peered":"2024-09-15T23:12:41.749551+0000","last_unstale":"2024-09-15T23:12:42.740210+0000","last_undegraded":"2024-09-15T23:12:42.740210+0000","last_fullsized":"2024-09-15T23:12:42.740210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:37.283315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734536+0000","last_change":"2024-09-15T23:12:41.754855+0000","last_active":"2024-09-15T23:13:42.734536+0000","last_peered":"2024-09-15T23:13:42.734536+0000","last_clean":"2024-09-15T23:13:42.734536+0000","last_became_active":"2024-09-15T23:12:41.753825+0000","last_became_peered":"2024-09-15T23:12:41.753825+0000","last_unstale":"2024-09-15T23:13:42.734536+0000","last_undegraded":"2024-09-15T23:13:42.734536+0000","last_fullsized":"2024-09-15T23:13:42.734536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:21.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.733315+0000","last_change":"2024-09-15T23:12:41.750708+0000","last_active":"2024-09-15T23:12:42.733315+0000","last_peered":"2024-09-15T23:12:42.733315+0000","last_clean":"2024-09-15T23:12:42.733315+0000","last_became_active":"2024-09-15T23:12:41.750372+0000","last_became_peered":"2024-09-15T23:12:41.750372+0000","last_unstale":"2024-09-15T23:12:42.733315+0000","last_undegraded":"2024-09-15T23:12:42.733315+0000","last_fullsized":"2024-09-15T23:12:42.733315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:22.693466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734408+0000","last_change":"2024-09-15T23:12:41.745514+0000","last_active":"2024-09-15T23:13:42.734408+0000","last_peered":"2024-09-15T23:13:42.734408+0000","last_clean":"2024-09-15T23:13:42.734408+0000","last_became_active":"2024-09-15T23:12:41.745165+0000","last_became_peered":"2024-09-15T23:12:41.745165+0000","last_unstale":"2024-09-15T23:13:42.734408+0000","last_undegraded":"2024-09-15T23:13:42.734408+0000","last_fullsized":"2024-09-15T23:13:42.734408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:39.275396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:13:41.732281+0000","last_change":"2024-09-15T23:12:41.752590+0000","last_active":"2024-09-15T23:13:41.732281+0000","last_peered":"2024-09-15T23:13:41.732281+0000","last_clean":"2024-09-15T23:13:41.732281+0000","last_became_active":"2024-09-15T23:12:41.752269+0000","last_became_peered":"2024-09-15T23:12:41.752269+0000","last_unstale":"2024-09-15T23:13:41.732281+0000","last_undegraded":"2024-09-15T23:13:41.732281+0000","last_fullsized":"2024-09-15T23:13:41.732281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:48:12.304549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732581+0000","last_change":"2024-09-15T23:12:41.746485+0000","last_active":"2024-09-15T23:12:42.732581+0000","last_peered":"2024-09-15T23:12:42.732581+0000","last_clean":"2024-09-15T23:12:42.732581+0000","last_became_active":"2024-09-15T23:12:41.746148+0000","last_became_peered":"2024-09-15T23:12:41.746148+0000","last_unstale":"2024-09-15T23:12:42.732581+0000","last_undegraded":"2024-09-15T23:12:42.732581+0000","last_fullsized":"2024-09-15T23:12:42.732581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:38.874706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741136+0000","last_change":"2024-09-15T23:12:41.758169+0000","last_active":"2024-09-15T23:12:42.741136+0000","last_peered":"2024-09-15T23:12:42.741136+0000","last_clean":"2024-09-15T23:12:42.741136+0000","last_became_active":"2024-09-15T23:12:41.757542+0000","last_became_peered":"2024-09-15T23:12:41.757542+0000","last_unstale":"2024-09-15T23:12:42.741136+0000","last_undegraded":"2024-09-15T23:12:42.741136+0000","last_fullsized":"2024-09-15T23:12:42.741136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:55.430022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734765+0000","last_change":"2024-09-15T23:12:41.751024+0000","last_active":"2024-09-15T23:13:42.734765+0000","last_peered":"2024-09-15T23:13:42.734765+0000","last_clean":"2024-09-15T23:13:42.734765+0000","last_became_active":"2024-09-15T23:12:41.750610+0000","last_became_peered":"2024-09-15T23:12:41.750610+0000","last_unstale":"2024-09-15T23:13:42.734765+0000","last_undegraded":"2024-09-15T23:13:42.734765+0000","last_fullsized":"2024-09-15T23:13:42.734765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:54.563688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.741766+0000","last_change":"2024-09-15T23:13:42.741376+0000","last_active":"2024-09-15T23:13:42.741766+0000","last_peered":"2024-09-15T23:13:42.741766+0000","last_clean":"2024-09-15T23:13:42.741766+0000","last_became_active":"2024-09-15T23:13:42.741028+0000","last_became_peered":"2024-09-15T23:13:42.741028+0000","last_unstale":"2024-09-15T23:13:42.741766+0000","last_undegraded":"2024-09-15T23:13:42.741766+0000","last_fullsized":"2024-09-15T23:13:42.741766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:42.590282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736677+0000","last_change":"2024-09-15T23:12:41.748306+0000","last_active":"2024-09-15T23:13:42.736677+0000","last_peered":"2024-09-15T23:13:42.736677+0000","last_clean":"2024-09-15T23:13:42.736677+0000","last_became_active":"2024-09-15T23:12:41.747950+0000","last_became_peered":"2024-09-15T23:12:41.747950+0000","last_unstale":"2024-09-15T23:13:42.736677+0000","last_undegraded":"2024-09-15T23:13:42.736677+0000","last_fullsized":"2024-09-15T23:13:42.736677+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:51.846769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.743799+0000","last_change":"2024-09-15T23:13:42.743799+0000","last_active":"2024-09-15T23:13:42.743799+0000","last_peered":"2024-09-15T23:13:42.743799+0000","last_clean":"2024-09-15T23:13:42.743799+0000","last_became_active":"2024-09-15T23:13:42.743404+0000","last_became_peered":"2024-09-15T23:13:42.743404+0000","last_unstale":"2024-09-15T23:13:42.743799+0000","last_undegraded":"2024-09-15T23:13:42.743799+0000","last_fullsized":"2024-09-15T23:13:42.743799+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:01.153392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:13:41.732984+0000","last_change":"2024-09-15T23:12:41.745342+0000","last_active":"2024-09-15T23:13:41.732984+0000","last_peered":"2024-09-15T23:13:41.732984+0000","last_clean":"2024-09-15T23:13:41.732984+0000","last_became_active":"2024-09-15T23:12:41.743658+0000","last_became_peered":"2024-09-15T23:12:41.743658+0000","last_unstale":"2024-09-15T23:13:41.732984+0000","last_undegraded":"2024-09-15T23:13:41.732984+0000","last_fullsized":"2024-09-15T23:13:41.732984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:32.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732868+0000","last_change":"2024-09-15T23:12:41.753015+0000","last_active":"2024-09-15T23:12:42.732868+0000","last_peered":"2024-09-15T23:12:42.732868+0000","last_clean":"2024-09-15T23:12:42.732868+0000","last_became_active":"2024-09-15T23:12:41.752692+0000","last_became_peered":"2024-09-15T23:12:41.752692+0000","last_unstale":"2024-09-15T23:12:42.732868+0000","last_undegraded":"2024-09-15T23:12:42.732868+0000","last_fullsized":"2024-09-15T23:12:42.732868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:51.310427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739992+0000","last_change":"2024-09-15T23:12:41.757381+0000","last_active":"2024-09-15T23:12:42.739992+0000","last_peered":"2024-09-15T23:12:42.739992+0000","last_clean":"2024-09-15T23:12:42.739992+0000","last_became_active":"2024-09-15T23:12:41.757075+0000","last_became_peered":"2024-09-15T23:12:41.757075+0000","last_unstale":"2024-09-15T23:12:42.739992+0000","last_undegraded":"2024-09-15T23:12:42.739992+0000","last_fullsized":"2024-09-15T23:12:42.739992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:57.282022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740142+0000","last_change":"2024-09-15T23:12:41.753164+0000","last_active":"2024-09-15T23:12:42.740142+0000","last_peered":"2024-09-15T23:12:42.740142+0000","last_clean":"2024-09-15T23:12:42.740142+0000","last_became_active":"2024-09-15T23:12:41.752855+0000","last_became_peered":"2024-09-15T23:12:41.752855+0000","last_unstale":"2024-09-15T23:12:42.740142+0000","last_undegraded":"2024-09-15T23:12:42.740142+0000","last_fullsized":"2024-09-15T23:12:42.740142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:29.569535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:13:41.731698+0000","last_change":"2024-09-15T23:12:41.750087+0000","last_active":"2024-09-15T23:13:41.731698+0000","last_peered":"2024-09-15T23:13:41.731698+0000","last_clean":"2024-09-15T23:13:41.731698+0000","last_became_active":"2024-09-15T23:12:41.749752+0000","last_became_peered":"2024-09-15T23:12:41.749752+0000","last_unstale":"2024-09-15T23:13:41.731698+0000","last_undegraded":"2024-09-15T23:13:41.731698+0000","last_fullsized":"2024-09-15T23:13:41.731698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:03.483448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:13:41.732410+0000","last_change":"2024-09-15T23:12:41.746724+0000","last_active":"2024-09-15T23:13:41.732410+0000","last_peered":"2024-09-15T23:13:41.732410+0000","last_clean":"2024-09-15T23:13:41.732410+0000","last_became_active":"2024-09-15T23:12:41.746333+0000","last_became_peered":"2024-09-15T23:12:41.746333+0000","last_unstale":"2024-09-15T23:13:41.732410+0000","last_undegraded":"2024-09-15T23:13:41.732410+0000","last_fullsized":"2024-09-15T23:13:41.732410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:04.413591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732909+0000","last_change":"2024-09-15T23:12:41.749473+0000","last_active":"2024-09-15T23:12:42.732909+0000","last_peered":"2024-09-15T23:12:42.732909+0000","last_clean":"2024-09-15T23:12:42.732909+0000","last_became_active":"2024-09-15T23:12:41.748764+0000","last_became_peered":"2024-09-15T23:12:41.748764+0000","last_unstale":"2024-09-15T23:12:42.732909+0000","last_undegraded":"2024-09-15T23:12:42.732909+0000","last_fullsized":"2024-09-15T23:12:42.732909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:43.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741904+0000","last_change":"2024-09-15T23:12:41.755451+0000","last_active":"2024-09-15T23:12:42.741904+0000","last_peered":"2024-09-15T23:12:42.741904+0000","last_clean":"2024-09-15T23:12:42.741904+0000","last_became_active":"2024-09-15T23:12:41.755083+0000","last_became_peered":"2024-09-15T23:12:41.755083+0000","last_unstale":"2024-09-15T23:12:42.741904+0000","last_undegraded":"2024-09-15T23:12:42.741904+0000","last_fullsized":"2024-09-15T23:12:42.741904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:06.340043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738169+0000","last_change":"2024-09-15T23:12:39.485771+0000","last_active":"2024-09-15T23:13:42.738169+0000","last_peered":"2024-09-15T23:13:42.738169+0000","last_clean":"2024-09-15T23:13:42.738169+0000","last_became_active":"2024-09-15T23:12:39.485430+0000","last_became_peered":"2024-09-15T23:12:39.485430+0000","last_unstale":"2024-09-15T23:13:42.738169+0000","last_undegraded":"2024-09-15T23:13:42.738169+0000","last_fullsized":"2024-09-15T23:13:42.738169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:49:08.027243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737396+0000","last_change":"2024-09-15T23:12:41.748977+0000","last_active":"2024-09-15T23:13:42.737396+0000","last_peered":"2024-09-15T23:13:42.737396+0000","last_clean":"2024-09-15T23:13:42.737396+0000","last_became_active":"2024-09-15T23:12:41.748616+0000","last_became_peered":"2024-09-15T23:12:41.748616+0000","last_unstale":"2024-09-15T23:13:42.737396+0000","last_undegraded":"2024-09-15T23:13:42.737396+0000","last_fullsized":"2024-09-15T23:13:42.737396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:45.248469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854329+0000","last_change":"2024-09-15T23:12:39.486497+0000","last_active":"2024-09-15T23:13:42.854329+0000","last_peered":"2024-09-15T23:13:42.854329+0000","last_clean":"2024-09-15T23:13:42.854329+0000","last_became_active":"2024-09-15T23:12:39.486173+0000","last_became_peered":"2024-09-15T23:12:39.486173+0000","last_unstale":"2024-09-15T23:13:42.854329+0000","last_undegraded":"2024-09-15T23:13:42.854329+0000","last_fullsized":"2024-09-15T23:13:42.854329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:06.125300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738267+0000","last_change":"2024-09-15T23:12:39.483270+0000","last_active":"2024-09-15T23:12:42.738267+0000","last_peered":"2024-09-15T23:12:42.738267+0000","last_clean":"2024-09-15T23:12:42.738267+0000","last_became_active":"2024-09-15T23:12:39.482913+0000","last_became_peered":"2024-09-15T23:12:39.482913+0000","last_unstale":"2024-09-15T23:12:42.738267+0000","last_undegraded":"2024-09-15T23:12:42.738267+0000","last_fullsized":"2024-09-15T23:12:42.738267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:25.333182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736977+0000","last_change":"2024-09-15T23:12:41.741778+0000","last_active":"2024-09-15T23:13:42.736977+0000","last_peered":"2024-09-15T23:13:42.736977+0000","last_clean":"2024-09-15T23:13:42.736977+0000","last_became_active":"2024-09-15T23:12:41.740768+0000","last_became_peered":"2024-09-15T23:12:41.740768+0000","last_unstale":"2024-09-15T23:13:42.736977+0000","last_undegraded":"2024-09-15T23:13:42.736977+0000","last_fullsized":"2024-09-15T23:13:42.736977+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:22.086290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737060+0000","last_change":"2024-09-15T23:12:39.483029+0000","last_active":"2024-09-15T23:13:42.737060+0000","last_peered":"2024-09-15T23:13:42.737060+0000","last_clean":"2024-09-15T23:13:42.737060+0000","last_became_active":"2024-09-15T23:12:39.482080+0000","last_became_peered":"2024-09-15T23:12:39.482080+0000","last_unstale":"2024-09-15T23:13:42.737060+0000","last_undegraded":"2024-09-15T23:13:42.737060+0000","last_fullsized":"2024-09-15T23:13:42.737060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:41.076993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734020+0000","last_change":"2024-09-15T23:12:41.747332+0000","last_active":"2024-09-15T23:13:42.734020+0000","last_peered":"2024-09-15T23:13:42.734020+0000","last_clean":"2024-09-15T23:13:42.734020+0000","last_became_active":"2024-09-15T23:12:41.746818+0000","last_became_peered":"2024-09-15T23:12:41.746818+0000","last_unstale":"2024-09-15T23:13:42.734020+0000","last_undegraded":"2024-09-15T23:13:42.734020+0000","last_fullsized":"2024-09-15T23:13:42.734020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:14.323947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854189+0000","last_change":"2024-09-15T23:12:39.486150+0000","last_active":"2024-09-15T23:13:42.854189+0000","last_peered":"2024-09-15T23:13:42.854189+0000","last_clean":"2024-09-15T23:13:42.854189+0000","last_became_active":"2024-09-15T23:12:39.485827+0000","last_became_peered":"2024-09-15T23:12:39.485827+0000","last_unstale":"2024-09-15T23:13:42.854189+0000","last_undegraded":"2024-09-15T23:13:42.854189+0000","last_fullsized":"2024-09-15T23:13:42.854189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:53.308822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.735085+0000","last_change":"2024-09-15T23:12:41.747866+0000","last_active":"2024-09-15T23:13:42.735085+0000","last_peered":"2024-09-15T23:13:42.735085+0000","last_clean":"2024-09-15T23:13:42.735085+0000","last_became_active":"2024-09-15T23:12:41.746593+0000","last_became_peered":"2024-09-15T23:12:41.746593+0000","last_unstale":"2024-09-15T23:13:42.735085+0000","last_undegraded":"2024-09-15T23:13:42.735085+0000","last_fullsized":"2024-09-15T23:13:42.735085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:35.952241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741110+0000","last_change":"2024-09-15T23:12:39.486320+0000","last_active":"2024-09-15T23:12:42.741110+0000","last_peered":"2024-09-15T23:12:42.741110+0000","last_clean":"2024-09-15T23:12:42.741110+0000","last_became_active":"2024-09-15T23:12:39.486010+0000","last_became_peered":"2024-09-15T23:12:39.486010+0000","last_unstale":"2024-09-15T23:12:42.741110+0000","last_undegraded":"2024-09-15T23:12:42.741110+0000","last_fullsized":"2024-09-15T23:12:42.741110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:33.701288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741014+0000","last_change":"2024-09-15T23:12:41.759468+0000","last_active":"2024-09-15T23:12:42.741014+0000","last_peered":"2024-09-15T23:12:42.741014+0000","last_clean":"2024-09-15T23:12:42.741014+0000","last_became_active":"2024-09-15T23:12:41.758145+0000","last_became_peered":"2024-09-15T23:12:41.758145+0000","last_unstale":"2024-09-15T23:12:42.741014+0000","last_undegraded":"2024-09-15T23:12:42.741014+0000","last_fullsized":"2024-09-15T23:12:42.741014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:19.055440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737462+0000","last_change":"2024-09-15T23:12:39.693366+0000","last_active":"2024-09-15T23:13:42.737462+0000","last_peered":"2024-09-15T23:13:42.737462+0000","last_clean":"2024-09-15T23:13:42.737462+0000","last_became_active":"2024-09-15T23:12:39.692941+0000","last_became_peered":"2024-09-15T23:12:39.692941+0000","last_unstale":"2024-09-15T23:13:42.737462+0000","last_undegraded":"2024-09-15T23:13:42.737462+0000","last_fullsized":"2024-09-15T23:13:42.737462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:04.371184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734908+0000","last_change":"2024-09-15T23:12:41.750195+0000","last_active":"2024-09-15T23:13:42.734908+0000","last_peered":"2024-09-15T23:13:42.734908+0000","last_clean":"2024-09-15T23:13:42.734908+0000","last_became_active":"2024-09-15T23:12:41.749862+0000","last_became_peered":"2024-09-15T23:12:41.749862+0000","last_unstale":"2024-09-15T23:13:42.734908+0000","last_undegraded":"2024-09-15T23:13:42.734908+0000","last_fullsized":"2024-09-15T23:13:42.734908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:59.746604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":166,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854545+0000","last_change":"2024-09-15T23:12:39.485608+0000","last_active":"2024-09-15T23:13:42.854545+0000","last_peered":"2024-09-15T23:13:42.854545+0000","last_clean":"2024-09-15T23:13:42.854545+0000","last_became_active":"2024-09-15T23:12:39.485266+0000","last_became_peered":"2024-09-15T23:12:39.485266+0000","last_unstale":"2024-09-15T23:13:42.854545+0000","last_undegraded":"2024-09-15T23:13:42.854545+0000","last_fullsized":"2024-09-15T23:13:42.854545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:04.696726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":119,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739653+0000","last_change":"2024-09-15T23:12:41.756495+0000","last_active":"2024-09-15T23:12:42.739653+0000","last_peered":"2024-09-15T23:12:42.739653+0000","last_clean":"2024-09-15T23:12:42.739653+0000","last_became_active":"2024-09-15T23:12:41.756130+0000","last_became_peered":"2024-09-15T23:12:41.756130+0000","last_unstale":"2024-09-15T23:12:42.739653+0000","last_undegraded":"2024-09-15T23:12:42.739653+0000","last_fullsized":"2024-09-15T23:12:42.739653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:29.100300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:13:41.732133+0000","last_change":"2024-09-15T23:12:39.488511+0000","last_active":"2024-09-15T23:13:41.732133+0000","last_peered":"2024-09-15T23:13:41.732133+0000","last_clean":"2024-09-15T23:13:41.732133+0000","last_became_active":"2024-09-15T23:12:39.488199+0000","last_became_peered":"2024-09-15T23:12:39.488199+0000","last_unstale":"2024-09-15T23:13:41.732133+0000","last_undegraded":"2024-09-15T23:13:41.732133+0000","last_fullsized":"2024-09-15T23:13:41.732133+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:08.678809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.737980+0000","last_change":"2024-09-15T23:12:41.756216+0000","last_active":"2024-09-15T23:12:42.737980+0000","last_peered":"2024-09-15T23:12:42.737980+0000","last_clean":"2024-09-15T23:12:42.737980+0000","last_became_active":"2024-09-15T23:12:41.755857+0000","last_became_peered":"2024-09-15T23:12:41.755857+0000","last_unstale":"2024-09-15T23:12:42.737980+0000","last_undegraded":"2024-09-15T23:12:42.737980+0000","last_fullsized":"2024-09-15T23:12:42.737980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:03.639704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737111+0000","last_change":"2024-09-15T23:12:39.482504+0000","last_active":"2024-09-15T23:13:42.737111+0000","last_peered":"2024-09-15T23:13:42.737111+0000","last_clean":"2024-09-15T23:13:42.737111+0000","last_became_active":"2024-09-15T23:12:39.482083+0000","last_became_peered":"2024-09-15T23:12:39.482083+0000","last_unstale":"2024-09-15T23:13:42.737111+0000","last_undegraded":"2024-09-15T23:13:42.737111+0000","last_fullsized":"2024-09-15T23:13:42.737111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:33.273301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741167+0000","last_change":"2024-09-15T23:12:41.752607+0000","last_active":"2024-09-15T23:12:42.741167+0000","last_peered":"2024-09-15T23:12:42.741167+0000","last_clean":"2024-09-15T23:12:42.741167+0000","last_became_active":"2024-09-15T23:12:41.752217+0000","last_became_peered":"2024-09-15T23:12:41.752217+0000","last_unstale":"2024-09-15T23:12:42.741167+0000","last_undegraded":"2024-09-15T23:12:42.741167+0000","last_fullsized":"2024-09-15T23:12:42.741167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:46:01.152604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739218+0000","last_change":"2024-09-15T23:12:39.486036+0000","last_active":"2024-09-15T23:13:42.739218+0000","last_peered":"2024-09-15T23:13:42.739218+0000","last_clean":"2024-09-15T23:13:42.739218+0000","last_became_active":"2024-09-15T23:12:39.485703+0000","last_became_peered":"2024-09-15T23:12:39.485703+0000","last_unstale":"2024-09-15T23:13:42.739218+0000","last_undegraded":"2024-09-15T23:13:42.739218+0000","last_fullsized":"2024-09-15T23:13:42.739218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:19.172258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740504+0000","last_change":"2024-09-15T23:12:41.751872+0000","last_active":"2024-09-15T23:12:42.740504+0000","last_peered":"2024-09-15T23:12:42.740504+0000","last_clean":"2024-09-15T23:12:42.740504+0000","last_became_active":"2024-09-15T23:12:41.751172+0000","last_became_peered":"2024-09-15T23:12:41.751172+0000","last_unstale":"2024-09-15T23:12:42.740504+0000","last_undegraded":"2024-09-15T23:12:42.740504+0000","last_fullsized":"2024-09-15T23:12:42.740504+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:00.508912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.746250+0000","last_change":"2024-09-15T23:12:39.692467+0000","last_active":"2024-09-15T23:12:42.746250+0000","last_peered":"2024-09-15T23:12:42.746250+0000","last_clean":"2024-09-15T23:12:42.746250+0000","last_became_active":"2024-09-15T23:12:39.692101+0000","last_became_peered":"2024-09-15T23:12:39.692101+0000","last_unstale":"2024-09-15T23:12:42.746250+0000","last_undegraded":"2024-09-15T23:12:42.746250+0000","last_fullsized":"2024-09-15T23:12:42.746250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:23.099398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.740888+0000","last_change":"2024-09-15T23:13:42.740888+0000","last_active":"2024-09-15T23:13:42.740888+0000","last_peered":"2024-09-15T23:13:42.740888+0000","last_clean":"2024-09-15T23:13:42.740888+0000","last_became_active":"2024-09-15T23:13:42.740411+0000","last_became_peered":"2024-09-15T23:13:42.740411+0000","last_unstale":"2024-09-15T23:13:42.740888+0000","last_undegraded":"2024-09-15T23:13:42.740888+0000","last_fullsized":"2024-09-15T23:13:42.740888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:16.541800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745161+0000","last_change":"2024-09-15T23:12:39.481639+0000","last_active":"2024-09-15T23:12:42.745161+0000","last_peered":"2024-09-15T23:12:42.745161+0000","last_clean":"2024-09-15T23:12:42.745161+0000","last_became_active":"2024-09-15T23:12:39.481231+0000","last_became_peered":"2024-09-15T23:12:39.481231+0000","last_unstale":"2024-09-15T23:12:42.745161+0000","last_undegraded":"2024-09-15T23:12:42.745161+0000","last_fullsized":"2024-09-15T23:12:42.745161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:37.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.732633+0000","last_change":"2024-09-15T23:12:41.751557+0000","last_active":"2024-09-15T23:12:42.732633+0000","last_peered":"2024-09-15T23:12:42.732633+0000","last_clean":"2024-09-15T23:12:42.732633+0000","last_became_active":"2024-09-15T23:12:41.751257+0000","last_became_peered":"2024-09-15T23:12:41.751257+0000","last_unstale":"2024-09-15T23:12:42.732633+0000","last_undegraded":"2024-09-15T23:12:42.732633+0000","last_fullsized":"2024-09-15T23:12:42.732633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:59:48.799875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.744483+0000","last_change":"2024-09-15T23:12:39.485812+0000","last_active":"2024-09-15T23:12:42.744483+0000","last_peered":"2024-09-15T23:12:42.744483+0000","last_clean":"2024-09-15T23:12:42.744483+0000","last_became_active":"2024-09-15T23:12:39.485447+0000","last_became_peered":"2024-09-15T23:12:39.485447+0000","last_unstale":"2024-09-15T23:12:42.744483+0000","last_undegraded":"2024-09-15T23:12:42.744483+0000","last_fullsized":"2024-09-15T23:12:42.744483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:05.483798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741676+0000","last_change":"2024-09-15T23:12:41.753166+0000","last_active":"2024-09-15T23:12:42.741676+0000","last_peered":"2024-09-15T23:12:42.741676+0000","last_clean":"2024-09-15T23:12:42.741676+0000","last_became_active":"2024-09-15T23:12:41.752841+0000","last_became_peered":"2024-09-15T23:12:41.752841+0000","last_unstale":"2024-09-15T23:12:42.741676+0000","last_undegraded":"2024-09-15T23:12:42.741676+0000","last_fullsized":"2024-09-15T23:12:42.741676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:38.439192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737927+0000","last_change":"2024-09-15T23:12:39.484696+0000","last_active":"2024-09-15T23:13:42.737927+0000","last_peered":"2024-09-15T23:13:42.737927+0000","last_clean":"2024-09-15T23:13:42.737927+0000","last_became_active":"2024-09-15T23:12:39.484230+0000","last_became_peered":"2024-09-15T23:12:39.484230+0000","last_unstale":"2024-09-15T23:13:42.737927+0000","last_undegraded":"2024-09-15T23:13:42.737927+0000","last_fullsized":"2024-09-15T23:13:42.737927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:12.456661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741503+0000","last_change":"2024-09-15T23:12:41.750605+0000","last_active":"2024-09-15T23:12:42.741503+0000","last_peered":"2024-09-15T23:12:42.741503+0000","last_clean":"2024-09-15T23:12:42.741503+0000","last_became_active":"2024-09-15T23:12:41.750236+0000","last_became_peered":"2024-09-15T23:12:41.750236+0000","last_unstale":"2024-09-15T23:12:42.741503+0000","last_undegraded":"2024-09-15T23:12:42.741503+0000","last_fullsized":"2024-09-15T23:12:42.741503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:24.918315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.741230+0000","last_change":"2024-09-15T23:13:42.740796+0000","last_active":"2024-09-15T23:13:42.741230+0000","last_peered":"2024-09-15T23:13:42.741230+0000","last_clean":"2024-09-15T23:13:42.741230+0000","last_became_active":"2024-09-15T23:13:42.740451+0000","last_became_peered":"2024-09-15T23:13:42.740451+0000","last_unstale":"2024-09-15T23:13:42.741230+0000","last_undegraded":"2024-09-15T23:13:42.741230+0000","last_fullsized":"2024-09-15T23:13:42.741230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:51.458936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741482+0000","last_change":"2024-09-15T23:12:41.751629+0000","last_active":"2024-09-15T23:12:42.741482+0000","last_peered":"2024-09-15T23:12:42.741482+0000","last_clean":"2024-09-15T23:12:42.741482+0000","last_became_active":"2024-09-15T23:12:41.751279+0000","last_became_peered":"2024-09-15T23:12:41.751279+0000","last_unstale":"2024-09-15T23:12:42.741482+0000","last_undegraded":"2024-09-15T23:12:42.741482+0000","last_fullsized":"2024-09-15T23:12:42.741482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:34.240811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":343,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740703+0000","last_change":"2024-09-15T23:11:26.734634+0000","last_active":"2024-09-15T23:12:42.740703+0000","last_peered":"2024-09-15T23:12:42.740703+0000","last_clean":"2024-09-15T23:12:42.740703+0000","last_became_active":"2024-09-15T23:11:26.734217+0000","last_became_peered":"2024-09-15T23:11:26.734217+0000","last_unstale":"2024-09-15T23:12:42.740703+0000","last_undegraded":"2024-09-15T23:12:42.740703+0000","last_fullsized":"2024-09-15T23:12:42.740703+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:07:58.008474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:07:58.008474+0000","last_clean_scrub_stamp":"2024-09-15T23:07:58.008474+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:59.634217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739334+0000","last_change":"2024-09-15T23:12:39.485101+0000","last_active":"2024-09-15T23:13:42.739334+0000","last_peered":"2024-09-15T23:13:42.739334+0000","last_clean":"2024-09-15T23:13:42.739334+0000","last_became_active":"2024-09-15T23:12:39.484651+0000","last_became_peered":"2024-09-15T23:12:39.484651+0000","last_unstale":"2024-09-15T23:13:42.739334+0000","last_undegraded":"2024-09-15T23:13:42.739334+0000","last_fullsized":"2024-09-15T23:13:42.739334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:46.709430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738666+0000","last_change":"2024-09-15T23:12:41.742460+0000","last_active":"2024-09-15T23:13:42.738666+0000","last_peered":"2024-09-15T23:13:42.738666+0000","last_clean":"2024-09-15T23:13:42.738666+0000","last_became_active":"2024-09-15T23:12:41.742157+0000","last_became_peered":"2024-09-15T23:12:41.742157+0000","last_unstale":"2024-09-15T23:13:42.738666+0000","last_undegraded":"2024-09-15T23:13:42.738666+0000","last_fullsized":"2024-09-15T23:13:42.738666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:36.602078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740755+0000","last_change":"2024-09-15T23:12:39.481814+0000","last_active":"2024-09-15T23:12:42.740755+0000","last_peered":"2024-09-15T23:12:42.740755+0000","last_clean":"2024-09-15T23:12:42.740755+0000","last_became_active":"2024-09-15T23:12:39.481419+0000","last_became_peered":"2024-09-15T23:12:39.481419+0000","last_unstale":"2024-09-15T23:12:42.740755+0000","last_undegraded":"2024-09-15T23:12:42.740755+0000","last_fullsized":"2024-09-15T23:12:42.740755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:42.217786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.737908+0000","last_change":"2024-09-15T23:12:41.752430+0000","last_active":"2024-09-15T23:12:42.737908+0000","last_peered":"2024-09-15T23:12:42.737908+0000","last_clean":"2024-09-15T23:12:42.737908+0000","last_became_active":"2024-09-15T23:12:41.752102+0000","last_became_peered":"2024-09-15T23:12:41.752102+0000","last_unstale":"2024-09-15T23:12:42.737908+0000","last_undegraded":"2024-09-15T23:12:42.737908+0000","last_fullsized":"2024-09-15T23:12:42.737908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:50.177644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.738122+0000","last_change":"2024-09-15T23:12:39.692189+0000","last_active":"2024-09-15T23:12:42.738122+0000","last_peered":"2024-09-15T23:12:42.738122+0000","last_clean":"2024-09-15T23:12:42.738122+0000","last_became_active":"2024-09-15T23:12:39.691839+0000","last_became_peered":"2024-09-15T23:12:39.691839+0000","last_unstale":"2024-09-15T23:12:42.738122+0000","last_undegraded":"2024-09-15T23:12:42.738122+0000","last_fullsized":"2024-09-15T23:12:42.738122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:31.286533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736677+0000","last_change":"2024-09-15T23:12:41.745096+0000","last_active":"2024-09-15T23:13:42.736677+0000","last_peered":"2024-09-15T23:13:42.736677+0000","last_clean":"2024-09-15T23:13:42.736677+0000","last_became_active":"2024-09-15T23:12:41.744647+0000","last_became_peered":"2024-09-15T23:12:41.744647+0000","last_unstale":"2024-09-15T23:13:42.736677+0000","last_undegraded":"2024-09-15T23:13:42.736677+0000","last_fullsized":"2024-09-15T23:13:42.736677+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:06.681024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.741031+0000","last_change":"2024-09-15T23:12:39.482633+0000","last_active":"2024-09-15T23:12:42.741031+0000","last_peered":"2024-09-15T23:12:42.741031+0000","last_clean":"2024-09-15T23:12:42.741031+0000","last_became_active":"2024-09-15T23:12:39.481842+0000","last_became_peered":"2024-09-15T23:12:39.481842+0000","last_unstale":"2024-09-15T23:12:42.741031+0000","last_undegraded":"2024-09-15T23:12:42.741031+0000","last_fullsized":"2024-09-15T23:12:42.741031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:16.995713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854456+0000","last_change":"2024-09-15T23:12:41.750155+0000","last_active":"2024-09-15T23:13:42.854456+0000","last_peered":"2024-09-15T23:13:42.854456+0000","last_clean":"2024-09-15T23:13:42.854456+0000","last_became_active":"2024-09-15T23:12:41.749851+0000","last_became_peered":"2024-09-15T23:12:41.749851+0000","last_unstale":"2024-09-15T23:13:42.854456+0000","last_undegraded":"2024-09-15T23:13:42.854456+0000","last_fullsized":"2024-09-15T23:13:42.854456+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:48.019129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734272+0000","last_change":"2024-09-15T23:12:39.692721+0000","last_active":"2024-09-15T23:13:42.734272+0000","last_peered":"2024-09-15T23:13:42.734272+0000","last_clean":"2024-09-15T23:13:42.734272+0000","last_became_active":"2024-09-15T23:12:39.692345+0000","last_became_peered":"2024-09-15T23:12:39.692345+0000","last_unstale":"2024-09-15T23:13:42.734272+0000","last_undegraded":"2024-09-15T23:13:42.734272+0000","last_fullsized":"2024-09-15T23:13:42.734272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:36.527037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854193+0000","last_change":"2024-09-15T23:12:41.739854+0000","last_active":"2024-09-15T23:13:42.854193+0000","last_peered":"2024-09-15T23:13:42.854193+0000","last_clean":"2024-09-15T23:13:42.854193+0000","last_became_active":"2024-09-15T23:12:41.739514+0000","last_became_peered":"2024-09-15T23:12:41.739514+0000","last_unstale":"2024-09-15T23:13:42.854193+0000","last_undegraded":"2024-09-15T23:13:42.854193+0000","last_fullsized":"2024-09-15T23:13:42.854193+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:08.001384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739992+0000","last_change":"2024-09-15T23:12:39.693238+0000","last_active":"2024-09-15T23:12:42.739992+0000","last_peered":"2024-09-15T23:12:42.739992+0000","last_clean":"2024-09-15T23:12:42.739992+0000","last_became_active":"2024-09-15T23:12:39.692838+0000","last_became_peered":"2024-09-15T23:12:39.692838+0000","last_unstale":"2024-09-15T23:12:42.739992+0000","last_undegraded":"2024-09-15T23:12:42.739992+0000","last_fullsized":"2024-09-15T23:12:42.739992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:48.385920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740144+0000","last_change":"2024-09-15T23:12:41.750113+0000","last_active":"2024-09-15T23:12:42.740144+0000","last_peered":"2024-09-15T23:12:42.740144+0000","last_clean":"2024-09-15T23:12:42.740144+0000","last_became_active":"2024-09-15T23:12:41.749799+0000","last_became_peered":"2024-09-15T23:12:41.749799+0000","last_unstale":"2024-09-15T23:12:42.740144+0000","last_undegraded":"2024-09-15T23:12:42.740144+0000","last_fullsized":"2024-09-15T23:12:42.740144+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:52:48.095393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734478+0000","last_change":"2024-09-15T23:12:39.480093+0000","last_active":"2024-09-15T23:13:42.734478+0000","last_peered":"2024-09-15T23:13:42.734478+0000","last_clean":"2024-09-15T23:13:42.734478+0000","last_became_active":"2024-09-15T23:12:39.479702+0000","last_became_peered":"2024-09-15T23:12:39.479702+0000","last_unstale":"2024-09-15T23:13:42.734478+0000","last_undegraded":"2024-09-15T23:13:42.734478+0000","last_fullsized":"2024-09-15T23:13:42.734478+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:34.617090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738347+0000","last_change":"2024-09-15T23:12:41.746786+0000","last_active":"2024-09-15T23:13:42.738347+0000","last_peered":"2024-09-15T23:13:42.738347+0000","last_clean":"2024-09-15T23:13:42.738347+0000","last_became_active":"2024-09-15T23:12:41.745877+0000","last_became_peered":"2024-09-15T23:12:41.745877+0000","last_unstale":"2024-09-15T23:13:42.738347+0000","last_undegraded":"2024-09-15T23:13:42.738347+0000","last_fullsized":"2024-09-15T23:13:42.738347+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:33.458142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739466+0000","last_change":"2024-09-15T23:12:40.282279+0000","last_active":"2024-09-15T23:13:42.739466+0000","last_peered":"2024-09-15T23:13:42.739466+0000","last_clean":"2024-09-15T23:13:42.739466+0000","last_became_active":"2024-09-15T23:12:40.281854+0000","last_became_peered":"2024-09-15T23:12:40.281854+0000","last_unstale":"2024-09-15T23:13:42.739466+0000","last_undegraded":"2024-09-15T23:13:42.739466+0000","last_fullsized":"2024-09-15T23:13:42.739466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:09.344989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740553+0000","last_change":"2024-09-15T23:12:41.759333+0000","last_active":"2024-09-15T23:12:42.740553+0000","last_peered":"2024-09-15T23:12:42.740553+0000","last_clean":"2024-09-15T23:12:42.740553+0000","last_became_active":"2024-09-15T23:12:41.757329+0000","last_became_peered":"2024-09-15T23:12:41.757329+0000","last_unstale":"2024-09-15T23:12:42.740553+0000","last_undegraded":"2024-09-15T23:12:42.740553+0000","last_fullsized":"2024-09-15T23:12:42.740553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:03.804263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734664+0000","last_change":"2024-09-15T23:12:39.692428+0000","last_active":"2024-09-15T23:13:42.734664+0000","last_peered":"2024-09-15T23:13:42.734664+0000","last_clean":"2024-09-15T23:13:42.734664+0000","last_became_active":"2024-09-15T23:12:39.692073+0000","last_became_peered":"2024-09-15T23:12:39.692073+0000","last_unstale":"2024-09-15T23:13:42.734664+0000","last_undegraded":"2024-09-15T23:13:42.734664+0000","last_fullsized":"2024-09-15T23:13:42.734664+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:39.971583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.739289+0000","last_change":"2024-09-15T23:12:41.752157+0000","last_active":"2024-09-15T23:12:42.739289+0000","last_peered":"2024-09-15T23:12:42.739289+0000","last_clean":"2024-09-15T23:12:42.739289+0000","last_became_active":"2024-09-15T23:12:41.751628+0000","last_became_peered":"2024-09-15T23:12:41.751628+0000","last_unstale":"2024-09-15T23:12:42.739289+0000","last_undegraded":"2024-09-15T23:12:42.739289+0000","last_fullsized":"2024-09-15T23:12:42.739289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:39.865611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737749+0000","last_change":"2024-09-15T23:12:39.484920+0000","last_active":"2024-09-15T23:13:42.737749+0000","last_peered":"2024-09-15T23:13:42.737749+0000","last_clean":"2024-09-15T23:13:42.737749+0000","last_became_active":"2024-09-15T23:12:39.484563+0000","last_became_peered":"2024-09-15T23:12:39.484563+0000","last_unstale":"2024-09-15T23:13:42.737749+0000","last_undegraded":"2024-09-15T23:13:42.737749+0000","last_fullsized":"2024-09-15T23:13:42.737749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:50.429881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.733033+0000","last_change":"2024-09-15T23:12:41.749718+0000","last_active":"2024-09-15T23:12:42.733033+0000","last_peered":"2024-09-15T23:12:42.733033+0000","last_clean":"2024-09-15T23:12:42.733033+0000","last_became_active":"2024-09-15T23:12:41.749187+0000","last_became_peered":"2024-09-15T23:12:41.749187+0000","last_unstale":"2024-09-15T23:12:42.733033+0000","last_undegraded":"2024-09-15T23:12:42.733033+0000","last_fullsized":"2024-09-15T23:12:42.733033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:30.700175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:13:41.731922+0000","last_change":"2024-09-15T23:12:39.482472+0000","last_active":"2024-09-15T23:13:41.731922+0000","last_peered":"2024-09-15T23:13:41.731922+0000","last_clean":"2024-09-15T23:13:41.731922+0000","last_became_active":"2024-09-15T23:12:39.481105+0000","last_became_peered":"2024-09-15T23:12:39.481105+0000","last_unstale":"2024-09-15T23:13:41.731922+0000","last_undegraded":"2024-09-15T23:13:41.731922+0000","last_fullsized":"2024-09-15T23:13:41.731922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:34.106771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738832+0000","last_change":"2024-09-15T23:12:41.749399+0000","last_active":"2024-09-15T23:13:42.738832+0000","last_peered":"2024-09-15T23:13:42.738832+0000","last_clean":"2024-09-15T23:13:42.738832+0000","last_became_active":"2024-09-15T23:12:41.748616+0000","last_became_peered":"2024-09-15T23:12:41.748616+0000","last_unstale":"2024-09-15T23:13:42.738832+0000","last_undegraded":"2024-09-15T23:13:42.738832+0000","last_fullsized":"2024-09-15T23:13:42.738832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:28.729933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745413+0000","last_change":"2024-09-15T23:12:39.485773+0000","last_active":"2024-09-15T23:12:42.745413+0000","last_peered":"2024-09-15T23:12:42.745413+0000","last_clean":"2024-09-15T23:12:42.745413+0000","last_became_active":"2024-09-15T23:12:39.485403+0000","last_became_peered":"2024-09-15T23:12:39.485403+0000","last_unstale":"2024-09-15T23:12:42.745413+0000","last_undegraded":"2024-09-15T23:12:42.745413+0000","last_fullsized":"2024-09-15T23:12:42.745413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:56.405296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740903+0000","last_change":"2024-09-15T23:12:41.752877+0000","last_active":"2024-09-15T23:12:42.740903+0000","last_peered":"2024-09-15T23:12:42.740903+0000","last_clean":"2024-09-15T23:12:42.740903+0000","last_became_active":"2024-09-15T23:12:41.748011+0000","last_became_peered":"2024-09-15T23:12:41.748011+0000","last_unstale":"2024-09-15T23:12:42.740903+0000","last_undegraded":"2024-09-15T23:12:42.740903+0000","last_fullsized":"2024-09-15T23:12:42.740903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:58.741067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737347+0000","last_change":"2024-09-15T23:12:41.743781+0000","last_active":"2024-09-15T23:13:42.737347+0000","last_peered":"2024-09-15T23:13:42.737347+0000","last_clean":"2024-09-15T23:13:42.737347+0000","last_became_active":"2024-09-15T23:12:41.743420+0000","last_became_peered":"2024-09-15T23:12:41.743420+0000","last_unstale":"2024-09-15T23:13:42.737347+0000","last_undegraded":"2024-09-15T23:13:42.737347+0000","last_fullsized":"2024-09-15T23:13:42.737347+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:51.728955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.743704+0000","last_change":"2024-09-15T23:12:39.478145+0000","last_active":"2024-09-15T23:12:42.743704+0000","last_peered":"2024-09-15T23:12:42.743704+0000","last_clean":"2024-09-15T23:12:42.743704+0000","last_became_active":"2024-09-15T23:12:39.477774+0000","last_became_peered":"2024-09-15T23:12:39.477774+0000","last_unstale":"2024-09-15T23:12:42.743704+0000","last_undegraded":"2024-09-15T23:12:42.743704+0000","last_fullsized":"2024-09-15T23:12:42.743704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:19.057212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734653+0000","last_change":"2024-09-15T23:12:41.747398+0000","last_active":"2024-09-15T23:13:42.734653+0000","last_peered":"2024-09-15T23:13:42.734653+0000","last_clean":"2024-09-15T23:13:42.734653+0000","last_became_active":"2024-09-15T23:12:41.747049+0000","last_became_peered":"2024-09-15T23:12:41.747049+0000","last_unstale":"2024-09-15T23:13:42.734653+0000","last_undegraded":"2024-09-15T23:13:42.734653+0000","last_fullsized":"2024-09-15T23:13:42.734653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:00.979843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.745155+0000","last_change":"2024-09-15T23:12:39.483666+0000","last_active":"2024-09-15T23:12:42.745155+0000","last_peered":"2024-09-15T23:12:42.745155+0000","last_clean":"2024-09-15T23:12:42.745155+0000","last_became_active":"2024-09-15T23:12:39.483309+0000","last_became_peered":"2024-09-15T23:12:39.483309+0000","last_unstale":"2024-09-15T23:12:42.745155+0000","last_undegraded":"2024-09-15T23:12:42.745155+0000","last_fullsized":"2024-09-15T23:12:42.745155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:25.785868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-15T23:12:42.740838+0000","last_change":"2024-09-15T23:12:41.758766+0000","last_active":"2024-09-15T23:12:42.740838+0000","last_peered":"2024-09-15T23:12:42.740838+0000","last_clean":"2024-09-15T23:12:42.740838+0000","last_became_active":"2024-09-15T23:12:41.758457+0000","last_became_peered":"2024-09-15T23:12:41.758457+0000","last_unstale":"2024-09-15T23:12:42.740838+0000","last_undegraded":"2024-09-15T23:12:42.740838+0000","last_fullsized":"2024-09-15T23:12:42.740838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:45.319708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738033+0000","last_change":"2024-09-15T23:12:39.692412+0000","last_active":"2024-09-15T23:13:42.738033+0000","last_peered":"2024-09-15T23:13:42.738033+0000","last_clean":"2024-09-15T23:13:42.738033+0000","last_became_active":"2024-09-15T23:12:39.691953+0000","last_became_peered":"2024-09-15T23:12:39.691953+0000","last_unstale":"2024-09-15T23:13:42.738033+0000","last_undegraded":"2024-09-15T23:13:42.738033+0000","last_fullsized":"2024-09-15T23:13:42.738033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:07.811976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737809+0000","last_change":"2024-09-15T23:12:41.753181+0000","last_active":"2024-09-15T23:13:42.737809+0000","last_peered":"2024-09-15T23:13:42.737809+0000","last_clean":"2024-09-15T23:13:42.737809+0000","last_became_active":"2024-09-15T23:12:41.752432+0000","last_became_peered":"2024-09-15T23:12:41.752432+0000","last_unstale":"2024-09-15T23:13:42.737809+0000","last_undegraded":"2024-09-15T23:13:42.737809+0000","last_fullsized":"2024-09-15T23:13:42.737809+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:37.363331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.746605+0000","last_change":"2024-09-15T23:13:42.746605+0000","last_active":"2024-09-15T23:13:42.746605+0000","last_peered":"2024-09-15T23:13:42.746605+0000","last_clean":"2024-09-15T23:13:42.746605+0000","last_became_active":"2024-09-15T23:13:42.740156+0000","last_became_peered":"2024-09-15T23:13:42.740156+0000","last_unstale":"2024-09-15T23:13:42.746605+0000","last_undegraded":"2024-09-15T23:13:42.746605+0000","last_fullsized":"2024-09-15T23:13:42.746605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:02.462553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":123,"num_read_kb":125,"num_write":84,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285160,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547226,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":872448,"data_stored":422542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776159,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1036288,"data_stored":1093340,"data_compressed":42042,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":440424,"data_compressed":5785,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201321,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":423146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430254,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":1013609,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593780,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":422659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822713,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":962560,"data_stored":1030509,"data_compressed":42042,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":439864,"data_compressed":5785,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":901120,"data_stored":431639,"data_compressed":2889,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444105,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":962560,"data_stored":494154,"data_compressed":2889,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":494120,"data_compressed":2889,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":876544,"data_stored":422632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34625,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34625,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34625,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:13:46.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T23:13:47.186 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:47.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:47 smithi112 ceph-mon[34367]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-15T23:13:47.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:47 smithi112 ceph-mon[34367]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:13:47.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:47 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:47.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:47 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:47.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:47 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:13:47.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:47 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:13:47.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:47 smithi112 ceph-mon[34367]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:47.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:47 smithi002 ceph-mon[31019]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-15T23:13:47.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:47 smithi002 ceph-mon[31019]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:13:47.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:47 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:47.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:47 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:47.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:47 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:13:47.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:47 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:13:47.559 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:47 smithi002 ceph-mon[31019]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.676+0000 7f123044b640 1 -- 172.21.15.2:0/3448752922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1228101df0 msgr2=0x7f12281021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.676+0000 7f123044b640 1 --2- 172.21.15.2:0/3448752922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1228101df0 0x7f12281021d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1224009980 tx=0x7f122402e820 comp rx=0 tx=0).stop 2024-09-15T23:13:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.676+0000 7f123044b640 1 -- 172.21.15.2:0/3448752922 shutdown_connections 2024-09-15T23:13:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.676+0000 7f123044b640 1 --2- 172.21.15.2:0/3448752922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1228106f20 0x7f122810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.676+0000 7f123044b640 1 --2- 172.21.15.2:0/3448752922 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12281027a0 0x7f12281067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.676+0000 7f123044b640 1 --2- 172.21.15.2:0/3448752922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1228101df0 0x7f12281021d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:47.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.676+0000 7f123044b640 1 -- 172.21.15.2:0/3448752922 >> 172.21.15.2:0/3448752922 conn(0x7f12280fd8f0 msgr2=0x7f12280ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.676+0000 7f123044b640 1 -- 172.21.15.2:0/3448752922 shutdown_connections 2024-09-15T23:13:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.676+0000 7f123044b640 1 -- 172.21.15.2:0/3448752922 wait complete. 2024-09-15T23:13:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f123044b640 1 Processor -- start 2024-09-15T23:13:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f123044b640 1 -- start start 2024-09-15T23:13:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f123044b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1228101df0 0x7f1228196200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f123044b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12281027a0 0x7f1228196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f123044b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1228106f20 0x7f122819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f123044b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f122810fc40 con 0x7f1228106f20 2024-09-15T23:13:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f123044b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f122810fac0 con 0x7f12281027a0 2024-09-15T23:13:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f123044b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f122810fdc0 con 0x7f1228101df0 2024-09-15T23:13:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f122e9e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1228106f20 0x7f122819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:47.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f122e9e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1228106f20 0x7f122819aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56486/0 (socket says 172.21.15.2:56486) 2024-09-15T23:13:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f122e9e8640 1 -- 172.21.15.2:0/2620784290 learned_addr learned my addr 172.21.15.2:0/2620784290 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f122e1e7640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1228101df0 0x7f1228196200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f122e9e8640 1 -- 172.21.15.2:0/2620784290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1228101df0 msgr2=0x7f1228196200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f122e9e8640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1228101df0 0x7f1228196200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f122e9e8640 1 -- 172.21.15.2:0/2620784290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12281027a0 msgr2=0x7f1228196740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f122e9e8640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12281027a0 0x7f1228196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f122e9e8640 1 -- 172.21.15.2:0/2620784290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122819b1b0 con 0x7f1228106f20 2024-09-15T23:13:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.677+0000 7f122e1e7640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1228101df0 0x7f1228196200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.678+0000 7f122e9e8640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1228106f20 0x7f122819aad0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f122000eaa0 tx=0x7f122000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.678+0000 7f121f7fe640 1 -- 172.21.15.2:0/2620784290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122000cdb0 con 0x7f1228106f20 2024-09-15T23:13:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.678+0000 7f123044b640 1 -- 172.21.15.2:0/2620784290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122819b4a0 con 0x7f1228106f20 2024-09-15T23:13:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.678+0000 7f121f7fe640 1 -- 172.21.15.2:0/2620784290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1220005020 con 0x7f1228106f20 2024-09-15T23:13:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.678+0000 7f121f7fe640 1 -- 172.21.15.2:0/2620784290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12200116d0 con 0x7f1228106f20 2024-09-15T23:13:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.678+0000 7f123044b640 1 -- 172.21.15.2:0/2620784290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12281a2d80 con 0x7f1228106f20 2024-09-15T23:13:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.679+0000 7f123044b640 1 -- 172.21.15.2:0/2620784290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12281021d0 con 0x7f1228106f20 2024-09-15T23:13:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.680+0000 7f121f7fe640 1 -- 172.21.15.2:0/2620784290 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f12200051d0 con 0x7f1228106f20 2024-09-15T23:13:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.681+0000 7f121f7fe640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f12140a32d0 0x7f12140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.681+0000 7f122e1e7640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f12140a32d0 0x7f12140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.681+0000 7f121f7fe640 1 -- 172.21.15.2:0/2620784290 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f12200cfce0 con 0x7f1228106f20 2024-09-15T23:13:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.681+0000 7f122e1e7640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f12140a32d0 0x7f12140a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1224006010 tx=0x7f1224005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:47.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.685+0000 7f121f7fe640 1 -- 172.21.15.2:0/2620784290 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1220016030 con 0x7f1228106f20 2024-09-15T23:13:47.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:47 smithi145 ceph-mon[34901]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-15T23:13:47.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:47 smithi145 ceph-mon[34901]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:13:47.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:47 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:47.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:47 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:47.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:47 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:13:47.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:47 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:13:47.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:47 smithi145 ceph-mon[34901]: from='mgr.14150 172.21.15.2:0/1521960996' entity='mgr.x' 2024-09-15T23:13:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.857+0000 7f123044b640 1 -- 172.21.15.2:0/2620784290 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f122810a160 con 0x7f12140a32d0 2024-09-15T23:13:47.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.863+0000 7f121f7fe640 1 -- 172.21.15.2:0/2620784290 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258896 (secure 0 0 0) 0x7f122810a160 con 0x7f12140a32d0 2024-09-15T23:13:47.867 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:47.868 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-15T23:13:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.866+0000 7f123044b640 1 -- 172.21.15.2:0/2620784290 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f12140a32d0 msgr2=0x7f12140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.866+0000 7f123044b640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f12140a32d0 0x7f12140a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1224006010 tx=0x7f1224005a20 comp rx=0 tx=0).stop 2024-09-15T23:13:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.866+0000 7f123044b640 1 -- 172.21.15.2:0/2620784290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1228106f20 msgr2=0x7f122819aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.866+0000 7f123044b640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1228106f20 0x7f122819aad0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f122000eaa0 tx=0x7f122000ef60 comp rx=0 tx=0).stop 2024-09-15T23:13:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.866+0000 7f123044b640 1 -- 172.21.15.2:0/2620784290 shutdown_connections 2024-09-15T23:13:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.866+0000 7f123044b640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f12140a32d0 0x7f12140a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.866+0000 7f123044b640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1228106f20 0x7f122819aad0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.866+0000 7f123044b640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f12281027a0 0x7f1228196740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.866+0000 7f123044b640 1 --2- 172.21.15.2:0/2620784290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1228101df0 0x7f1228196200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.866+0000 7f123044b640 1 -- 172.21.15.2:0/2620784290 >> 172.21.15.2:0/2620784290 conn(0x7f12280fd8f0 msgr2=0x7f12280fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.866+0000 7f123044b640 1 -- 172.21.15.2:0/2620784290 shutdown_connections 2024-09-15T23:13:47.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:47.866+0000 7f123044b640 1 -- 172.21.15.2:0/2620784290 wait complete. 2024-09-15T23:13:48.615 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-09-15T23:13:47.518893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":259,"num_read_kb":244,"num_write":267,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368584,"kb_used_data":10932,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573240,"statfs":{"total":1151940427776,"available":1151562997760,"internally_reserved":0,"allocated":11194368,"data_stored":7223679,"data_compressed":172399,"data_compressed_allocated":225280,"data_compressed_original":1949696,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002137"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738580+0000","last_change":"2024-09-15T23:12:41.750867+0000","last_active":"2024-09-15T23:13:42.738580+0000","last_peered":"2024-09-15T23:13:42.738580+0000","last_clean":"2024-09-15T23:13:42.738580+0000","last_became_active":"2024-09-15T23:12:41.750508+0000","last_became_peered":"2024-09-15T23:12:41.750508+0000","last_unstale":"2024-09-15T23:13:42.738580+0000","last_undegraded":"2024-09-15T23:13:42.738580+0000","last_fullsized":"2024-09-15T23:13:42.738580+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:55.104563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737145+0000","last_change":"2024-09-15T23:12:41.752704+0000","last_active":"2024-09-15T23:13:42.737145+0000","last_peered":"2024-09-15T23:13:42.737145+0000","last_clean":"2024-09-15T23:13:42.737145+0000","last_became_active":"2024-09-15T23:12:41.751144+0000","last_became_peered":"2024-09-15T23:12:41.751144+0000","last_unstale":"2024-09-15T23:13:42.737145+0000","last_undegraded":"2024-09-15T23:13:42.737145+0000","last_fullsized":"2024-09-15T23:13:42.737145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:10.332172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736895+0000","last_change":"2024-09-15T23:12:41.759051+0000","last_active":"2024-09-15T23:13:42.736895+0000","last_peered":"2024-09-15T23:13:42.736895+0000","last_clean":"2024-09-15T23:13:42.736895+0000","last_became_active":"2024-09-15T23:12:41.757243+0000","last_became_peered":"2024-09-15T23:12:41.757243+0000","last_unstale":"2024-09-15T23:13:42.736895+0000","last_undegraded":"2024-09-15T23:13:42.736895+0000","last_fullsized":"2024-09-15T23:13:42.736895+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:44.388027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739130+0000","last_change":"2024-09-15T23:12:41.751732+0000","last_active":"2024-09-15T23:13:42.739130+0000","last_peered":"2024-09-15T23:13:42.739130+0000","last_clean":"2024-09-15T23:13:42.739130+0000","last_became_active":"2024-09-15T23:12:41.751404+0000","last_became_peered":"2024-09-15T23:12:41.751404+0000","last_unstale":"2024-09-15T23:13:42.739130+0000","last_undegraded":"2024-09-15T23:13:42.739130+0000","last_fullsized":"2024-09-15T23:13:42.739130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:05.724326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734647+0000","last_change":"2024-09-15T23:12:41.750642+0000","last_active":"2024-09-15T23:13:42.734647+0000","last_peered":"2024-09-15T23:13:42.734647+0000","last_clean":"2024-09-15T23:13:42.734647+0000","last_became_active":"2024-09-15T23:12:41.750312+0000","last_became_peered":"2024-09-15T23:12:41.750312+0000","last_unstale":"2024-09-15T23:13:42.734647+0000","last_undegraded":"2024-09-15T23:13:42.734647+0000","last_fullsized":"2024-09-15T23:13:42.734647+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:46.168397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854193+0000","last_change":"2024-09-15T23:12:41.744794+0000","last_active":"2024-09-15T23:13:42.854193+0000","last_peered":"2024-09-15T23:13:42.854193+0000","last_clean":"2024-09-15T23:13:42.854193+0000","last_became_active":"2024-09-15T23:12:41.744468+0000","last_became_peered":"2024-09-15T23:12:41.744468+0000","last_unstale":"2024-09-15T23:13:42.854193+0000","last_undegraded":"2024-09-15T23:13:42.854193+0000","last_fullsized":"2024-09-15T23:13:42.854193+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:22.298132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736034+0000","last_change":"2024-09-15T23:12:41.746124+0000","last_active":"2024-09-15T23:13:42.736034+0000","last_peered":"2024-09-15T23:13:42.736034+0000","last_clean":"2024-09-15T23:13:42.736034+0000","last_became_active":"2024-09-15T23:12:41.745756+0000","last_became_peered":"2024-09-15T23:12:41.745756+0000","last_unstale":"2024-09-15T23:13:42.736034+0000","last_undegraded":"2024-09-15T23:13:42.736034+0000","last_fullsized":"2024-09-15T23:13:42.736034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:12.368976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736870+0000","last_change":"2024-09-15T23:12:41.742047+0000","last_active":"2024-09-15T23:13:42.736870+0000","last_peered":"2024-09-15T23:13:42.736870+0000","last_clean":"2024-09-15T23:13:42.736870+0000","last_became_active":"2024-09-15T23:12:41.741730+0000","last_became_peered":"2024-09-15T23:12:41.741730+0000","last_unstale":"2024-09-15T23:13:42.736870+0000","last_undegraded":"2024-09-15T23:13:42.736870+0000","last_fullsized":"2024-09-15T23:13:42.736870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:46.278342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.735299+0000","last_change":"2024-09-15T23:12:41.757117+0000","last_active":"2024-09-15T23:13:42.735299+0000","last_peered":"2024-09-15T23:13:42.735299+0000","last_clean":"2024-09-15T23:13:42.735299+0000","last_became_active":"2024-09-15T23:12:41.756515+0000","last_became_peered":"2024-09-15T23:12:41.756515+0000","last_unstale":"2024-09-15T23:13:42.735299+0000","last_undegraded":"2024-09-15T23:13:42.735299+0000","last_fullsized":"2024-09-15T23:13:42.735299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:37.453454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854406+0000","last_change":"2024-09-15T23:12:41.751118+0000","last_active":"2024-09-15T23:13:42.854406+0000","last_peered":"2024-09-15T23:13:42.854406+0000","last_clean":"2024-09-15T23:13:42.854406+0000","last_became_active":"2024-09-15T23:12:41.750748+0000","last_became_peered":"2024-09-15T23:12:41.750748+0000","last_unstale":"2024-09-15T23:13:42.854406+0000","last_undegraded":"2024-09-15T23:13:42.854406+0000","last_fullsized":"2024-09-15T23:13:42.854406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:55.079937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736645+0000","last_change":"2024-09-15T23:12:41.756539+0000","last_active":"2024-09-15T23:13:42.736645+0000","last_peered":"2024-09-15T23:13:42.736645+0000","last_clean":"2024-09-15T23:13:42.736645+0000","last_became_active":"2024-09-15T23:12:41.756191+0000","last_became_peered":"2024-09-15T23:12:41.756191+0000","last_unstale":"2024-09-15T23:13:42.736645+0000","last_undegraded":"2024-09-15T23:13:42.736645+0000","last_fullsized":"2024-09-15T23:13:42.736645+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:52.715699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739482+0000","last_change":"2024-09-15T23:12:41.750681+0000","last_active":"2024-09-15T23:13:42.739482+0000","last_peered":"2024-09-15T23:13:42.739482+0000","last_clean":"2024-09-15T23:13:42.739482+0000","last_became_active":"2024-09-15T23:12:41.750344+0000","last_became_peered":"2024-09-15T23:12:41.750344+0000","last_unstale":"2024-09-15T23:13:42.739482+0000","last_undegraded":"2024-09-15T23:13:42.739482+0000","last_fullsized":"2024-09-15T23:13:42.739482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:13.455792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.855482+0000","last_change":"2024-09-15T23:13:42.855482+0000","last_active":"2024-09-15T23:13:42.855482+0000","last_peered":"2024-09-15T23:13:42.855482+0000","last_clean":"2024-09-15T23:13:42.855482+0000","last_became_active":"2024-09-15T23:13:42.855055+0000","last_became_peered":"2024-09-15T23:13:42.855055+0000","last_unstale":"2024-09-15T23:13:42.855482+0000","last_undegraded":"2024-09-15T23:13:42.855482+0000","last_fullsized":"2024-09-15T23:13:42.855482+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:50.138289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736760+0000","last_change":"2024-09-15T23:12:41.750831+0000","last_active":"2024-09-15T23:13:42.736760+0000","last_peered":"2024-09-15T23:13:42.736760+0000","last_clean":"2024-09-15T23:13:42.736760+0000","last_became_active":"2024-09-15T23:12:41.750528+0000","last_became_peered":"2024-09-15T23:12:41.750528+0000","last_unstale":"2024-09-15T23:13:42.736760+0000","last_undegraded":"2024-09-15T23:13:42.736760+0000","last_fullsized":"2024-09-15T23:13:42.736760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:11.737726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736538+0000","last_change":"2024-09-15T23:12:41.750079+0000","last_active":"2024-09-15T23:13:42.736538+0000","last_peered":"2024-09-15T23:13:42.736538+0000","last_clean":"2024-09-15T23:13:42.736538+0000","last_became_active":"2024-09-15T23:12:41.749551+0000","last_became_peered":"2024-09-15T23:12:41.749551+0000","last_unstale":"2024-09-15T23:13:42.736538+0000","last_undegraded":"2024-09-15T23:13:42.736538+0000","last_fullsized":"2024-09-15T23:13:42.736538+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:37.283315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734536+0000","last_change":"2024-09-15T23:12:41.754855+0000","last_active":"2024-09-15T23:13:42.734536+0000","last_peered":"2024-09-15T23:13:42.734536+0000","last_clean":"2024-09-15T23:13:42.734536+0000","last_became_active":"2024-09-15T23:12:41.753825+0000","last_became_peered":"2024-09-15T23:12:41.753825+0000","last_unstale":"2024-09-15T23:13:42.734536+0000","last_undegraded":"2024-09-15T23:13:42.734536+0000","last_fullsized":"2024-09-15T23:13:42.734536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:21.488347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738688+0000","last_change":"2024-09-15T23:12:41.750708+0000","last_active":"2024-09-15T23:13:42.738688+0000","last_peered":"2024-09-15T23:13:42.738688+0000","last_clean":"2024-09-15T23:13:42.738688+0000","last_became_active":"2024-09-15T23:12:41.750372+0000","last_became_peered":"2024-09-15T23:12:41.750372+0000","last_unstale":"2024-09-15T23:13:42.738688+0000","last_undegraded":"2024-09-15T23:13:42.738688+0000","last_fullsized":"2024-09-15T23:13:42.738688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:22.693466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734408+0000","last_change":"2024-09-15T23:12:41.745514+0000","last_active":"2024-09-15T23:13:42.734408+0000","last_peered":"2024-09-15T23:13:42.734408+0000","last_clean":"2024-09-15T23:13:42.734408+0000","last_became_active":"2024-09-15T23:12:41.745165+0000","last_became_peered":"2024-09-15T23:12:41.745165+0000","last_unstale":"2024-09-15T23:13:42.734408+0000","last_undegraded":"2024-09-15T23:13:42.734408+0000","last_fullsized":"2024-09-15T23:13:42.734408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:39.275396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739431+0000","last_change":"2024-09-15T23:12:41.752590+0000","last_active":"2024-09-15T23:13:42.739431+0000","last_peered":"2024-09-15T23:13:42.739431+0000","last_clean":"2024-09-15T23:13:42.739431+0000","last_became_active":"2024-09-15T23:12:41.752269+0000","last_became_peered":"2024-09-15T23:12:41.752269+0000","last_unstale":"2024-09-15T23:13:42.739431+0000","last_undegraded":"2024-09-15T23:13:42.739431+0000","last_fullsized":"2024-09-15T23:13:42.739431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:48:12.304549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737868+0000","last_change":"2024-09-15T23:12:41.746485+0000","last_active":"2024-09-15T23:13:42.737868+0000","last_peered":"2024-09-15T23:13:42.737868+0000","last_clean":"2024-09-15T23:13:42.737868+0000","last_became_active":"2024-09-15T23:12:41.746148+0000","last_became_peered":"2024-09-15T23:12:41.746148+0000","last_unstale":"2024-09-15T23:13:42.737868+0000","last_undegraded":"2024-09-15T23:13:42.737868+0000","last_fullsized":"2024-09-15T23:13:42.737868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:38.874706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738437+0000","last_change":"2024-09-15T23:12:41.758169+0000","last_active":"2024-09-15T23:13:42.738437+0000","last_peered":"2024-09-15T23:13:42.738437+0000","last_clean":"2024-09-15T23:13:42.738437+0000","last_became_active":"2024-09-15T23:12:41.757542+0000","last_became_peered":"2024-09-15T23:12:41.757542+0000","last_unstale":"2024-09-15T23:13:42.738437+0000","last_undegraded":"2024-09-15T23:13:42.738437+0000","last_fullsized":"2024-09-15T23:13:42.738437+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:55.430022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734765+0000","last_change":"2024-09-15T23:12:41.751024+0000","last_active":"2024-09-15T23:13:42.734765+0000","last_peered":"2024-09-15T23:13:42.734765+0000","last_clean":"2024-09-15T23:13:42.734765+0000","last_became_active":"2024-09-15T23:12:41.750610+0000","last_became_peered":"2024-09-15T23:12:41.750610+0000","last_unstale":"2024-09-15T23:13:42.734765+0000","last_undegraded":"2024-09-15T23:13:42.734765+0000","last_fullsized":"2024-09-15T23:13:42.734765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:54.563688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.741766+0000","last_change":"2024-09-15T23:13:42.741376+0000","last_active":"2024-09-15T23:13:42.741766+0000","last_peered":"2024-09-15T23:13:42.741766+0000","last_clean":"2024-09-15T23:13:42.741766+0000","last_became_active":"2024-09-15T23:13:42.741028+0000","last_became_peered":"2024-09-15T23:13:42.741028+0000","last_unstale":"2024-09-15T23:13:42.741766+0000","last_undegraded":"2024-09-15T23:13:42.741766+0000","last_fullsized":"2024-09-15T23:13:42.741766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:42.590282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736677+0000","last_change":"2024-09-15T23:12:41.748306+0000","last_active":"2024-09-15T23:13:42.736677+0000","last_peered":"2024-09-15T23:13:42.736677+0000","last_clean":"2024-09-15T23:13:42.736677+0000","last_became_active":"2024-09-15T23:12:41.747950+0000","last_became_peered":"2024-09-15T23:12:41.747950+0000","last_unstale":"2024-09-15T23:13:42.736677+0000","last_undegraded":"2024-09-15T23:13:42.736677+0000","last_fullsized":"2024-09-15T23:13:42.736677+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:51.846769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.743799+0000","last_change":"2024-09-15T23:13:42.743799+0000","last_active":"2024-09-15T23:13:42.743799+0000","last_peered":"2024-09-15T23:13:42.743799+0000","last_clean":"2024-09-15T23:13:42.743799+0000","last_became_active":"2024-09-15T23:13:42.743404+0000","last_became_peered":"2024-09-15T23:13:42.743404+0000","last_unstale":"2024-09-15T23:13:42.743799+0000","last_undegraded":"2024-09-15T23:13:42.743799+0000","last_fullsized":"2024-09-15T23:13:42.743799+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:01.153392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739858+0000","last_change":"2024-09-15T23:12:41.745342+0000","last_active":"2024-09-15T23:13:42.739858+0000","last_peered":"2024-09-15T23:13:42.739858+0000","last_clean":"2024-09-15T23:13:42.739858+0000","last_became_active":"2024-09-15T23:12:41.743658+0000","last_became_peered":"2024-09-15T23:12:41.743658+0000","last_unstale":"2024-09-15T23:13:42.739858+0000","last_undegraded":"2024-09-15T23:13:42.739858+0000","last_fullsized":"2024-09-15T23:13:42.739858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:32.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739166+0000","last_change":"2024-09-15T23:12:41.753015+0000","last_active":"2024-09-15T23:13:42.739166+0000","last_peered":"2024-09-15T23:13:42.739166+0000","last_clean":"2024-09-15T23:13:42.739166+0000","last_became_active":"2024-09-15T23:12:41.752692+0000","last_became_peered":"2024-09-15T23:12:41.752692+0000","last_unstale":"2024-09-15T23:13:42.739166+0000","last_undegraded":"2024-09-15T23:13:42.739166+0000","last_fullsized":"2024-09-15T23:13:42.739166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:51.310427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736979+0000","last_change":"2024-09-15T23:12:41.757381+0000","last_active":"2024-09-15T23:13:42.736979+0000","last_peered":"2024-09-15T23:13:42.736979+0000","last_clean":"2024-09-15T23:13:42.736979+0000","last_became_active":"2024-09-15T23:12:41.757075+0000","last_became_peered":"2024-09-15T23:12:41.757075+0000","last_unstale":"2024-09-15T23:13:42.736979+0000","last_undegraded":"2024-09-15T23:13:42.736979+0000","last_fullsized":"2024-09-15T23:13:42.736979+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:57.282022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.740803+0000","last_change":"2024-09-15T23:13:42.740803+0000","last_active":"2024-09-15T23:13:42.740803+0000","last_peered":"2024-09-15T23:13:42.740803+0000","last_clean":"2024-09-15T23:13:42.740803+0000","last_became_active":"2024-09-15T23:13:42.740404+0000","last_became_peered":"2024-09-15T23:13:42.740404+0000","last_unstale":"2024-09-15T23:13:42.740803+0000","last_undegraded":"2024-09-15T23:13:42.740803+0000","last_fullsized":"2024-09-15T23:13:42.740803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:02.401182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739782+0000","last_change":"2024-09-15T23:12:41.750087+0000","last_active":"2024-09-15T23:13:42.739782+0000","last_peered":"2024-09-15T23:13:42.739782+0000","last_clean":"2024-09-15T23:13:42.739782+0000","last_became_active":"2024-09-15T23:12:41.749752+0000","last_became_peered":"2024-09-15T23:12:41.749752+0000","last_unstale":"2024-09-15T23:13:42.739782+0000","last_undegraded":"2024-09-15T23:13:42.739782+0000","last_fullsized":"2024-09-15T23:13:42.739782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:03.483448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739666+0000","last_change":"2024-09-15T23:12:41.746724+0000","last_active":"2024-09-15T23:13:42.739666+0000","last_peered":"2024-09-15T23:13:42.739666+0000","last_clean":"2024-09-15T23:13:42.739666+0000","last_became_active":"2024-09-15T23:12:41.746333+0000","last_became_peered":"2024-09-15T23:12:41.746333+0000","last_unstale":"2024-09-15T23:13:42.739666+0000","last_undegraded":"2024-09-15T23:13:42.739666+0000","last_fullsized":"2024-09-15T23:13:42.739666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:04.413591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737918+0000","last_change":"2024-09-15T23:12:41.749473+0000","last_active":"2024-09-15T23:13:42.737918+0000","last_peered":"2024-09-15T23:13:42.737918+0000","last_clean":"2024-09-15T23:13:42.737918+0000","last_became_active":"2024-09-15T23:12:41.748764+0000","last_became_peered":"2024-09-15T23:12:41.748764+0000","last_unstale":"2024-09-15T23:13:42.737918+0000","last_undegraded":"2024-09-15T23:13:42.737918+0000","last_fullsized":"2024-09-15T23:13:42.737918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:43.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734682+0000","last_change":"2024-09-15T23:12:41.755451+0000","last_active":"2024-09-15T23:13:42.734682+0000","last_peered":"2024-09-15T23:13:42.734682+0000","last_clean":"2024-09-15T23:13:42.734682+0000","last_became_active":"2024-09-15T23:12:41.755083+0000","last_became_peered":"2024-09-15T23:12:41.755083+0000","last_unstale":"2024-09-15T23:13:42.734682+0000","last_undegraded":"2024-09-15T23:13:42.734682+0000","last_fullsized":"2024-09-15T23:13:42.734682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:06.340043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738169+0000","last_change":"2024-09-15T23:12:39.485771+0000","last_active":"2024-09-15T23:13:42.738169+0000","last_peered":"2024-09-15T23:13:42.738169+0000","last_clean":"2024-09-15T23:13:42.738169+0000","last_became_active":"2024-09-15T23:12:39.485430+0000","last_became_peered":"2024-09-15T23:12:39.485430+0000","last_unstale":"2024-09-15T23:13:42.738169+0000","last_undegraded":"2024-09-15T23:13:42.738169+0000","last_fullsized":"2024-09-15T23:13:42.738169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:49:08.027243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737396+0000","last_change":"2024-09-15T23:12:41.748977+0000","last_active":"2024-09-15T23:13:42.737396+0000","last_peered":"2024-09-15T23:13:42.737396+0000","last_clean":"2024-09-15T23:13:42.737396+0000","last_became_active":"2024-09-15T23:12:41.748616+0000","last_became_peered":"2024-09-15T23:12:41.748616+0000","last_unstale":"2024-09-15T23:13:42.737396+0000","last_undegraded":"2024-09-15T23:13:42.737396+0000","last_fullsized":"2024-09-15T23:13:42.737396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:45.248469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854329+0000","last_change":"2024-09-15T23:12:39.486497+0000","last_active":"2024-09-15T23:13:42.854329+0000","last_peered":"2024-09-15T23:13:42.854329+0000","last_clean":"2024-09-15T23:13:42.854329+0000","last_became_active":"2024-09-15T23:12:39.486173+0000","last_became_peered":"2024-09-15T23:12:39.486173+0000","last_unstale":"2024-09-15T23:13:42.854329+0000","last_undegraded":"2024-09-15T23:13:42.854329+0000","last_fullsized":"2024-09-15T23:13:42.854329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:06.125300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736643+0000","last_change":"2024-09-15T23:12:39.483270+0000","last_active":"2024-09-15T23:13:42.736643+0000","last_peered":"2024-09-15T23:13:42.736643+0000","last_clean":"2024-09-15T23:13:42.736643+0000","last_became_active":"2024-09-15T23:12:39.482913+0000","last_became_peered":"2024-09-15T23:12:39.482913+0000","last_unstale":"2024-09-15T23:13:42.736643+0000","last_undegraded":"2024-09-15T23:13:42.736643+0000","last_fullsized":"2024-09-15T23:13:42.736643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:25.333182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736977+0000","last_change":"2024-09-15T23:12:41.741778+0000","last_active":"2024-09-15T23:13:42.736977+0000","last_peered":"2024-09-15T23:13:42.736977+0000","last_clean":"2024-09-15T23:13:42.736977+0000","last_became_active":"2024-09-15T23:12:41.740768+0000","last_became_peered":"2024-09-15T23:12:41.740768+0000","last_unstale":"2024-09-15T23:13:42.736977+0000","last_undegraded":"2024-09-15T23:13:42.736977+0000","last_fullsized":"2024-09-15T23:13:42.736977+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:22.086290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737060+0000","last_change":"2024-09-15T23:12:39.483029+0000","last_active":"2024-09-15T23:13:42.737060+0000","last_peered":"2024-09-15T23:13:42.737060+0000","last_clean":"2024-09-15T23:13:42.737060+0000","last_became_active":"2024-09-15T23:12:39.482080+0000","last_became_peered":"2024-09-15T23:12:39.482080+0000","last_unstale":"2024-09-15T23:13:42.737060+0000","last_undegraded":"2024-09-15T23:13:42.737060+0000","last_fullsized":"2024-09-15T23:13:42.737060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:41.076993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734020+0000","last_change":"2024-09-15T23:12:41.747332+0000","last_active":"2024-09-15T23:13:42.734020+0000","last_peered":"2024-09-15T23:13:42.734020+0000","last_clean":"2024-09-15T23:13:42.734020+0000","last_became_active":"2024-09-15T23:12:41.746818+0000","last_became_peered":"2024-09-15T23:12:41.746818+0000","last_unstale":"2024-09-15T23:13:42.734020+0000","last_undegraded":"2024-09-15T23:13:42.734020+0000","last_fullsized":"2024-09-15T23:13:42.734020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:14.323947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854189+0000","last_change":"2024-09-15T23:12:39.486150+0000","last_active":"2024-09-15T23:13:42.854189+0000","last_peered":"2024-09-15T23:13:42.854189+0000","last_clean":"2024-09-15T23:13:42.854189+0000","last_became_active":"2024-09-15T23:12:39.485827+0000","last_became_peered":"2024-09-15T23:12:39.485827+0000","last_unstale":"2024-09-15T23:13:42.854189+0000","last_undegraded":"2024-09-15T23:13:42.854189+0000","last_fullsized":"2024-09-15T23:13:42.854189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:53.308822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.735085+0000","last_change":"2024-09-15T23:12:41.747866+0000","last_active":"2024-09-15T23:13:42.735085+0000","last_peered":"2024-09-15T23:13:42.735085+0000","last_clean":"2024-09-15T23:13:42.735085+0000","last_became_active":"2024-09-15T23:12:41.746593+0000","last_became_peered":"2024-09-15T23:12:41.746593+0000","last_unstale":"2024-09-15T23:13:42.735085+0000","last_undegraded":"2024-09-15T23:13:42.735085+0000","last_fullsized":"2024-09-15T23:13:42.735085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:35.952241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736450+0000","last_change":"2024-09-15T23:12:39.486320+0000","last_active":"2024-09-15T23:13:42.736450+0000","last_peered":"2024-09-15T23:13:42.736450+0000","last_clean":"2024-09-15T23:13:42.736450+0000","last_became_active":"2024-09-15T23:12:39.486010+0000","last_became_peered":"2024-09-15T23:12:39.486010+0000","last_unstale":"2024-09-15T23:13:42.736450+0000","last_undegraded":"2024-09-15T23:13:42.736450+0000","last_fullsized":"2024-09-15T23:13:42.736450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:33.701288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737750+0000","last_change":"2024-09-15T23:12:41.759468+0000","last_active":"2024-09-15T23:13:42.737750+0000","last_peered":"2024-09-15T23:13:42.737750+0000","last_clean":"2024-09-15T23:13:42.737750+0000","last_became_active":"2024-09-15T23:12:41.758145+0000","last_became_peered":"2024-09-15T23:12:41.758145+0000","last_unstale":"2024-09-15T23:13:42.737750+0000","last_undegraded":"2024-09-15T23:13:42.737750+0000","last_fullsized":"2024-09-15T23:13:42.737750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:19.055440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737462+0000","last_change":"2024-09-15T23:12:39.693366+0000","last_active":"2024-09-15T23:13:42.737462+0000","last_peered":"2024-09-15T23:13:42.737462+0000","last_clean":"2024-09-15T23:13:42.737462+0000","last_became_active":"2024-09-15T23:12:39.692941+0000","last_became_peered":"2024-09-15T23:12:39.692941+0000","last_unstale":"2024-09-15T23:13:42.737462+0000","last_undegraded":"2024-09-15T23:13:42.737462+0000","last_fullsized":"2024-09-15T23:13:42.737462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:04.371184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734908+0000","last_change":"2024-09-15T23:12:41.750195+0000","last_active":"2024-09-15T23:13:42.734908+0000","last_peered":"2024-09-15T23:13:42.734908+0000","last_clean":"2024-09-15T23:13:42.734908+0000","last_became_active":"2024-09-15T23:12:41.749862+0000","last_became_peered":"2024-09-15T23:12:41.749862+0000","last_unstale":"2024-09-15T23:13:42.734908+0000","last_undegraded":"2024-09-15T23:13:42.734908+0000","last_fullsized":"2024-09-15T23:13:42.734908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:59.746604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":166,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854545+0000","last_change":"2024-09-15T23:12:39.485608+0000","last_active":"2024-09-15T23:13:42.854545+0000","last_peered":"2024-09-15T23:13:42.854545+0000","last_clean":"2024-09-15T23:13:42.854545+0000","last_became_active":"2024-09-15T23:12:39.485266+0000","last_became_peered":"2024-09-15T23:12:39.485266+0000","last_unstale":"2024-09-15T23:13:42.854545+0000","last_undegraded":"2024-09-15T23:13:42.854545+0000","last_fullsized":"2024-09-15T23:13:42.854545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:04.696726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":119,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.735117+0000","last_change":"2024-09-15T23:12:41.756495+0000","last_active":"2024-09-15T23:13:42.735117+0000","last_peered":"2024-09-15T23:13:42.735117+0000","last_clean":"2024-09-15T23:13:42.735117+0000","last_became_active":"2024-09-15T23:12:41.756130+0000","last_became_peered":"2024-09-15T23:12:41.756130+0000","last_unstale":"2024-09-15T23:13:42.735117+0000","last_undegraded":"2024-09-15T23:13:42.735117+0000","last_fullsized":"2024-09-15T23:13:42.735117+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:29.100300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739935+0000","last_change":"2024-09-15T23:12:39.488511+0000","last_active":"2024-09-15T23:13:42.739935+0000","last_peered":"2024-09-15T23:13:42.739935+0000","last_clean":"2024-09-15T23:13:42.739935+0000","last_became_active":"2024-09-15T23:12:39.488199+0000","last_became_peered":"2024-09-15T23:12:39.488199+0000","last_unstale":"2024-09-15T23:13:42.739935+0000","last_undegraded":"2024-09-15T23:13:42.739935+0000","last_fullsized":"2024-09-15T23:13:42.739935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:08.678809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737051+0000","last_change":"2024-09-15T23:12:41.756216+0000","last_active":"2024-09-15T23:13:42.737051+0000","last_peered":"2024-09-15T23:13:42.737051+0000","last_clean":"2024-09-15T23:13:42.737051+0000","last_became_active":"2024-09-15T23:12:41.755857+0000","last_became_peered":"2024-09-15T23:12:41.755857+0000","last_unstale":"2024-09-15T23:13:42.737051+0000","last_undegraded":"2024-09-15T23:13:42.737051+0000","last_fullsized":"2024-09-15T23:13:42.737051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:03.639704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737111+0000","last_change":"2024-09-15T23:12:39.482504+0000","last_active":"2024-09-15T23:13:42.737111+0000","last_peered":"2024-09-15T23:13:42.737111+0000","last_clean":"2024-09-15T23:13:42.737111+0000","last_became_active":"2024-09-15T23:12:39.482083+0000","last_became_peered":"2024-09-15T23:12:39.482083+0000","last_unstale":"2024-09-15T23:13:42.737111+0000","last_undegraded":"2024-09-15T23:13:42.737111+0000","last_fullsized":"2024-09-15T23:13:42.737111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:33.273301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736159+0000","last_change":"2024-09-15T23:12:41.752607+0000","last_active":"2024-09-15T23:13:42.736159+0000","last_peered":"2024-09-15T23:13:42.736159+0000","last_clean":"2024-09-15T23:13:42.736159+0000","last_became_active":"2024-09-15T23:12:41.752217+0000","last_became_peered":"2024-09-15T23:12:41.752217+0000","last_unstale":"2024-09-15T23:13:42.736159+0000","last_undegraded":"2024-09-15T23:13:42.736159+0000","last_fullsized":"2024-09-15T23:13:42.736159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:46:01.152604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739218+0000","last_change":"2024-09-15T23:12:39.486036+0000","last_active":"2024-09-15T23:13:42.739218+0000","last_peered":"2024-09-15T23:13:42.739218+0000","last_clean":"2024-09-15T23:13:42.739218+0000","last_became_active":"2024-09-15T23:12:39.485703+0000","last_became_peered":"2024-09-15T23:12:39.485703+0000","last_unstale":"2024-09-15T23:13:42.739218+0000","last_undegraded":"2024-09-15T23:13:42.739218+0000","last_fullsized":"2024-09-15T23:13:42.739218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:19.172258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736231+0000","last_change":"2024-09-15T23:12:41.751872+0000","last_active":"2024-09-15T23:13:42.736231+0000","last_peered":"2024-09-15T23:13:42.736231+0000","last_clean":"2024-09-15T23:13:42.736231+0000","last_became_active":"2024-09-15T23:12:41.751172+0000","last_became_peered":"2024-09-15T23:12:41.751172+0000","last_unstale":"2024-09-15T23:13:42.736231+0000","last_undegraded":"2024-09-15T23:13:42.736231+0000","last_fullsized":"2024-09-15T23:13:42.736231+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:00.508912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.750506+0000","last_change":"2024-09-15T23:13:42.750506+0000","last_active":"2024-09-15T23:13:42.750506+0000","last_peered":"2024-09-15T23:13:42.750506+0000","last_clean":"2024-09-15T23:13:42.750506+0000","last_became_active":"2024-09-15T23:13:42.741901+0000","last_became_peered":"2024-09-15T23:13:42.741901+0000","last_unstale":"2024-09-15T23:13:42.750506+0000","last_undegraded":"2024-09-15T23:13:42.750506+0000","last_fullsized":"2024-09-15T23:13:42.750506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:56.099580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.740888+0000","last_change":"2024-09-15T23:13:42.740888+0000","last_active":"2024-09-15T23:13:42.740888+0000","last_peered":"2024-09-15T23:13:42.740888+0000","last_clean":"2024-09-15T23:13:42.740888+0000","last_became_active":"2024-09-15T23:13:42.740411+0000","last_became_peered":"2024-09-15T23:13:42.740411+0000","last_unstale":"2024-09-15T23:13:42.740888+0000","last_undegraded":"2024-09-15T23:13:42.740888+0000","last_fullsized":"2024-09-15T23:13:42.740888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:16.541800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.735988+0000","last_change":"2024-09-15T23:12:39.481639+0000","last_active":"2024-09-15T23:13:42.735988+0000","last_peered":"2024-09-15T23:13:42.735988+0000","last_clean":"2024-09-15T23:13:42.735988+0000","last_became_active":"2024-09-15T23:12:39.481231+0000","last_became_peered":"2024-09-15T23:12:39.481231+0000","last_unstale":"2024-09-15T23:13:42.735988+0000","last_undegraded":"2024-09-15T23:13:42.735988+0000","last_fullsized":"2024-09-15T23:13:42.735988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:37.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738249+0000","last_change":"2024-09-15T23:12:41.751557+0000","last_active":"2024-09-15T23:13:42.738249+0000","last_peered":"2024-09-15T23:13:42.738249+0000","last_clean":"2024-09-15T23:13:42.738249+0000","last_became_active":"2024-09-15T23:12:41.751257+0000","last_became_peered":"2024-09-15T23:12:41.751257+0000","last_unstale":"2024-09-15T23:13:42.738249+0000","last_undegraded":"2024-09-15T23:13:42.738249+0000","last_fullsized":"2024-09-15T23:13:42.738249+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:59:48.799875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737342+0000","last_change":"2024-09-15T23:12:39.485812+0000","last_active":"2024-09-15T23:13:42.737342+0000","last_peered":"2024-09-15T23:13:42.737342+0000","last_clean":"2024-09-15T23:13:42.737342+0000","last_became_active":"2024-09-15T23:12:39.485447+0000","last_became_peered":"2024-09-15T23:12:39.485447+0000","last_unstale":"2024-09-15T23:13:42.737342+0000","last_undegraded":"2024-09-15T23:13:42.737342+0000","last_fullsized":"2024-09-15T23:13:42.737342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:05.483798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736676+0000","last_change":"2024-09-15T23:12:41.753166+0000","last_active":"2024-09-15T23:13:42.736676+0000","last_peered":"2024-09-15T23:13:42.736676+0000","last_clean":"2024-09-15T23:13:42.736676+0000","last_became_active":"2024-09-15T23:12:41.752841+0000","last_became_peered":"2024-09-15T23:12:41.752841+0000","last_unstale":"2024-09-15T23:13:42.736676+0000","last_undegraded":"2024-09-15T23:13:42.736676+0000","last_fullsized":"2024-09-15T23:13:42.736676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:38.439192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737927+0000","last_change":"2024-09-15T23:12:39.484696+0000","last_active":"2024-09-15T23:13:42.737927+0000","last_peered":"2024-09-15T23:13:42.737927+0000","last_clean":"2024-09-15T23:13:42.737927+0000","last_became_active":"2024-09-15T23:12:39.484230+0000","last_became_peered":"2024-09-15T23:12:39.484230+0000","last_unstale":"2024-09-15T23:13:42.737927+0000","last_undegraded":"2024-09-15T23:13:42.737927+0000","last_fullsized":"2024-09-15T23:13:42.737927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:12.456661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736264+0000","last_change":"2024-09-15T23:12:41.750605+0000","last_active":"2024-09-15T23:13:42.736264+0000","last_peered":"2024-09-15T23:13:42.736264+0000","last_clean":"2024-09-15T23:13:42.736264+0000","last_became_active":"2024-09-15T23:12:41.750236+0000","last_became_peered":"2024-09-15T23:12:41.750236+0000","last_unstale":"2024-09-15T23:13:42.736264+0000","last_undegraded":"2024-09-15T23:13:42.736264+0000","last_fullsized":"2024-09-15T23:13:42.736264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:24.918315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.741230+0000","last_change":"2024-09-15T23:13:42.740796+0000","last_active":"2024-09-15T23:13:42.741230+0000","last_peered":"2024-09-15T23:13:42.741230+0000","last_clean":"2024-09-15T23:13:42.741230+0000","last_became_active":"2024-09-15T23:13:42.740451+0000","last_became_peered":"2024-09-15T23:13:42.740451+0000","last_unstale":"2024-09-15T23:13:42.741230+0000","last_undegraded":"2024-09-15T23:13:42.741230+0000","last_fullsized":"2024-09-15T23:13:42.741230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:51.458936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736772+0000","last_change":"2024-09-15T23:12:41.751629+0000","last_active":"2024-09-15T23:13:42.736772+0000","last_peered":"2024-09-15T23:13:42.736772+0000","last_clean":"2024-09-15T23:13:42.736772+0000","last_became_active":"2024-09-15T23:12:41.751279+0000","last_became_peered":"2024-09-15T23:12:41.751279+0000","last_unstale":"2024-09-15T23:13:42.736772+0000","last_undegraded":"2024-09-15T23:13:42.736772+0000","last_fullsized":"2024-09-15T23:13:42.736772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:34.240811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":347,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736544+0000","last_change":"2024-09-15T23:11:26.734634+0000","last_active":"2024-09-15T23:13:42.736544+0000","last_peered":"2024-09-15T23:13:42.736544+0000","last_clean":"2024-09-15T23:13:42.736544+0000","last_became_active":"2024-09-15T23:11:26.734217+0000","last_became_peered":"2024-09-15T23:11:26.734217+0000","last_unstale":"2024-09-15T23:13:42.736544+0000","last_undegraded":"2024-09-15T23:13:42.736544+0000","last_fullsized":"2024-09-15T23:13:42.736544+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:07:58.008474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:07:58.008474+0000","last_clean_scrub_stamp":"2024-09-15T23:07:58.008474+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:59.634217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739334+0000","last_change":"2024-09-15T23:12:39.485101+0000","last_active":"2024-09-15T23:13:42.739334+0000","last_peered":"2024-09-15T23:13:42.739334+0000","last_clean":"2024-09-15T23:13:42.739334+0000","last_became_active":"2024-09-15T23:12:39.484651+0000","last_became_peered":"2024-09-15T23:12:39.484651+0000","last_unstale":"2024-09-15T23:13:42.739334+0000","last_undegraded":"2024-09-15T23:13:42.739334+0000","last_fullsized":"2024-09-15T23:13:42.739334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:46.709430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738666+0000","last_change":"2024-09-15T23:12:41.742460+0000","last_active":"2024-09-15T23:13:42.738666+0000","last_peered":"2024-09-15T23:13:42.738666+0000","last_clean":"2024-09-15T23:13:42.738666+0000","last_became_active":"2024-09-15T23:12:41.742157+0000","last_became_peered":"2024-09-15T23:12:41.742157+0000","last_unstale":"2024-09-15T23:13:42.738666+0000","last_undegraded":"2024-09-15T23:13:42.738666+0000","last_fullsized":"2024-09-15T23:13:42.738666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:36.602078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.740237+0000","last_change":"2024-09-15T23:13:42.740237+0000","last_active":"2024-09-15T23:13:42.740237+0000","last_peered":"2024-09-15T23:13:42.740237+0000","last_clean":"2024-09-15T23:13:42.740237+0000","last_became_active":"2024-09-15T23:13:42.739884+0000","last_became_peered":"2024-09-15T23:13:42.739884+0000","last_unstale":"2024-09-15T23:13:42.740237+0000","last_undegraded":"2024-09-15T23:13:42.740237+0000","last_fullsized":"2024-09-15T23:13:42.740237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:31.042545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736537+0000","last_change":"2024-09-15T23:12:41.752430+0000","last_active":"2024-09-15T23:13:42.736537+0000","last_peered":"2024-09-15T23:13:42.736537+0000","last_clean":"2024-09-15T23:13:42.736537+0000","last_became_active":"2024-09-15T23:12:41.752102+0000","last_became_peered":"2024-09-15T23:12:41.752102+0000","last_unstale":"2024-09-15T23:13:42.736537+0000","last_undegraded":"2024-09-15T23:13:42.736537+0000","last_fullsized":"2024-09-15T23:13:42.736537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:50.177644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738067+0000","last_change":"2024-09-15T23:12:39.692189+0000","last_active":"2024-09-15T23:13:42.738067+0000","last_peered":"2024-09-15T23:13:42.738067+0000","last_clean":"2024-09-15T23:13:42.738067+0000","last_became_active":"2024-09-15T23:12:39.691839+0000","last_became_peered":"2024-09-15T23:12:39.691839+0000","last_unstale":"2024-09-15T23:13:42.738067+0000","last_undegraded":"2024-09-15T23:13:42.738067+0000","last_fullsized":"2024-09-15T23:13:42.738067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:31.286533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736677+0000","last_change":"2024-09-15T23:12:41.745096+0000","last_active":"2024-09-15T23:13:42.736677+0000","last_peered":"2024-09-15T23:13:42.736677+0000","last_clean":"2024-09-15T23:13:42.736677+0000","last_became_active":"2024-09-15T23:12:41.744647+0000","last_became_peered":"2024-09-15T23:12:41.744647+0000","last_unstale":"2024-09-15T23:13:42.736677+0000","last_undegraded":"2024-09-15T23:13:42.736677+0000","last_fullsized":"2024-09-15T23:13:42.736677+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:06.681024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736642+0000","last_change":"2024-09-15T23:12:39.482633+0000","last_active":"2024-09-15T23:13:42.736642+0000","last_peered":"2024-09-15T23:13:42.736642+0000","last_clean":"2024-09-15T23:13:42.736642+0000","last_became_active":"2024-09-15T23:12:39.481842+0000","last_became_peered":"2024-09-15T23:12:39.481842+0000","last_unstale":"2024-09-15T23:13:42.736642+0000","last_undegraded":"2024-09-15T23:13:42.736642+0000","last_fullsized":"2024-09-15T23:13:42.736642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:16.995713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854456+0000","last_change":"2024-09-15T23:12:41.750155+0000","last_active":"2024-09-15T23:13:42.854456+0000","last_peered":"2024-09-15T23:13:42.854456+0000","last_clean":"2024-09-15T23:13:42.854456+0000","last_became_active":"2024-09-15T23:12:41.749851+0000","last_became_peered":"2024-09-15T23:12:41.749851+0000","last_unstale":"2024-09-15T23:13:42.854456+0000","last_undegraded":"2024-09-15T23:13:42.854456+0000","last_fullsized":"2024-09-15T23:13:42.854456+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:48.019129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734272+0000","last_change":"2024-09-15T23:12:39.692721+0000","last_active":"2024-09-15T23:13:42.734272+0000","last_peered":"2024-09-15T23:13:42.734272+0000","last_clean":"2024-09-15T23:13:42.734272+0000","last_became_active":"2024-09-15T23:12:39.692345+0000","last_became_peered":"2024-09-15T23:12:39.692345+0000","last_unstale":"2024-09-15T23:13:42.734272+0000","last_undegraded":"2024-09-15T23:13:42.734272+0000","last_fullsized":"2024-09-15T23:13:42.734272+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:36.527037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.854193+0000","last_change":"2024-09-15T23:12:41.739854+0000","last_active":"2024-09-15T23:13:42.854193+0000","last_peered":"2024-09-15T23:13:42.854193+0000","last_clean":"2024-09-15T23:13:42.854193+0000","last_became_active":"2024-09-15T23:12:41.739514+0000","last_became_peered":"2024-09-15T23:12:41.739514+0000","last_unstale":"2024-09-15T23:13:42.854193+0000","last_undegraded":"2024-09-15T23:13:42.854193+0000","last_fullsized":"2024-09-15T23:13:42.854193+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:08.001384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.735247+0000","last_change":"2024-09-15T23:12:39.693238+0000","last_active":"2024-09-15T23:13:42.735247+0000","last_peered":"2024-09-15T23:13:42.735247+0000","last_clean":"2024-09-15T23:13:42.735247+0000","last_became_active":"2024-09-15T23:12:39.692838+0000","last_became_peered":"2024-09-15T23:12:39.692838+0000","last_unstale":"2024-09-15T23:13:42.735247+0000","last_undegraded":"2024-09-15T23:13:42.735247+0000","last_fullsized":"2024-09-15T23:13:42.735247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:48.385920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737084+0000","last_change":"2024-09-15T23:12:41.750113+0000","last_active":"2024-09-15T23:13:42.737084+0000","last_peered":"2024-09-15T23:13:42.737084+0000","last_clean":"2024-09-15T23:13:42.737084+0000","last_became_active":"2024-09-15T23:12:41.749799+0000","last_became_peered":"2024-09-15T23:12:41.749799+0000","last_unstale":"2024-09-15T23:13:42.737084+0000","last_undegraded":"2024-09-15T23:13:42.737084+0000","last_fullsized":"2024-09-15T23:13:42.737084+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:52:48.095393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734478+0000","last_change":"2024-09-15T23:12:39.480093+0000","last_active":"2024-09-15T23:13:42.734478+0000","last_peered":"2024-09-15T23:13:42.734478+0000","last_clean":"2024-09-15T23:13:42.734478+0000","last_became_active":"2024-09-15T23:12:39.479702+0000","last_became_peered":"2024-09-15T23:12:39.479702+0000","last_unstale":"2024-09-15T23:13:42.734478+0000","last_undegraded":"2024-09-15T23:13:42.734478+0000","last_fullsized":"2024-09-15T23:13:42.734478+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:34.617090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738347+0000","last_change":"2024-09-15T23:12:41.746786+0000","last_active":"2024-09-15T23:13:42.738347+0000","last_peered":"2024-09-15T23:13:42.738347+0000","last_clean":"2024-09-15T23:13:42.738347+0000","last_became_active":"2024-09-15T23:12:41.745877+0000","last_became_peered":"2024-09-15T23:12:41.745877+0000","last_unstale":"2024-09-15T23:13:42.738347+0000","last_undegraded":"2024-09-15T23:13:42.738347+0000","last_fullsized":"2024-09-15T23:13:42.738347+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:33.458142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.739466+0000","last_change":"2024-09-15T23:12:40.282279+0000","last_active":"2024-09-15T23:13:42.739466+0000","last_peered":"2024-09-15T23:13:42.739466+0000","last_clean":"2024-09-15T23:13:42.739466+0000","last_became_active":"2024-09-15T23:12:40.281854+0000","last_became_peered":"2024-09-15T23:12:40.281854+0000","last_unstale":"2024-09-15T23:13:42.739466+0000","last_undegraded":"2024-09-15T23:13:42.739466+0000","last_fullsized":"2024-09-15T23:13:42.739466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:09.344989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737236+0000","last_change":"2024-09-15T23:12:41.759333+0000","last_active":"2024-09-15T23:13:42.737236+0000","last_peered":"2024-09-15T23:13:42.737236+0000","last_clean":"2024-09-15T23:13:42.737236+0000","last_became_active":"2024-09-15T23:12:41.757329+0000","last_became_peered":"2024-09-15T23:12:41.757329+0000","last_unstale":"2024-09-15T23:13:42.737236+0000","last_undegraded":"2024-09-15T23:13:42.737236+0000","last_fullsized":"2024-09-15T23:13:42.737236+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:03.804263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734664+0000","last_change":"2024-09-15T23:12:39.692428+0000","last_active":"2024-09-15T23:13:42.734664+0000","last_peered":"2024-09-15T23:13:42.734664+0000","last_clean":"2024-09-15T23:13:42.734664+0000","last_became_active":"2024-09-15T23:12:39.692073+0000","last_became_peered":"2024-09-15T23:12:39.692073+0000","last_unstale":"2024-09-15T23:13:42.734664+0000","last_undegraded":"2024-09-15T23:13:42.734664+0000","last_fullsized":"2024-09-15T23:13:42.734664+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:39.971583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734625+0000","last_change":"2024-09-15T23:12:41.752157+0000","last_active":"2024-09-15T23:13:42.734625+0000","last_peered":"2024-09-15T23:13:42.734625+0000","last_clean":"2024-09-15T23:13:42.734625+0000","last_became_active":"2024-09-15T23:12:41.751628+0000","last_became_peered":"2024-09-15T23:12:41.751628+0000","last_unstale":"2024-09-15T23:13:42.734625+0000","last_undegraded":"2024-09-15T23:13:42.734625+0000","last_fullsized":"2024-09-15T23:13:42.734625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:39.865611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737749+0000","last_change":"2024-09-15T23:12:39.484920+0000","last_active":"2024-09-15T23:13:42.737749+0000","last_peered":"2024-09-15T23:13:42.737749+0000","last_clean":"2024-09-15T23:13:42.737749+0000","last_became_active":"2024-09-15T23:12:39.484563+0000","last_became_peered":"2024-09-15T23:12:39.484563+0000","last_unstale":"2024-09-15T23:13:42.737749+0000","last_undegraded":"2024-09-15T23:13:42.737749+0000","last_fullsized":"2024-09-15T23:13:42.737749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:50.429881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738034+0000","last_change":"2024-09-15T23:12:41.749718+0000","last_active":"2024-09-15T23:13:42.738034+0000","last_peered":"2024-09-15T23:13:42.738034+0000","last_clean":"2024-09-15T23:13:42.738034+0000","last_became_active":"2024-09-15T23:12:41.749187+0000","last_became_peered":"2024-09-15T23:12:41.749187+0000","last_unstale":"2024-09-15T23:13:42.738034+0000","last_undegraded":"2024-09-15T23:13:42.738034+0000","last_fullsized":"2024-09-15T23:13:42.738034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:30.700175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.740205+0000","last_change":"2024-09-15T23:12:39.482472+0000","last_active":"2024-09-15T23:13:42.740205+0000","last_peered":"2024-09-15T23:13:42.740205+0000","last_clean":"2024-09-15T23:13:42.740205+0000","last_became_active":"2024-09-15T23:12:39.481105+0000","last_became_peered":"2024-09-15T23:12:39.481105+0000","last_unstale":"2024-09-15T23:13:42.740205+0000","last_undegraded":"2024-09-15T23:13:42.740205+0000","last_fullsized":"2024-09-15T23:13:42.740205+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:34.106771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738832+0000","last_change":"2024-09-15T23:12:41.749399+0000","last_active":"2024-09-15T23:13:42.738832+0000","last_peered":"2024-09-15T23:13:42.738832+0000","last_clean":"2024-09-15T23:13:42.738832+0000","last_became_active":"2024-09-15T23:12:41.748616+0000","last_became_peered":"2024-09-15T23:12:41.748616+0000","last_unstale":"2024-09-15T23:13:42.738832+0000","last_undegraded":"2024-09-15T23:13:42.738832+0000","last_fullsized":"2024-09-15T23:13:42.738832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:28.729933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734821+0000","last_change":"2024-09-15T23:12:39.485773+0000","last_active":"2024-09-15T23:13:42.734821+0000","last_peered":"2024-09-15T23:13:42.734821+0000","last_clean":"2024-09-15T23:13:42.734821+0000","last_became_active":"2024-09-15T23:12:39.485403+0000","last_became_peered":"2024-09-15T23:12:39.485403+0000","last_unstale":"2024-09-15T23:13:42.734821+0000","last_undegraded":"2024-09-15T23:13:42.734821+0000","last_fullsized":"2024-09-15T23:13:42.734821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:56.405296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.736527+0000","last_change":"2024-09-15T23:12:41.752877+0000","last_active":"2024-09-15T23:13:42.736527+0000","last_peered":"2024-09-15T23:13:42.736527+0000","last_clean":"2024-09-15T23:13:42.736527+0000","last_became_active":"2024-09-15T23:12:41.748011+0000","last_became_peered":"2024-09-15T23:12:41.748011+0000","last_unstale":"2024-09-15T23:13:42.736527+0000","last_undegraded":"2024-09-15T23:13:42.736527+0000","last_fullsized":"2024-09-15T23:13:42.736527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:58.741067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737347+0000","last_change":"2024-09-15T23:12:41.743781+0000","last_active":"2024-09-15T23:13:42.737347+0000","last_peered":"2024-09-15T23:13:42.737347+0000","last_clean":"2024-09-15T23:13:42.737347+0000","last_became_active":"2024-09-15T23:12:41.743420+0000","last_became_peered":"2024-09-15T23:12:41.743420+0000","last_unstale":"2024-09-15T23:13:42.737347+0000","last_undegraded":"2024-09-15T23:13:42.737347+0000","last_fullsized":"2024-09-15T23:13:42.737347+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:51.728955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.745915+0000","last_change":"2024-09-15T23:13:42.745436+0000","last_active":"2024-09-15T23:13:42.745915+0000","last_peered":"2024-09-15T23:13:42.745915+0000","last_clean":"2024-09-15T23:13:42.745915+0000","last_became_active":"2024-09-15T23:13:42.741267+0000","last_became_peered":"2024-09-15T23:13:42.741267+0000","last_unstale":"2024-09-15T23:13:42.745915+0000","last_undegraded":"2024-09-15T23:13:42.745915+0000","last_fullsized":"2024-09-15T23:13:42.745915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:07.663823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.734653+0000","last_change":"2024-09-15T23:12:41.747398+0000","last_active":"2024-09-15T23:13:42.734653+0000","last_peered":"2024-09-15T23:13:42.734653+0000","last_clean":"2024-09-15T23:13:42.734653+0000","last_became_active":"2024-09-15T23:12:41.747049+0000","last_became_peered":"2024-09-15T23:12:41.747049+0000","last_unstale":"2024-09-15T23:13:42.734653+0000","last_undegraded":"2024-09-15T23:13:42.734653+0000","last_fullsized":"2024-09-15T23:13:42.734653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:00.979843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.735138+0000","last_change":"2024-09-15T23:12:39.483666+0000","last_active":"2024-09-15T23:13:42.735138+0000","last_peered":"2024-09-15T23:13:42.735138+0000","last_clean":"2024-09-15T23:13:42.735138+0000","last_became_active":"2024-09-15T23:12:39.483309+0000","last_became_peered":"2024-09-15T23:12:39.483309+0000","last_unstale":"2024-09-15T23:13:42.735138+0000","last_undegraded":"2024-09-15T23:13:42.735138+0000","last_fullsized":"2024-09-15T23:13:42.735138+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:25.785868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737661+0000","last_change":"2024-09-15T23:12:41.758766+0000","last_active":"2024-09-15T23:13:42.737661+0000","last_peered":"2024-09-15T23:13:42.737661+0000","last_clean":"2024-09-15T23:13:42.737661+0000","last_became_active":"2024-09-15T23:12:41.758457+0000","last_became_peered":"2024-09-15T23:12:41.758457+0000","last_unstale":"2024-09-15T23:13:42.737661+0000","last_undegraded":"2024-09-15T23:13:42.737661+0000","last_fullsized":"2024-09-15T23:13:42.737661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:45.319708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.738033+0000","last_change":"2024-09-15T23:12:39.692412+0000","last_active":"2024-09-15T23:13:42.738033+0000","last_peered":"2024-09-15T23:13:42.738033+0000","last_clean":"2024-09-15T23:13:42.738033+0000","last_became_active":"2024-09-15T23:12:39.691953+0000","last_became_peered":"2024-09-15T23:12:39.691953+0000","last_unstale":"2024-09-15T23:13:42.738033+0000","last_undegraded":"2024-09-15T23:13:42.738033+0000","last_fullsized":"2024-09-15T23:13:42.738033+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:07.811976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.737809+0000","last_change":"2024-09-15T23:12:41.753181+0000","last_active":"2024-09-15T23:13:42.737809+0000","last_peered":"2024-09-15T23:13:42.737809+0000","last_clean":"2024-09-15T23:13:42.737809+0000","last_became_active":"2024-09-15T23:12:41.752432+0000","last_became_peered":"2024-09-15T23:12:41.752432+0000","last_unstale":"2024-09-15T23:13:42.737809+0000","last_undegraded":"2024-09-15T23:13:42.737809+0000","last_fullsized":"2024-09-15T23:13:42.737809+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:40.716803+0000","last_clean_scrub_stamp":"2024-09-15T23:12:40.716803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:37.363331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-15T23:13:42.746605+0000","last_change":"2024-09-15T23:13:42.746605+0000","last_active":"2024-09-15T23:13:42.746605+0000","last_peered":"2024-09-15T23:13:42.746605+0000","last_clean":"2024-09-15T23:13:42.746605+0000","last_became_active":"2024-09-15T23:13:42.740156+0000","last_became_peered":"2024-09-15T23:13:42.740156+0000","last_unstale":"2024-09-15T23:13:42.746605+0000","last_undegraded":"2024-09-15T23:13:42.746605+0000","last_fullsized":"2024-09-15T23:13:42.746605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:38.459034+0000","last_clean_scrub_stamp":"2024-09-15T23:12:38.459034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:02.462553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":123,"num_read_kb":125,"num_write":84,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285160,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547227,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":440424,"data_compressed":5785,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776159,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1036288,"data_stored":1093340,"data_compressed":42042,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":440424,"data_compressed":5785,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201322,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":905216,"data_stored":440446,"data_compressed":5785,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430255,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":950272,"data_stored":1030327,"data_compressed":42042,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593781,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":439959,"data_compressed":5785,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822713,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":962560,"data_stored":1030509,"data_compressed":42042,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":439864,"data_compressed":5785,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":901120,"data_stored":431639,"data_compressed":2889,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444106,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":974848,"data_stored":502695,"data_compressed":5785,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":494120,"data_compressed":2889,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":901120,"data_stored":439932,"data_compressed":5785,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34625,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34625,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34625,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36257,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:13:48.619 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T23:13:48.620 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T23:13:48.620 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-15T23:13:48.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-15T23:13:48.879 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:49.285 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:49 smithi002 ceph-mon[31019]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 72 B/s, 0 objects/s recovering 2024-09-15T23:13:49.285 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:49 smithi002 ceph-mon[31019]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:13:49.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.366+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/1841558873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4101420 msgr2=0x7f6bb410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.366+0000 7f6bb8a3a640 1 --2- 172.21.15.2:0/1841558873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4101420 0x7f6bb410d950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009930 tx=0x7f6bac02a420 comp rx=0 tx=0).stop 2024-09-15T23:13:49.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.366+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/1841558873 shutdown_connections 2024-09-15T23:13:49.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.366+0000 7f6bb8a3a640 1 --2- 172.21.15.2:0/1841558873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4101420 0x7f6bb410d950 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.366+0000 7f6bb8a3a640 1 --2- 172.21.15.2:0/1841558873 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb4100a80 0x7f6bb4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.366+0000 7f6bb8a3a640 1 --2- 172.21.15.2:0/1841558873 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6bb4106a80 0x7f6bb4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.366+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/1841558873 >> 172.21.15.2:0/1841558873 conn(0x7f6bb40fc7a0 msgr2=0x7f6bb40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.366+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/1841558873 shutdown_connections 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.366+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/1841558873 wait complete. 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.367+0000 7f6bb8a3a640 1 Processor -- start 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.367+0000 7f6bb8a3a640 1 -- start start 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.367+0000 7f6bb8a3a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6bb4100a80 0x7f6bb40fcec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.367+0000 7f6bb8a3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4101420 0x7f6bb40fd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.367+0000 7f6bb8a3a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb4106a80 0x7f6bb40fd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.367+0000 7f6bb8a3a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb4110dd0 con 0x7f6bb4101420 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.367+0000 7f6bb8a3a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb4110c50 con 0x7f6bb4106a80 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.367+0000 7f6bb8a3a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb4110f50 con 0x7f6bb4100a80 2024-09-15T23:13:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.367+0000 7f6bb1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4101420 0x7f6bb40fd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.367+0000 7f6bb1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4101420 0x7f6bb40fd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56502/0 (socket says 172.21.15.2:56502) 2024-09-15T23:13:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.367+0000 7f6bb1d9b640 1 -- 172.21.15.2:0/87306698 learned_addr learned my addr 172.21.15.2:0/87306698 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.367+0000 7f6bb259c640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6bb4100a80 0x7f6bb40fcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.367+0000 7f6bb2d9d640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb4106a80 0x7f6bb40fd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.368+0000 7f6bb1d9b640 1 -- 172.21.15.2:0/87306698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6bb4100a80 msgr2=0x7f6bb40fcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.368+0000 7f6bb1d9b640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6bb4100a80 0x7f6bb40fcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.368+0000 7f6bb1d9b640 1 -- 172.21.15.2:0/87306698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb4106a80 msgr2=0x7f6bb40fd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.368+0000 7f6bb1d9b640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb4106a80 0x7f6bb40fd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.368+0000 7f6bb1d9b640 1 -- 172.21.15.2:0/87306698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb41a6950 con 0x7f6bb4101420 2024-09-15T23:13:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.368+0000 7f6bb2d9d640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb4106a80 0x7f6bb40fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.368+0000 7f6bb1d9b640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4101420 0x7f6bb40fd400 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800ba50 tx=0x7f6ba800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.368+0000 7f6ba37fe640 1 -- 172.21.15.2:0/87306698 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8019070 con 0x7f6bb4101420 2024-09-15T23:13:49.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.368+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/87306698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb41a6c40 con 0x7f6bb4101420 2024-09-15T23:13:49.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.368+0000 7f6ba37fe640 1 -- 172.21.15.2:0/87306698 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ba8014440 con 0x7f6bb4101420 2024-09-15T23:13:49.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.368+0000 7f6ba37fe640 1 -- 172.21.15.2:0/87306698 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80075b0 con 0x7f6bb4101420 2024-09-15T23:13:49.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.368+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/87306698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb41a7180 con 0x7f6bb4101420 2024-09-15T23:13:49.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.369+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/87306698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb4100f60 con 0x7f6bb4101420 2024-09-15T23:13:49.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.370+0000 7f6ba37fe640 1 -- 172.21.15.2:0/87306698 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6ba801c070 con 0x7f6bb4101420 2024-09-15T23:13:49.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.371+0000 7f6ba37fe640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f6b9c0a32d0 0x7f6b9c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.371+0000 7f6bb259c640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f6b9c0a32d0 0x7f6b9c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.371+0000 7f6ba37fe640 1 -- 172.21.15.2:0/87306698 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f6ba80cef60 con 0x7f6bb4101420 2024-09-15T23:13:49.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.371+0000 7f6bb259c640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f6b9c0a32d0 0x7f6b9c0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009990 tx=0x7f6ba4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:49.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.375+0000 7f6ba37fe640 1 -- 172.21.15.2:0/87306698 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6ba809bc10 con 0x7f6bb4101420 2024-09-15T23:13:49.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:49 smithi112 ceph-mon[34367]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 72 B/s, 0 objects/s recovering 2024-09-15T23:13:49.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:49 smithi112 ceph-mon[34367]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:13:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.587+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/87306698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6bb410a020 con 0x7f6bb4101420 2024-09-15T23:13:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.588+0000 7f6ba37fe640 1 -- 172.21.15.2:0/87306698 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6ba809b510 con 0x7f6bb4101420 2024-09-15T23:13:49.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:49.589 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T23:13:49.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.590+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/87306698 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f6b9c0a32d0 msgr2=0x7f6b9c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.590+0000 7f6bb8a3a640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f6b9c0a32d0 0x7f6b9c0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009990 tx=0x7f6ba4009110 comp rx=0 tx=0).stop 2024-09-15T23:13:49.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.590+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/87306698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4101420 msgr2=0x7f6bb40fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.590+0000 7f6bb8a3a640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4101420 0x7f6bb40fd400 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800ba50 tx=0x7f6ba800be50 comp rx=0 tx=0).stop 2024-09-15T23:13:49.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.590+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/87306698 shutdown_connections 2024-09-15T23:13:49.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.590+0000 7f6bb8a3a640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f6b9c0a32d0 0x7f6b9c0a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.590+0000 7f6bb8a3a640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6bb4106a80 0x7f6bb40fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.590+0000 7f6bb8a3a640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4101420 0x7f6bb40fd400 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.590+0000 7f6bb8a3a640 1 --2- 172.21.15.2:0/87306698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6bb4100a80 0x7f6bb40fcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.590+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/87306698 >> 172.21.15.2:0/87306698 conn(0x7f6bb40fc7a0 msgr2=0x7f6bb406ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:49.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.590+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/87306698 shutdown_connections 2024-09-15T23:13:49.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:49.590+0000 7f6bb8a3a640 1 -- 172.21.15.2:0/87306698 wait complete. 2024-09-15T23:13:49.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:49 smithi145 ceph-mon[34901]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 72 B/s, 0 objects/s recovering 2024-09-15T23:13:49.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:49 smithi145 ceph-mon[34901]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:13:50.289 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-15T23:13:50.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:13:50.547 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:50.557 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:50 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/87306698' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T23:13:50.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:50 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/87306698' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T23:13:50.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:50 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/87306698' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T23:13:51.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.041+0000 7fdb80813640 1 -- 172.21.15.2:0/1507791003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb7c103780 msgr2=0x7fdb7c107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:51.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.041+0000 7fdb80813640 1 --2- 172.21.15.2:0/1507791003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb7c103780 0x7fdb7c107bc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009930 tx=0x7fdb6402a420 comp rx=0 tx=0).stop 2024-09-15T23:13:51.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.041+0000 7fdb80813640 1 -- 172.21.15.2:0/1507791003 shutdown_connections 2024-09-15T23:13:51.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.041+0000 7fdb80813640 1 --2- 172.21.15.2:0/1507791003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb7c108300 0x7fdb7c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.041+0000 7fdb80813640 1 --2- 172.21.15.2:0/1507791003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb7c103780 0x7fdb7c107bc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.041+0000 7fdb80813640 1 --2- 172.21.15.2:0/1507791003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb7c102dd0 0x7fdb7c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.041+0000 7fdb80813640 1 -- 172.21.15.2:0/1507791003 >> 172.21.15.2:0/1507791003 conn(0x7fdb7c0fc7d0 msgr2=0x7fdb7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.041+0000 7fdb80813640 1 -- 172.21.15.2:0/1507791003 shutdown_connections 2024-09-15T23:13:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.041+0000 7fdb80813640 1 -- 172.21.15.2:0/1507791003 wait complete. 2024-09-15T23:13:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb80813640 1 Processor -- start 2024-09-15T23:13:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb80813640 1 -- start start 2024-09-15T23:13:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb80813640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb7c102dd0 0x7fdb7c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb80813640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb7c103780 0x7fdb7c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb80813640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb7c108300 0x7fdb7c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb80813640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c111f80 con 0x7fdb7c103780 2024-09-15T23:13:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb80813640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c111e00 con 0x7fdb7c108300 2024-09-15T23:13:51.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb80813640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c112100 con 0x7fdb7c102dd0 2024-09-15T23:13:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb79d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb7c103780 0x7fdb7c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb79d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb7c103780 0x7fdb7c198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56520/0 (socket says 172.21.15.2:56520) 2024-09-15T23:13:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb79d9b640 1 -- 172.21.15.2:0/99026486 learned_addr learned my addr 172.21.15.2:0/99026486 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb7a59c640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb7c102dd0 0x7fdb7c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb7ad9d640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb7c108300 0x7fdb7c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb79d9b640 1 -- 172.21.15.2:0/99026486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb7c102dd0 msgr2=0x7fdb7c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.042+0000 7fdb79d9b640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb7c102dd0 0x7fdb7c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.043+0000 7fdb79d9b640 1 -- 172.21.15.2:0/99026486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb7c108300 msgr2=0x7fdb7c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.043+0000 7fdb79d9b640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb7c108300 0x7fdb7c19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.043+0000 7fdb79d9b640 1 -- 172.21.15.2:0/99026486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c19d4f0 con 0x7fdb7c103780 2024-09-15T23:13:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.043+0000 7fdb7a59c640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb7c102dd0 0x7fdb7c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.043+0000 7fdb7ad9d640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb7c108300 0x7fdb7c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:51.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.043+0000 7fdb79d9b640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb7c103780 0x7fdb7c198a80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdb64031440 tx=0x7fdb64004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.043+0000 7fdb737fe640 1 -- 172.21.15.2:0/99026486 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6403f030 con 0x7fdb7c103780 2024-09-15T23:13:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.043+0000 7fdb737fe640 1 -- 172.21.15.2:0/99026486 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb64003aa0 con 0x7fdb7c103780 2024-09-15T23:13:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.043+0000 7fdb80813640 1 -- 172.21.15.2:0/99026486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7c19d780 con 0x7fdb7c103780 2024-09-15T23:13:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.043+0000 7fdb737fe640 1 -- 172.21.15.2:0/99026486 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64035070 con 0x7fdb7c103780 2024-09-15T23:13:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.043+0000 7fdb80813640 1 -- 172.21.15.2:0/99026486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb7c1a50c0 con 0x7fdb7c103780 2024-09-15T23:13:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.044+0000 7fdb80813640 1 -- 172.21.15.2:0/99026486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb7c06a7b0 con 0x7fdb7c103780 2024-09-15T23:13:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.045+0000 7fdb737fe640 1 -- 172.21.15.2:0/99026486 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdb64042030 con 0x7fdb7c103780 2024-09-15T23:13:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.046+0000 7fdb737fe640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fdb680a32d0 0x7fdb680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.046+0000 7fdb7a59c640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fdb680a32d0 0x7fdb680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.046+0000 7fdb737fe640 1 -- 172.21.15.2:0/99026486 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fdb640f0340 con 0x7fdb7c103780 2024-09-15T23:13:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.047+0000 7fdb7a59c640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fdb680a32d0 0x7fdb680a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdb740058c0 tx=0x7fdb74005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:51.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.051+0000 7fdb737fe640 1 -- 172.21.15.2:0/99026486 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb640bce80 con 0x7fdb7c103780 2024-09-15T23:13:51.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.264+0000 7fdb80813640 1 -- 172.21.15.2:0/99026486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb7c10a2e0 con 0x7fdb7c103780 2024-09-15T23:13:51.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.264+0000 7fdb737fe640 1 -- 172.21.15.2:0/99026486 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11843 (secure 0 0 0) 0x7fdb640bc780 con 0x7fdb7c103780 2024-09-15T23:13:51.266 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:51.266 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"btime":"2024-09-15T23:12:51:758295+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1051460220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1051460220},{"type":"v1","addr":"172.21.15.2:6839","nonce":1051460220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/1583533983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":1583533983},{"type":"v1","addr":"172.21.15.2:6841","nonce":1583533983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/91315913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":91315913},{"type":"v1","addr":"172.21.15.145:6835","nonce":91315913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1066293931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":1066293931},{"type":"v1","addr":"172.21.15.145:6837","nonce":1066293931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/418078184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":418078184},{"type":"v1","addr":"172.21.15.112:6837","nonce":418078184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:12:42.434565+0000","modified":"2024-09-15T23:12:51.456432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3930825714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3930825714},{"type":"v1","addr":"172.21.15.145:6839","nonce":3930825714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/1380244119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1380244119},{"type":"v1","addr":"172.21.15.112:6839","nonce":1380244119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24464,"qdb_cluster":[24464]},"id":1}]} 2024-09-15T23:13:51.266 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-09-15T23:13:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.267+0000 7fdb80813640 1 -- 172.21.15.2:0/99026486 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fdb680a32d0 msgr2=0x7fdb680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.267+0000 7fdb80813640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fdb680a32d0 0x7fdb680a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdb740058c0 tx=0x7fdb74005850 comp rx=0 tx=0).stop 2024-09-15T23:13:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.267+0000 7fdb80813640 1 -- 172.21.15.2:0/99026486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb7c103780 msgr2=0x7fdb7c198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.267+0000 7fdb80813640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb7c103780 0x7fdb7c198a80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdb64031440 tx=0x7fdb64004270 comp rx=0 tx=0).stop 2024-09-15T23:13:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.267+0000 7fdb80813640 1 -- 172.21.15.2:0/99026486 shutdown_connections 2024-09-15T23:13:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.267+0000 7fdb80813640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fdb680a32d0 0x7fdb680a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.267+0000 7fdb80813640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb7c108300 0x7fdb7c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.267+0000 7fdb80813640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb7c103780 0x7fdb7c198a80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.267+0000 7fdb80813640 1 --2- 172.21.15.2:0/99026486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb7c102dd0 0x7fdb7c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.267+0000 7fdb80813640 1 -- 172.21.15.2:0/99026486 >> 172.21.15.2:0/99026486 conn(0x7fdb7c0fc7d0 msgr2=0x7fdb7c105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.267+0000 7fdb80813640 1 -- 172.21.15.2:0/99026486 shutdown_connections 2024-09-15T23:13:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:51.267+0000 7fdb80813640 1 -- 172.21.15.2:0/99026486 wait complete. 2024-09-15T23:13:51.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:51 smithi112 ceph-mon[34367]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-15T23:13:51.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:51 smithi002 ceph-mon[31019]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-15T23:13:51.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:51 smithi145 ceph-mon[34901]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-15T23:13:51.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:13:52.239 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:52.503 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:52 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/99026486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:13:52.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:52 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/99026486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:13:52.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:52 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/99026486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:13:52.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.732+0000 7fe7724be640 1 -- 172.21.15.2:0/2310611687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe76c102570 msgr2=0x7fe76c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:52.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.732+0000 7fe7724be640 1 --2- 172.21.15.2:0/2310611687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe76c102570 0x7fe76c1029b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe760009900 tx=0x7fe76002a480 comp rx=0 tx=0).stop 2024-09-15T23:13:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.732+0000 7fe7724be640 1 -- 172.21.15.2:0/2310611687 shutdown_connections 2024-09-15T23:13:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.732+0000 7fe7724be640 1 --2- 172.21.15.2:0/2310611687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c102ef0 0x7fe76c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.732+0000 7fe7724be640 1 --2- 172.21.15.2:0/2310611687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe76c102570 0x7fe76c1029b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.732+0000 7fe7724be640 1 --2- 172.21.15.2:0/2310611687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe76c100e20 0x7fe76c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.732+0000 7fe7724be640 1 -- 172.21.15.2:0/2310611687 >> 172.21.15.2:0/2310611687 conn(0x7fe76c0fc7d0 msgr2=0x7fe76c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.732+0000 7fe7724be640 1 -- 172.21.15.2:0/2310611687 shutdown_connections 2024-09-15T23:13:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.732+0000 7fe7724be640 1 -- 172.21.15.2:0/2310611687 wait complete. 2024-09-15T23:13:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.732+0000 7fe7724be640 1 Processor -- start 2024-09-15T23:13:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.732+0000 7fe7724be640 1 -- start start 2024-09-15T23:13:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe7724be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe76c100e20 0x7fe76c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe7724be640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe76c102570 0x7fe76c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe7724be640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c102ef0 0x7fe76c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe7724be640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe76c110ea0 con 0x7fe76c100e20 2024-09-15T23:13:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe7724be640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe76c110d20 con 0x7fe76c102ef0 2024-09-15T23:13:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe7724be640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe76c111020 con 0x7fe76c102570 2024-09-15T23:13:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe76bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe76c100e20 0x7fe76c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe76bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe76c100e20 0x7fe76c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56536/0 (socket says 172.21.15.2:56536) 2024-09-15T23:13:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe76bfff640 1 -- 172.21.15.2:0/4105099098 learned_addr learned my addr 172.21.15.2:0/4105099098 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe770a5b640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c102ef0 0x7fe76c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe76b7fe640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe76c102570 0x7fe76c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe76bfff640 1 -- 172.21.15.2:0/4105099098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe76c102570 msgr2=0x7fe76c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe76bfff640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe76c102570 0x7fe76c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe76bfff640 1 -- 172.21.15.2:0/4105099098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c102ef0 msgr2=0x7fe76c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe76bfff640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c102ef0 0x7fe76c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe76bfff640 1 -- 172.21.15.2:0/4105099098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76c19d440 con 0x7fe76c100e20 2024-09-15T23:13:52.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.733+0000 7fe76bfff640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe76c100e20 0x7fe76c198490 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00b4a0 tx=0x7fe75c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.734+0000 7fe7697fa640 1 -- 172.21.15.2:0/4105099098 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c014070 con 0x7fe76c100e20 2024-09-15T23:13:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.734+0000 7fe7724be640 1 -- 172.21.15.2:0/4105099098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76c19d730 con 0x7fe76c100e20 2024-09-15T23:13:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.734+0000 7fe7697fa640 1 -- 172.21.15.2:0/4105099098 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe75c010ac0 con 0x7fe76c100e20 2024-09-15T23:13:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.734+0000 7fe7697fa640 1 -- 172.21.15.2:0/4105099098 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c017c30 con 0x7fe76c100e20 2024-09-15T23:13:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.734+0000 7fe7724be640 1 -- 172.21.15.2:0/4105099098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe76c1a5010 con 0x7fe76c100e20 2024-09-15T23:13:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.735+0000 7fe7724be640 1 -- 172.21.15.2:0/4105099098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe76c101200 con 0x7fe76c100e20 2024-09-15T23:13:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.736+0000 7fe7697fa640 1 -- 172.21.15.2:0/4105099098 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe75c017070 con 0x7fe76c100e20 2024-09-15T23:13:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.737+0000 7fe7697fa640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe7540a32d0 0x7fe7540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.737+0000 7fe76b7fe640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe7540a32d0 0x7fe7540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.737+0000 7fe7697fa640 1 -- 172.21.15.2:0/4105099098 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe75c0cecf0 con 0x7fe76c100e20 2024-09-15T23:13:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.737+0000 7fe76b7fe640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe7540a32d0 0x7fe7540a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe760000c00 tx=0x7fe760005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:52.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.741+0000 7fe7697fa640 1 -- 172.21.15.2:0/4105099098 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe75c09b350 con 0x7fe76c100e20 2024-09-15T23:13:52.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.953+0000 7fe7724be640 1 -- 172.21.15.2:0/4105099098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe76c10a0a0 con 0x7fe76c100e20 2024-09-15T23:13:52.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.954+0000 7fe7697fa640 1 -- 172.21.15.2:0/4105099098 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11843 (secure 0 0 0) 0x7fe75c09f650 con 0x7fe76c100e20 2024-09-15T23:13:52.956 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:52.956 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"btime":"2024-09-15T23:12:51:758295+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1051460220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1051460220},{"type":"v1","addr":"172.21.15.2:6839","nonce":1051460220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/1583533983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":1583533983},{"type":"v1","addr":"172.21.15.2:6841","nonce":1583533983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/91315913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":91315913},{"type":"v1","addr":"172.21.15.145:6835","nonce":91315913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1066293931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":1066293931},{"type":"v1","addr":"172.21.15.145:6837","nonce":1066293931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/418078184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":418078184},{"type":"v1","addr":"172.21.15.112:6837","nonce":418078184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:12:42.434565+0000","modified":"2024-09-15T23:12:51.456432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3930825714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3930825714},{"type":"v1","addr":"172.21.15.145:6839","nonce":3930825714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/1380244119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1380244119},{"type":"v1","addr":"172.21.15.112:6839","nonce":1380244119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24464,"qdb_cluster":[24464]},"id":1}]} 2024-09-15T23:13:52.956 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-09-15T23:13:52.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.956+0000 7fe7724be640 1 -- 172.21.15.2:0/4105099098 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe7540a32d0 msgr2=0x7fe7540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:52.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.956+0000 7fe7724be640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe7540a32d0 0x7fe7540a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe760000c00 tx=0x7fe760005e80 comp rx=0 tx=0).stop 2024-09-15T23:13:52.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.956+0000 7fe7724be640 1 -- 172.21.15.2:0/4105099098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe76c100e20 msgr2=0x7fe76c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:52.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.956+0000 7fe7724be640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe76c100e20 0x7fe76c198490 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00b4a0 tx=0x7fe75c00b960 comp rx=0 tx=0).stop 2024-09-15T23:13:52.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.956+0000 7fe7724be640 1 -- 172.21.15.2:0/4105099098 shutdown_connections 2024-09-15T23:13:52.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.956+0000 7fe7724be640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fe7540a32d0 0x7fe7540a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:52.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.956+0000 7fe7724be640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe76c102ef0 0x7fe76c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:52.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.956+0000 7fe7724be640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe76c102570 0x7fe76c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:52.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.956+0000 7fe7724be640 1 --2- 172.21.15.2:0/4105099098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe76c100e20 0x7fe76c198490 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:52.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.956+0000 7fe7724be640 1 -- 172.21.15.2:0/4105099098 >> 172.21.15.2:0/4105099098 conn(0x7fe76c0fc7d0 msgr2=0x7fe76c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:52.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.956+0000 7fe7724be640 1 -- 172.21.15.2:0/4105099098 shutdown_connections 2024-09-15T23:13:52.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:52.956+0000 7fe7724be640 1 -- 172.21.15.2:0/4105099098 wait complete. 2024-09-15T23:13:53.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:53 smithi002 ceph-mon[31019]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s; 59 B/s, 0 objects/s recovering 2024-09-15T23:13:53.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:53 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/4105099098' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:13:53.609 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:53 smithi145 ceph-mon[34901]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s; 59 B/s, 0 objects/s recovering 2024-09-15T23:13:53.609 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:53 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/4105099098' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:13:53.648 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:53 smithi112 ceph-mon[34367]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s; 59 B/s, 0 objects/s recovering 2024-09-15T23:13:53.648 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:53 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/4105099098' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:13:53.740 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:13:54.002 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:54.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.501+0000 7f634bb4c640 1 -- 172.21.15.2:0/3515377618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63441027a0 msgr2=0x7f63441067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.501+0000 7f634bb4c640 1 --2- 172.21.15.2:0/3515377618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63441027a0 0x7f63441067f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6334009900 tx=0x7f633402a410 comp rx=0 tx=0).stop 2024-09-15T23:13:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.501+0000 7f634bb4c640 1 -- 172.21.15.2:0/3515377618 shutdown_connections 2024-09-15T23:13:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.501+0000 7f634bb4c640 1 --2- 172.21.15.2:0/3515377618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6344106f20 0x7f634410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.501+0000 7f634bb4c640 1 --2- 172.21.15.2:0/3515377618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63441027a0 0x7f63441067f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.501+0000 7f634bb4c640 1 --2- 172.21.15.2:0/3515377618 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6344101df0 0x7f63441021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.501+0000 7f634bb4c640 1 -- 172.21.15.2:0/3515377618 >> 172.21.15.2:0/3515377618 conn(0x7f63440fd8b0 msgr2=0x7f63440ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.501+0000 7f634bb4c640 1 -- 172.21.15.2:0/3515377618 shutdown_connections 2024-09-15T23:13:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.501+0000 7f634bb4c640 1 -- 172.21.15.2:0/3515377618 wait complete. 2024-09-15T23:13:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.502+0000 7f634bb4c640 1 Processor -- start 2024-09-15T23:13:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.502+0000 7f634bb4c640 1 -- start start 2024-09-15T23:13:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.502+0000 7f634bb4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6344101df0 0x7f63441982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.502+0000 7f634bb4c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63441027a0 0x7f63441987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:54.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.502+0000 7f634bb4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6344106f20 0x7f634419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.502+0000 7f634bb4c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6344111e30 con 0x7f6344106f20 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.502+0000 7f634bb4c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6344111cb0 con 0x7f6344101df0 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.502+0000 7f634bb4c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6344111fb0 con 0x7f63441027a0 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.502+0000 7f634a0e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6344106f20 0x7f634419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.502+0000 7f634a0e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6344106f20 0x7f634419cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56560/0 (socket says 172.21.15.2:56560) 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.502+0000 7f634a0e9640 1 -- 172.21.15.2:0/2538615955 learned_addr learned my addr 172.21.15.2:0/2538615955 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.502+0000 7f63490e7640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63441027a0 0x7f63441987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.503+0000 7f634a0e9640 1 -- 172.21.15.2:0/2538615955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63441027a0 msgr2=0x7f63441987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.503+0000 7f634a0e9640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63441027a0 0x7f63441987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.503+0000 7f634a0e9640 1 -- 172.21.15.2:0/2538615955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6344101df0 msgr2=0x7f63441982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.503+0000 7f63498e8640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6344101df0 0x7f63441982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.503+0000 7f634a0e9640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6344101df0 0x7f63441982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.503+0000 7f634a0e9640 1 -- 172.21.15.2:0/2538615955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634419d260 con 0x7f6344106f20 2024-09-15T23:13:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.503+0000 7f63498e8640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6344101df0 0x7f63441982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.503+0000 7f634a0e9640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6344106f20 0x7f634419cb80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f633c00cce0 tx=0x7f633c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.503+0000 7f633affd640 1 -- 172.21.15.2:0/2538615955 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c00f450 con 0x7f6344106f20 2024-09-15T23:13:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.503+0000 7f634bb4c640 1 -- 172.21.15.2:0/2538615955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634419d550 con 0x7f6344106f20 2024-09-15T23:13:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.503+0000 7f633affd640 1 -- 172.21.15.2:0/2538615955 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f633c00faa0 con 0x7f6344106f20 2024-09-15T23:13:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.503+0000 7f633affd640 1 -- 172.21.15.2:0/2538615955 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c018b70 con 0x7f6344106f20 2024-09-15T23:13:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.503+0000 7f634bb4c640 1 -- 172.21.15.2:0/2538615955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63441a4e30 con 0x7f6344106f20 2024-09-15T23:13:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.504+0000 7f634bb4c640 1 -- 172.21.15.2:0/2538615955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63441032d0 con 0x7f6344106f20 2024-09-15T23:13:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.505+0000 7f633affd640 1 -- 172.21.15.2:0/2538615955 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f633c018d10 con 0x7f6344106f20 2024-09-15T23:13:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.506+0000 7f633affd640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f63300a32d0 0x7f63300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.506+0000 7f63498e8640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f63300a32d0 0x7f63300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.506+0000 7f633affd640 1 -- 172.21.15.2:0/2538615955 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f633c0cfff0 con 0x7f6344106f20 2024-09-15T23:13:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.507+0000 7f63498e8640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f63300a32d0 0x7f63300a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f63400058c0 tx=0x7f6340005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.509+0000 7f633affd640 1 -- 172.21.15.2:0/2538615955 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f633c014030 con 0x7f6344106f20 2024-09-15T23:13:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.689+0000 7f634bb4c640 1 -- 172.21.15.2:0/2538615955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63441021d0 con 0x7f6344106f20 2024-09-15T23:13:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.691+0000 7f633affd640 1 -- 172.21.15.2:0/2538615955 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22723 (secure 0 0 0) 0x7f633c09cc20 con 0x7f6344106f20 2024-09-15T23:13:54.692 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:54.692 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":83,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","created":"2024-09-15T23:04:45.101432+0000","modified":"2024-09-15T23:13:42.726811+0000","last_up_change":"2024-09-15T23:11:49.566858+0000","last_in_change":"2024-09-15T23:11:25.723093+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:07:57.919291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:38.100522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:40.716254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40ff4fd9-3904-4178-a9cb-51f4647be540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6803","nonce":280991401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6805","nonce":280991401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6809","nonce":280991401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6807","nonce":280991401}]},"public_addr":"172.21.15.2:6803/280991401","cluster_addr":"172.21.15.2:6805/280991401","heartbeat_back_addr":"172.21.15.2:6809/280991401","heartbeat_front_addr":"172.21.15.2:6807/280991401","state":["exists","up"]},{"osd":1,"uuid":"af5e265d-fe45-4d9c-a34c-6f0b103d75d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6801","nonce":2649210970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6803","nonce":2649210970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6807","nonce":2649210970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6805","nonce":2649210970}]},"public_addr":"172.21.15.112:6801/2649210970","cluster_addr":"172.21.15.112:6803/2649210970","heartbeat_back_addr":"172.21.15.112:6807/2649210970","heartbeat_front_addr":"172.21.15.112:6805/2649210970","state":["exists","up"]},{"osd":2,"uuid":"8df9e644-fc51-4626-a1a7-6ac4448a5b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6801","nonce":3485615437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6803","nonce":3485615437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6807","nonce":3485615437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6805","nonce":3485615437}]},"public_addr":"172.21.15.145:6801/3485615437","cluster_addr":"172.21.15.145:6803/3485615437","heartbeat_back_addr":"172.21.15.145:6807/3485615437","heartbeat_front_addr":"172.21.15.145:6805/3485615437","state":["exists","up"]},{"osd":3,"uuid":"dbab372a-8fdd-4b0c-bee3-16cd75b35ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6811","nonce":113061968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6813","nonce":113061968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6817","nonce":113061968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6815","nonce":113061968}]},"public_addr":"172.21.15.2:6811/113061968","cluster_addr":"172.21.15.2:6813/113061968","heartbeat_back_addr":"172.21.15.2:6817/113061968","heartbeat_front_addr":"172.21.15.2:6815/113061968","state":["exists","up"]},{"osd":4,"uuid":"73bab8af-3973-4beb-a034-d00bcf0c572f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6809","nonce":2519162767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6811","nonce":2519162767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6815","nonce":2519162767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6813","nonce":2519162767}]},"public_addr":"172.21.15.112:6809/2519162767","cluster_addr":"172.21.15.112:6811/2519162767","heartbeat_back_addr":"172.21.15.112:6815/2519162767","heartbeat_front_addr":"172.21.15.112:6813/2519162767","state":["exists","up"]},{"osd":5,"uuid":"2d163e61-5891-46c1-b1c2-39d50a3b6f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6809","nonce":712427242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6811","nonce":712427242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6815","nonce":712427242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6813","nonce":712427242}]},"public_addr":"172.21.15.145:6809/712427242","cluster_addr":"172.21.15.145:6811/712427242","heartbeat_back_addr":"172.21.15.145:6815/712427242","heartbeat_front_addr":"172.21.15.145:6813/712427242","state":["exists","up"]},{"osd":6,"uuid":"bca02c96-10de-4953-96e9-42fc9ddf7c1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6819","nonce":2930673197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6821","nonce":2930673197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6825","nonce":2930673197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6823","nonce":2930673197}]},"public_addr":"172.21.15.2:6819/2930673197","cluster_addr":"172.21.15.2:6821/2930673197","heartbeat_back_addr":"172.21.15.2:6825/2930673197","heartbeat_front_addr":"172.21.15.2:6823/2930673197","state":["exists","up"]},{"osd":7,"uuid":"4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6817","nonce":830628191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6819","nonce":830628191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6823","nonce":830628191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6821","nonce":830628191}]},"public_addr":"172.21.15.112:6817/830628191","cluster_addr":"172.21.15.112:6819/830628191","heartbeat_back_addr":"172.21.15.112:6823/830628191","heartbeat_front_addr":"172.21.15.112:6821/830628191","state":["exists","up"]},{"osd":8,"uuid":"2733f9dd-3872-4bec-9c22-bcdb64828ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6817","nonce":3634470540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6819","nonce":3634470540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6823","nonce":3634470540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6821","nonce":3634470540}]},"public_addr":"172.21.15.145:6817/3634470540","cluster_addr":"172.21.15.145:6819/3634470540","heartbeat_back_addr":"172.21.15.145:6823/3634470540","heartbeat_front_addr":"172.21.15.145:6821/3634470540","state":["exists","up"]},{"osd":9,"uuid":"bd1f4a4a-547c-43a9-859a-75b37b06905f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6827","nonce":1417377702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6829","nonce":1417377702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6833","nonce":1417377702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6831","nonce":1417377702}]},"public_addr":"172.21.15.2:6827/1417377702","cluster_addr":"172.21.15.2:6829/1417377702","heartbeat_back_addr":"172.21.15.2:6833/1417377702","heartbeat_front_addr":"172.21.15.2:6831/1417377702","state":["exists","up"]},{"osd":10,"uuid":"f8b895e8-39f5-4753-9343-03f96da12246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6825","nonce":105615908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6827","nonce":105615908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6831","nonce":105615908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6829","nonce":105615908}]},"public_addr":"172.21.15.112:6825/105615908","cluster_addr":"172.21.15.112:6827/105615908","heartbeat_back_addr":"172.21.15.112:6831/105615908","heartbeat_front_addr":"172.21.15.112:6829/105615908","state":["exists","up"]},{"osd":11,"uuid":"dc018bfc-bc13-4ef2-a712-5cd406a56cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6825","nonce":430484289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6827","nonce":430484289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6831","nonce":430484289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6829","nonce":430484289}]},"public_addr":"172.21.15.145:6825/430484289","cluster_addr":"172.21.15.145:6827/430484289","heartbeat_back_addr":"172.21.15.145:6831/430484289","heartbeat_front_addr":"172.21.15.145:6829/430484289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:03.938207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:29.814740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:54.853802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:20.802021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:47.028090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:13.226130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:39.003023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:04.465156+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:29.321331+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:55.992585+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:21.623406+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:48.269840+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/2956732837":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6800/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/896502743":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/3802152324":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/1891095221":"2024-09-16T23:05:17.756048+0000","172.21.15.2:6800/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/236781836":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/2404111366":"2024-09-16T23:05:17.756048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:13:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.693+0000 7f634bb4c640 1 -- 172.21.15.2:0/2538615955 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f63300a32d0 msgr2=0x7f63300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.693+0000 7f634bb4c640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f63300a32d0 0x7f63300a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f63400058c0 tx=0x7f6340005d30 comp rx=0 tx=0).stop 2024-09-15T23:13:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.693+0000 7f634bb4c640 1 -- 172.21.15.2:0/2538615955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6344106f20 msgr2=0x7f634419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.693+0000 7f634bb4c640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6344106f20 0x7f634419cb80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f633c00cce0 tx=0x7f633c00a620 comp rx=0 tx=0).stop 2024-09-15T23:13:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.693+0000 7f634bb4c640 1 -- 172.21.15.2:0/2538615955 shutdown_connections 2024-09-15T23:13:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.693+0000 7f634bb4c640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f63300a32d0 0x7f63300a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.693+0000 7f634bb4c640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6344106f20 0x7f634419cb80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.693+0000 7f634bb4c640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f63441027a0 0x7f63441987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.693+0000 7f634bb4c640 1 --2- 172.21.15.2:0/2538615955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6344101df0 0x7f63441982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.693+0000 7f634bb4c640 1 -- 172.21.15.2:0/2538615955 >> 172.21.15.2:0/2538615955 conn(0x7f63440fd8b0 msgr2=0x7f63440fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.693+0000 7f634bb4c640 1 -- 172.21.15.2:0/2538615955 shutdown_connections 2024-09-15T23:13:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:54.693+0000 7f634bb4c640 1 -- 172.21.15.2:0/2538615955 wait complete. 2024-09-15T23:13:55.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:55 smithi002 ceph-mon[31019]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s; 53 B/s, 0 objects/s recovering 2024-09-15T23:13:55.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:55 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2538615955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:13:55.381 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:13:55.639 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:55.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:55 smithi145 ceph-mon[34901]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s; 53 B/s, 0 objects/s recovering 2024-09-15T23:13:55.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:55 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2538615955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:13:55.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:55 smithi112 ceph-mon[34367]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s; 53 B/s, 0 objects/s recovering 2024-09-15T23:13:55.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:55 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2538615955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:13:56.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.159+0000 7fafeb784640 1 -- 172.21.15.2:0/4236276089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe4074590 msgr2=0x7fafe4074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:56.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.159+0000 7fafeb784640 1 --2- 172.21.15.2:0/4236276089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe4074590 0x7fafe4074970 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009900 tx=0x7fafe002a480 comp rx=0 tx=0).stop 2024-09-15T23:13:56.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.159+0000 7fafeb784640 1 -- 172.21.15.2:0/4236276089 shutdown_connections 2024-09-15T23:13:56.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.159+0000 7fafeb784640 1 --2- 172.21.15.2:0/4236276089 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafe4112b90 0x7fafe4114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:56.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.159+0000 7fafeb784640 1 --2- 172.21.15.2:0/4236276089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafe4074eb0 0x7fafe4112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:56.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.159+0000 7fafeb784640 1 --2- 172.21.15.2:0/4236276089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe4074590 0x7fafe4074970 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:56.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.159+0000 7fafeb784640 1 -- 172.21.15.2:0/4236276089 >> 172.21.15.2:0/4236276089 conn(0x7fafe40fd8c0 msgr2=0x7fafe40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.159+0000 7fafeb784640 1 -- 172.21.15.2:0/4236276089 shutdown_connections 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.159+0000 7fafeb784640 1 -- 172.21.15.2:0/4236276089 wait complete. 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.160+0000 7fafeb784640 1 Processor -- start 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.160+0000 7fafeb784640 1 -- start start 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.160+0000 7fafeb784640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafe4074590 0x7fafe41a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.160+0000 7fafeb784640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafe4074eb0 0x7fafe41a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.160+0000 7fafeb784640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe4112b90 0x7fafe419e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.160+0000 7fafeb784640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fafe4118420 con 0x7fafe4112b90 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.160+0000 7fafeb784640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fafe41182a0 con 0x7fafe4074590 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.160+0000 7fafeb784640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fafe41185a0 con 0x7fafe4074eb0 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.160+0000 7fafe9d21640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe4112b90 0x7fafe419e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.160+0000 7fafe9d21640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe4112b90 0x7fafe419e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56578/0 (socket says 172.21.15.2:56578) 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.160+0000 7fafe9d21640 1 -- 172.21.15.2:0/1866473161 learned_addr learned my addr 172.21.15.2:0/1866473161 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:56.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.160+0000 7fafe9520640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafe4074590 0x7fafe41a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:56.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.161+0000 7fafe8d1f640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafe4074eb0 0x7fafe41a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:56.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.161+0000 7fafe9d21640 1 -- 172.21.15.2:0/1866473161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafe4074eb0 msgr2=0x7fafe41a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:56.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.161+0000 7fafe9d21640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafe4074eb0 0x7fafe41a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:56.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.161+0000 7fafe9d21640 1 -- 172.21.15.2:0/1866473161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafe4074590 msgr2=0x7fafe41a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:56.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.161+0000 7fafe9d21640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafe4074590 0x7fafe41a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:56.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.161+0000 7fafe9d21640 1 -- 172.21.15.2:0/1866473161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe419ef90 con 0x7fafe4112b90 2024-09-15T23:13:56.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.161+0000 7fafe9520640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafe4074590 0x7fafe41a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:56.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.161+0000 7fafe9d21640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe4112b90 0x7fafe419e7f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00e9d0 tx=0x7fafdc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:56.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.161+0000 7fafda7fc640 1 -- 172.21.15.2:0/1866473161 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc00cd80 con 0x7fafe4112b90 2024-09-15T23:13:56.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.161+0000 7fafda7fc640 1 -- 172.21.15.2:0/1866473161 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafdc005020 con 0x7fafe4112b90 2024-09-15T23:13:56.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.161+0000 7fafeb784640 1 -- 172.21.15.2:0/1866473161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafe419f280 con 0x7fafe4112b90 2024-09-15T23:13:56.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.161+0000 7fafda7fc640 1 -- 172.21.15.2:0/1866473161 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0116d0 con 0x7fafe4112b90 2024-09-15T23:13:56.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.161+0000 7fafeb784640 1 -- 172.21.15.2:0/1866473161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafe41ab4d0 con 0x7fafe4112b90 2024-09-15T23:13:56.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.162+0000 7fafeb784640 1 -- 172.21.15.2:0/1866473161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafe4075cd0 con 0x7fafe4112b90 2024-09-15T23:13:56.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.163+0000 7fafda7fc640 1 -- 172.21.15.2:0/1866473161 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fafdc0051d0 con 0x7fafe4112b90 2024-09-15T23:13:56.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.164+0000 7fafda7fc640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fafd00a32d0 0x7fafd00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:56.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.164+0000 7fafe9520640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fafd00a32d0 0x7fafd00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:56.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.164+0000 7fafda7fc640 1 -- 172.21.15.2:0/1866473161 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fafdc0cffe0 con 0x7fafe4112b90 2024-09-15T23:13:56.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.164+0000 7fafe9520640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fafd00a32d0 0x7fafd00a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fafe0031440 tx=0x7fafe0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:56.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.167+0000 7fafda7fc640 1 -- 172.21.15.2:0/1866473161 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fafdc016030 con 0x7fafe4112b90 2024-09-15T23:13:56.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.380+0000 7fafeb784640 1 -- 172.21.15.2:0/1866473161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafe4074970 con 0x7fafe4112b90 2024-09-15T23:13:56.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.381+0000 7fafda7fc640 1 -- 172.21.15.2:0/1866473161 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11843 (secure 0 0 0) 0x7fafe4074970 con 0x7fafe4112b90 2024-09-15T23:13:56.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:13:56.383 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"btime":"2024-09-15T23:12:51:758295+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1051460220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1051460220},{"type":"v1","addr":"172.21.15.2:6839","nonce":1051460220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/1583533983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":1583533983},{"type":"v1","addr":"172.21.15.2:6841","nonce":1583533983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/91315913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":91315913},{"type":"v1","addr":"172.21.15.145:6835","nonce":91315913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1066293931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":1066293931},{"type":"v1","addr":"172.21.15.145:6837","nonce":1066293931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/418078184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":418078184},{"type":"v1","addr":"172.21.15.112:6837","nonce":418078184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:12:42.434565+0000","modified":"2024-09-15T23:12:51.456432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3930825714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3930825714},{"type":"v1","addr":"172.21.15.145:6839","nonce":3930825714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/1380244119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1380244119},{"type":"v1","addr":"172.21.15.112:6839","nonce":1380244119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24464,"qdb_cluster":[24464]},"id":1}]} 2024-09-15T23:13:56.383 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-09-15T23:13:56.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.384+0000 7fafeb784640 1 -- 172.21.15.2:0/1866473161 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fafd00a32d0 msgr2=0x7fafd00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:56.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.384+0000 7fafeb784640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fafd00a32d0 0x7fafd00a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fafe0031440 tx=0x7fafe0005a20 comp rx=0 tx=0).stop 2024-09-15T23:13:56.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.384+0000 7fafeb784640 1 -- 172.21.15.2:0/1866473161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe4112b90 msgr2=0x7fafe419e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:56.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.384+0000 7fafeb784640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe4112b90 0x7fafe419e7f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00e9d0 tx=0x7fafdc00ee90 comp rx=0 tx=0).stop 2024-09-15T23:13:56.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.384+0000 7fafeb784640 1 -- 172.21.15.2:0/1866473161 shutdown_connections 2024-09-15T23:13:56.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.384+0000 7fafeb784640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fafd00a32d0 0x7fafd00a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:56.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.384+0000 7fafeb784640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe4112b90 0x7fafe419e7f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:56.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.384+0000 7fafeb784640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fafe4074eb0 0x7fafe41a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:56.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.384+0000 7fafeb784640 1 --2- 172.21.15.2:0/1866473161 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fafe4074590 0x7fafe41a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:56.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.384+0000 7fafeb784640 1 -- 172.21.15.2:0/1866473161 >> 172.21.15.2:0/1866473161 conn(0x7fafe40fd8c0 msgr2=0x7fafe40ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:56.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.384+0000 7fafeb784640 1 -- 172.21.15.2:0/1866473161 shutdown_connections 2024-09-15T23:13:56.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:56.384+0000 7fafeb784640 1 -- 172.21.15.2:0/1866473161 wait complete. 2024-09-15T23:13:57.196 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T23:12:42.434565+0000', 'modified': '2024-09-15T23:12:51.456432+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24442': {'gid': 24442, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.145:6839/3930825714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6838', 'nonce': 3930825714}, {'type': 'v1', 'addr': '172.21.15.145:6839', 'nonce': 3930825714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.112:6839/1380244119', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6838', 'nonce': 1380244119}, {'type': 'v1', 'addr': '172.21.15.112:6839', 'nonce': 1380244119}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24464, 'qdb_cluster': [24464]} 2024-09-15T23:13:57.197 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:13:57.197 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T23:13:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:57.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:57 smithi002 ceph-mon[31019]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 48 B/s, 0 objects/s recovering 2024-09-15T23:13:57.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:57 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1866473161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:13:57.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:57 smithi145 ceph-mon[34901]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 48 B/s, 0 objects/s recovering 2024-09-15T23:13:57.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:57 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1866473161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:13:57.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:57 smithi112 ceph-mon[34367]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 48 B/s, 0 objects/s recovering 2024-09-15T23:13:57.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:57 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1866473161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:13:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.969+0000 7fc54929a640 1 -- 172.21.15.2:0/1348959351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc544102790 msgr2=0x7fc5441067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.969+0000 7fc54929a640 1 --2- 172.21.15.2:0/1348959351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc544102790 0x7fc5441067e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc52c009900 tx=0x7fc52c02a410 comp rx=0 tx=0).stop 2024-09-15T23:13:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.969+0000 7fc54929a640 1 -- 172.21.15.2:0/1348959351 shutdown_connections 2024-09-15T23:13:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.969+0000 7fc54929a640 1 --2- 172.21.15.2:0/1348959351 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc544106f10 0x7fc54410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:57.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.969+0000 7fc54929a640 1 --2- 172.21.15.2:0/1348959351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc544102790 0x7fc5441067e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.969+0000 7fc54929a640 1 --2- 172.21.15.2:0/1348959351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc544101de0 0x7fc5441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.969+0000 7fc54929a640 1 -- 172.21.15.2:0/1348959351 >> 172.21.15.2:0/1348959351 conn(0x7fc5440fd8c0 msgr2=0x7fc5440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.969+0000 7fc54929a640 1 -- 172.21.15.2:0/1348959351 shutdown_connections 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.969+0000 7fc54929a640 1 -- 172.21.15.2:0/1348959351 wait complete. 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc54929a640 1 Processor -- start 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc54929a640 1 -- start start 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc54929a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc544101de0 0x7fc5441983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc54929a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc544102790 0x7fc544198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc54929a640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc544106f10 0x7fc54419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc54929a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc544111e40 con 0x7fc544101de0 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc54929a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc544111cc0 con 0x7fc544102790 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc54929a640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc544111fc0 con 0x7fc544106f10 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc542ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc544101de0 0x7fc5441983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:57.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc542ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc544101de0 0x7fc5441983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54798/0 (socket says 172.21.15.2:54798) 2024-09-15T23:13:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc542ffd640 1 -- 172.21.15.2:0/3235669418 learned_addr learned my addr 172.21.15.2:0/3235669418 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc53bfff640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc544102790 0x7fc544198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc5437fe640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc544106f10 0x7fc54419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc542ffd640 1 -- 172.21.15.2:0/3235669418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc544106f10 msgr2=0x7fc54419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc542ffd640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc544106f10 0x7fc54419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc542ffd640 1 -- 172.21.15.2:0/3235669418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc544102790 msgr2=0x7fc544198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc542ffd640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc544102790 0x7fc544198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc542ffd640 1 -- 172.21.15.2:0/3235669418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54419d390 con 0x7fc544101de0 2024-09-15T23:13:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.970+0000 7fc5437fe640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc544106f10 0x7fc54419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.971+0000 7fc542ffd640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc544101de0 0x7fc5441983e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c890 tx=0x7fc53400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.971+0000 7fc540ff9640 1 -- 172.21.15.2:0/3235669418 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc534004220 con 0x7fc544101de0 2024-09-15T23:13:57.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.971+0000 7fc540ff9640 1 -- 172.21.15.2:0/3235669418 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc5340043c0 con 0x7fc544101de0 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.971+0000 7fc54929a640 1 -- 172.21.15.2:0/3235669418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54419d680 con 0x7fc544101de0 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.971+0000 7fc540ff9640 1 -- 172.21.15.2:0/3235669418 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc534004a00 con 0x7fc544101de0 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.971+0000 7fc54929a640 1 -- 172.21.15.2:0/3235669418 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5441a4f60 con 0x7fc544101de0 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.973+0000 7fc540ff9640 1 -- 172.21.15.2:0/3235669418 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc534004ba0 con 0x7fc544101de0 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.973+0000 7fc54b673740 1 Processor -- start 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.973+0000 7fc54b673740 1 -- start start 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc54b673740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcce9d0 0x56276bccedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc54b673740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bccf2f0 0x56276bcd9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc54b673740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcd9bb0 0x56276bcdbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc540ff9640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc5300a32d0 0x7fc5300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc5437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcce9d0 0x56276bccedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc5437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcce9d0 0x56276bccedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54800/0 (socket says 172.21.15.2:54800) 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc5437fe640 1 -- 172.21.15.2:0/666200785 learned_addr learned my addr 172.21.15.2:0/666200785 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc540ff9640 1 -- 172.21.15.2:0/3235669418 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fc5340cf780 con 0x7fc544101de0 2024-09-15T23:13:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc54b673740 1 -- 172.21.15.2:0/666200785 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56276bc35090 con 0x56276bcce9d0 2024-09-15T23:13:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc542ffd640 1 --2- 172.21.15.2:0/666200785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bccf2f0 0x56276bcd9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc54b673740 1 -- 172.21.15.2:0/666200785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56276bbdca70 con 0x56276bccf2f0 2024-09-15T23:13:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc54b673740 1 -- 172.21.15.2:0/666200785 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56276bc31050 con 0x56276bcd9bb0 2024-09-15T23:13:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc53bfff640 1 --2- 172.21.15.2:0/666200785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcd9bb0 0x56276bcdbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.974+0000 7fc5437fe640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc5300a32d0 0x7fc5300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.975+0000 7fc542ffd640 1 -- 172.21.15.2:0/666200785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcd9bb0 msgr2=0x56276bcdbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.975+0000 7fc542ffd640 1 --2- 172.21.15.2:0/666200785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcd9bb0 0x56276bcdbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.975+0000 7fc542ffd640 1 -- 172.21.15.2:0/666200785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcce9d0 msgr2=0x56276bccedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.975+0000 7fc542ffd640 1 --2- 172.21.15.2:0/666200785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcce9d0 0x56276bccedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.975+0000 7fc542ffd640 1 -- 172.21.15.2:0/666200785 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56276bbe9130 con 0x56276bccf2f0 2024-09-15T23:13:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.975+0000 7fc5437fe640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc5300a32d0 0x7fc5300a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00eca0 tx=0x7fc53c009ad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:57.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.975+0000 7fc542ffd640 1 --2- 172.21.15.2:0/666200785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bccf2f0 0x56276bcd9670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc5340cd110 tx=0x7fc53409b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11240ae165fcdceb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.975+0000 7fc5397fa640 1 -- 172.21.15.2:0/666200785 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53401d040 con 0x56276bccf2f0 2024-09-15T23:13:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.975+0000 7fc5397fa640 1 -- 172.21.15.2:0/666200785 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc53409c320 con 0x56276bccf2f0 2024-09-15T23:13:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.975+0000 7fc5397fa640 1 -- 172.21.15.2:0/666200785 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5340a4890 con 0x56276bccf2f0 2024-09-15T23:13:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.976+0000 7fc54b673740 1 -- 172.21.15.2:0/666200785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bccf2f0 msgr2=0x56276bcd9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.976+0000 7fc54b673740 1 --2- 172.21.15.2:0/666200785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bccf2f0 0x56276bcd9670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc5340cd110 tx=0x7fc53409b760 comp rx=0 tx=0).stop 2024-09-15T23:13:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.976+0000 7fc54b673740 1 -- 172.21.15.2:0/666200785 shutdown_connections 2024-09-15T23:13:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.976+0000 7fc54b673740 1 --2- 172.21.15.2:0/666200785 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcd9bb0 0x56276bcdbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.976+0000 7fc54b673740 1 --2- 172.21.15.2:0/666200785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bccf2f0 0x56276bcd9670 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.976+0000 7fc54b673740 1 --2- 172.21.15.2:0/666200785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcce9d0 0x56276bccedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.976+0000 7fc54b673740 1 -- 172.21.15.2:0/666200785 >> 172.21.15.2:0/666200785 conn(0x56276bccaf60 msgr2=0x56276bccb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.976+0000 7fc54b673740 1 -- 172.21.15.2:0/666200785 shutdown_connections 2024-09-15T23:13:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.976+0000 7fc54b673740 1 -- 172.21.15.2:0/666200785 wait complete. 2024-09-15T23:13:58.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.976+0000 7fc54b673740 1 -- start start 2024-09-15T23:13:58.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.976+0000 7fc54b673740 1 Processor -- start 2024-09-15T23:13:58.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc54b673740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bcce9d0 0x56276bcd9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:58.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc54b673740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bccf2f0 0x56276bcd67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:58.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc54b673740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 0x56276bcd6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:58.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc54b673740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56276bcdc780 con 0x56276bcd9bb0 2024-09-15T23:13:58.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc54b673740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56276bbeff20 con 0x56276bcce9d0 2024-09-15T23:13:58.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc54b673740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56276bcdc900 con 0x56276bccf2f0 2024-09-15T23:13:58.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc54b673740 10 client.0 _ll_register_callbacks cb 0x56276bbb9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:13:58.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc5437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 0x56276bcd6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:58.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc5437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 0x56276bcd6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54804/0 (socket says 172.21.15.2:54804) 2024-09-15T23:13:58.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc5437fe640 1 -- 172.21.15.2:0/993059207 learned_addr learned my addr 172.21.15.2:0/993059207 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:58.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc542ffd640 1 --2- 172.21.15.2:0/993059207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bcce9d0 0x56276bcd9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:58.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc5437fe640 1 -- 172.21.15.2:0/993059207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bccf2f0 msgr2=0x56276bcd67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:58.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc5437fe640 1 --2- 172.21.15.2:0/993059207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bccf2f0 0x56276bcd67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc5437fe640 1 -- 172.21.15.2:0/993059207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bcce9d0 msgr2=0x56276bcd9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:58.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc5437fe640 1 --2- 172.21.15.2:0/993059207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bcce9d0 0x56276bcd9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc5437fe640 1 -- 172.21.15.2:0/993059207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56276b9a62b0 con 0x56276bcd9bb0 2024-09-15T23:13:58.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc5437fe640 1 --2- 172.21.15.2:0/993059207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 0x56276bcd6d10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00efd0 tx=0x7fc53c0097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bcb3f20ea4c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:58.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.977+0000 7fc52a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-15T23:13:58.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc52a7fc640 1 -- 172.21.15.2:0/993059207 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c01ab90 con 0x56276bcd9bb0 2024-09-15T23:13:58.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc52a7fc640 1 -- 172.21.15.2:0/993059207 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fc53c01ad30 con 0x56276bcd9bb0 2024-09-15T23:13:58.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc54b673740 1 -- 172.21.15.2:0/993059207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc53409c320 con 0x56276bcd9bb0 2024-09-15T23:13:58.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc52a7fc640 1 -- 172.21.15.2:0/993059207 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc53c028480 con 0x56276bcd9bb0 2024-09-15T23:13:58.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc54b673740 10 client.14946 fetch_fsmap learned FSMap version 20 2024-09-15T23:13:58.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc54b673740 1 -- 172.21.15.2:0/993059207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56276bce80d0 con 0x56276bcd9bb0 2024-09-15T23:13:58.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc52a7fc640 1 -- 172.21.15.2:0/993059207 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc53409c320 con 0x56276bcd9bb0 2024-09-15T23:13:58.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc52a7fc640 1 -- 172.21.15.2:0/993059207 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc53c01b070 con 0x56276bcd9bb0 2024-09-15T23:13:58.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc54b673740 10 client.14946 fetch_fsmap finished waiting for FSMap version 20 2024-09-15T23:13:58.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc54b673740 10 client.14946 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T23:13:58.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc54b673740 20 client.14946 populate_metadata read hostname 'smithi002' 2024-09-15T23:13:58.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc54b673740 1 --2- 172.21.15.2:0/993059207 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x56276bcea790 0x56276bcebc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:58.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc54b673740 4 client.14946 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:13:58.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.978+0000 7fc54b673740 1 -- 172.21.15.2:0/993059207 --> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56276bc42600 con 0x56276bcea790 2024-09-15T23:13:58.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.979+0000 7fc542ffd640 1 --2- 172.21.15.2:0/993059207 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x56276bcea790 0x56276bcebc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:58.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.979+0000 7fc542ffd640 1 --2- 172.21.15.2:0/993059207 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x56276bcea790 0x56276bcebc00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=135eb2680eab1f95 server_cookie=355ab95b591420fa in_seq=0 out_seq=0 2024-09-15T23:13:58.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.979+0000 7fc52a7fc640 10 client.14946 ms_handle_connect on v2:172.21.15.112:6838/1380244119 2024-09-15T23:13:58.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc52a7fc640 1 -- 172.21.15.2:0/993059207 <== mds.0 v2:172.21.15.112:6838/1380244119 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56276bc42600 con 0x56276bcea790 2024-09-15T23:13:58.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc52a7fc640 10 client.14946 handle_command_reply: tid=0 2024-09-15T23:13:58.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc54b673740 1 client.14946 shutdown 2024-09-15T23:13:58.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc54b673740 1 -- 172.21.15.2:0/993059207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 msgr2=0x56276bcd6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:58.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc54b673740 1 --2- 172.21.15.2:0/993059207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 0x56276bcd6d10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00efd0 tx=0x7fc53c0097b0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc54b673740 1 -- 172.21.15.2:0/993059207 shutdown_connections 2024-09-15T23:13:58.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc54b673740 1 --2- 172.21.15.2:0/993059207 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x56276bcea790 0x56276bcebc00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc54b673740 1 --2- 172.21.15.2:0/993059207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 0x56276bcd6d10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc54b673740 1 --2- 172.21.15.2:0/993059207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bccf2f0 0x56276bcd67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc54b673740 1 --2- 172.21.15.2:0/993059207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bcce9d0 0x56276bcd9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc54b673740 1 -- 172.21.15.2:0/993059207 >> 172.21.15.2:0/993059207 conn(0x56276bccaf60 msgr2=0x56276bcd0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:58.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc52a7fc640 0 client.14946 ms_handle_reset on v2:172.21.15.112:6838/1380244119 2024-09-15T23:13:58.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc54b673740 1 -- 172.21.15.2:0/993059207 shutdown_connections 2024-09-15T23:13:58.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc54b673740 1 -- 172.21.15.2:0/993059207 wait complete. 2024-09-15T23:13:58.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.980+0000 7fc54b673740 20 client.14946 trim_cache size 0 max 16384 2024-09-15T23:13:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.998+0000 7fc54b673740 1 Processor -- start 2024-09-15T23:13:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.998+0000 7fc54b673740 1 -- start start 2024-09-15T23:13:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc54b673740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcce9d0 0x56276bceae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc54b673740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bccf2f0 0x56276bceb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc54b673740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bcd9bb0 0x56276bcea0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:58.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc54b673740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56276bce9f40 con 0x56276bccf2f0 2024-09-15T23:13:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc54b673740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56276bcea610 con 0x56276bcd9bb0 2024-09-15T23:13:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc54b673740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56276bceace0 con 0x56276bcce9d0 2024-09-15T23:13:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc53bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bccf2f0 0x56276bceb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc53bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bccf2f0 0x56276bceb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54808/0 (socket says 172.21.15.2:54808) 2024-09-15T23:13:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc53bfff640 1 -- 172.21.15.2:0/3286395736 learned_addr learned my addr 172.21.15.2:0/3286395736 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc542ffd640 1 --2- 172.21.15.2:0/3286395736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcce9d0 0x56276bceae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc5437fe640 1 --2- 172.21.15.2:0/3286395736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bcd9bb0 0x56276bcea0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc53bfff640 1 -- 172.21.15.2:0/3286395736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcce9d0 msgr2=0x56276bceae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc53bfff640 1 --2- 172.21.15.2:0/3286395736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcce9d0 0x56276bceae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc53bfff640 1 -- 172.21.15.2:0/3286395736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bcd9bb0 msgr2=0x56276bcea0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:58.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc53bfff640 1 --2- 172.21.15.2:0/3286395736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bcd9bb0 0x56276bcea0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc53bfff640 1 -- 172.21.15.2:0/3286395736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56276bccf120 con 0x56276bccf2f0 2024-09-15T23:13:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc5437fe640 1 --2- 172.21.15.2:0/3286395736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bcd9bb0 0x56276bcea0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc542ffd640 1 --2- 172.21.15.2:0/3286395736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcce9d0 0x56276bceae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc53bfff640 1 --2- 172.21.15.2:0/3286395736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bccf2f0 0x56276bceb530 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc52c02a930 tx=0x7fc52c031e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8448ae246e2115a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc538ff9640 1 -- 172.21.15.2:0/3286395736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c035040 con 0x56276bccf2f0 2024-09-15T23:13:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc538ff9640 1 -- 172.21.15.2:0/3286395736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc52c031720 con 0x56276bccf2f0 2024-09-15T23:13:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:57.999+0000 7fc538ff9640 1 -- 172.21.15.2:0/3286395736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c03d450 con 0x56276bccf2f0 2024-09-15T23:13:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.000+0000 7fc54b673740 1 -- 172.21.15.2:0/3286395736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bccf2f0 msgr2=0x56276bceb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.000+0000 7fc54b673740 1 --2- 172.21.15.2:0/3286395736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bccf2f0 0x56276bceb530 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc52c02a930 tx=0x7fc52c031e80 comp rx=0 tx=0).stop 2024-09-15T23:13:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.000+0000 7fc54b673740 1 -- 172.21.15.2:0/3286395736 shutdown_connections 2024-09-15T23:13:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.000+0000 7fc54b673740 1 --2- 172.21.15.2:0/3286395736 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bcd9bb0 0x56276bcea0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.000+0000 7fc54b673740 1 --2- 172.21.15.2:0/3286395736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bccf2f0 0x56276bceb530 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.000+0000 7fc54b673740 1 --2- 172.21.15.2:0/3286395736 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcce9d0 0x56276bceae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.000+0000 7fc54b673740 1 -- 172.21.15.2:0/3286395736 >> 172.21.15.2:0/3286395736 conn(0x56276bccaf60 msgr2=0x56276bccb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.000+0000 7fc54b673740 1 -- 172.21.15.2:0/3286395736 shutdown_connections 2024-09-15T23:13:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.000+0000 7fc54b673740 1 -- 172.21.15.2:0/3286395736 wait complete. 2024-09-15T23:13:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.000+0000 7fc54b673740 1 -- start start 2024-09-15T23:13:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc54b673740 1 Processor -- start 2024-09-15T23:13:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc54b673740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcce9d0 0x56276bcf12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc54b673740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bccf2f0 0x56276bcf17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc54b673740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 0x56276bcf1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc54b673740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56276bceba80 con 0x56276bcd9bb0 2024-09-15T23:13:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc54b673740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56276bceb3b0 con 0x56276bccf2f0 2024-09-15T23:13:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc54b673740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56276bcec150 con 0x56276bcce9d0 2024-09-15T23:13:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc54b673740 10 client.0 _ll_register_callbacks cb 0x7fc53c00ecd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc5437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 0x56276bcf1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc5437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 0x56276bcf1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54824/0 (socket says 172.21.15.2:54824) 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc5437fe640 1 -- 172.21.15.2:0/687933598 learned_addr learned my addr 172.21.15.2:0/687933598 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc53bfff640 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bccf2f0 0x56276bcf17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc542ffd640 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcce9d0 0x56276bcf12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc5437fe640 1 -- 172.21.15.2:0/687933598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcce9d0 msgr2=0x56276bcf12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc5437fe640 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcce9d0 0x56276bcf12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc5437fe640 1 -- 172.21.15.2:0/687933598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bccf2f0 msgr2=0x56276bcf17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc5437fe640 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bccf2f0 0x56276bcf17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc5437fe640 1 -- 172.21.15.2:0/687933598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56276bd56fc0 con 0x56276bcd9bb0 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc542ffd640 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcce9d0 0x56276bcf12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.001+0000 7fc53bfff640 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bccf2f0 0x56276bcf17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc5437fe640 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 0x56276bcf1d30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc53c033650 tx=0x7fc53c033680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f494a095c126fa60 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc52a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc52a7fc640 1 -- 172.21.15.2:0/687933598 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c01ab90 con 0x56276bcd9bb0 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc52a7fc640 1 -- 172.21.15.2:0/687933598 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fc53c01ad30 con 0x56276bcd9bb0 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc54b673740 1 -- 172.21.15.2:0/687933598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc52c031720 con 0x56276bcd9bb0 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc52a7fc640 1 -- 172.21.15.2:0/687933598 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc53c042050 con 0x56276bcd9bb0 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc54b673740 10 client.14952 fetch_fsmap learned FSMap version 20 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc54b673740 1 -- 172.21.15.2:0/687933598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56276bd58230 con 0x56276bcd9bb0 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc52a7fc640 1 -- 172.21.15.2:0/687933598 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc52c031720 con 0x56276bcd9bb0 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc52a7fc640 1 -- 172.21.15.2:0/687933598 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc53c028c30 con 0x56276bcd9bb0 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc54b673740 10 client.14952 fetch_fsmap finished waiting for FSMap version 20 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc54b673740 10 client.14952 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc54b673740 20 client.14952 populate_metadata read hostname 'smithi002' 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc54b673740 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x56276bd5ce30 0x56276bd5bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc54b673740 4 client.14952 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:13:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.002+0000 7fc54b673740 1 -- 172.21.15.2:0/687933598 --> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] -- command(tid 0: {"prefix": "status"}) -- 0x56276bc3cb10 con 0x56276bd5ce30 2024-09-15T23:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.003+0000 7fc542ffd640 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x56276bd5ce30 0x56276bd5bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.003+0000 7fc542ffd640 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x56276bd5ce30 0x56276bd5bb40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9279c1e9a56eebc9 server_cookie=7e1602f1b5e2452 in_seq=0 out_seq=0 2024-09-15T23:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.003+0000 7fc52a7fc640 10 client.14952 ms_handle_connect on v2:172.21.15.112:6838/1380244119 2024-09-15T23:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.003+0000 7fc52a7fc640 1 -- 172.21.15.2:0/687933598 <== mds.0 v2:172.21.15.112:6838/1380244119 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56276bc3cb10 con 0x56276bd5ce30 2024-09-15T23:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.003+0000 7fc52a7fc640 10 client.14952 handle_command_reply: tid=0 2024-09-15T23:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.003+0000 7fc54b673740 1 client.14952 shutdown 2024-09-15T23:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54b673740 1 -- 172.21.15.2:0/687933598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 msgr2=0x56276bcf1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54b673740 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 0x56276bcf1d30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc53c033650 tx=0x7fc53c033680 comp rx=0 tx=0).stop 2024-09-15T23:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54b673740 1 -- 172.21.15.2:0/687933598 shutdown_connections 2024-09-15T23:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54b673740 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x56276bd5ce30 0x56276bd5bb40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54b673740 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56276bcd9bb0 0x56276bcf1d30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54b673740 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56276bccf2f0 0x56276bcf17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54b673740 1 --2- 172.21.15.2:0/687933598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56276bcce9d0 0x56276bcf12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54b673740 1 -- 172.21.15.2:0/687933598 >> 172.21.15.2:0/687933598 conn(0x56276bccaf60 msgr2=0x56276bcd1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc52a7fc640 0 client.14952 ms_handle_reset on v2:172.21.15.112:6838/1380244119 2024-09-15T23:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54b673740 1 -- 172.21.15.2:0/687933598 shutdown_connections 2024-09-15T23:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54b673740 1 -- 172.21.15.2:0/687933598 wait complete. 2024-09-15T23:13:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54b673740 20 client.14952 trim_cache size 0 max 16384 2024-09-15T23:13:58.017 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-15T23:13:58.017 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "cb7ab3ae-73b6-11ef-bceb-c7b262605968", 2024-09-15T23:13:58.017 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-15T23:13:58.018 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24464, 2024-09-15T23:13:58.018 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-15T23:13:58.018 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-15T23:13:58.018 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-15T23:13:58.018 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 75.273637820000005, 2024-09-15T23:13:58.018 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 20, 2024-09-15T23:13:58.018 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 83, 2024-09-15T23:13:58.018 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-15T23:13:58.018 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 86.349999245999996 2024-09-15T23:13:58.018 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-15T23:13:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54929a640 1 -- 172.21.15.2:0/3235669418 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc5300a32d0 msgr2=0x7fc5300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54929a640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc5300a32d0 0x7fc5300a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00eca0 tx=0x7fc53c009ad0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54929a640 1 -- 172.21.15.2:0/3235669418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc544101de0 msgr2=0x7fc5441983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54929a640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc544101de0 0x7fc5441983e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c890 tx=0x7fc53400cd50 comp rx=0 tx=0).stop 2024-09-15T23:13:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54929a640 1 -- 172.21.15.2:0/3235669418 shutdown_connections 2024-09-15T23:13:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54929a640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fc5300a32d0 0x7fc5300a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54929a640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc544106f10 0x7fc54419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54929a640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc544102790 0x7fc544198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54929a640 1 --2- 172.21.15.2:0/3235669418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc544101de0 0x7fc5441983e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.004+0000 7fc54929a640 1 -- 172.21.15.2:0/3235669418 >> 172.21.15.2:0/3235669418 conn(0x7fc5440fd8c0 msgr2=0x7fc5440fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.005+0000 7fc54929a640 1 -- 172.21.15.2:0/3235669418 shutdown_connections 2024-09-15T23:13:58.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:58.005+0000 7fc54929a640 1 -- 172.21.15.2:0/3235669418 wait complete. 2024-09-15T23:13:58.811 INFO:tasks.cephadm:Setup complete, yielding 2024-09-15T23:13:58.811 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T23:13:58.823 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-15T23:13:58.824 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-15T23:13:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:13:59.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:13:59 smithi002 ceph-mon[31019]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T23:13:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.561+0000 7f8db1843640 1 -- 172.21.15.2:0/1296877072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac104fd0 msgr2=0x7f8dac1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.561+0000 7f8db1843640 1 --2- 172.21.15.2:0/1296877072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac104fd0 0x7f8dac1073c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8da0009900 tx=0x7f8da002a410 comp rx=0 tx=0).stop 2024-09-15T23:13:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.561+0000 7f8db1843640 1 -- 172.21.15.2:0/1296877072 shutdown_connections 2024-09-15T23:13:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.561+0000 7f8db1843640 1 --2- 172.21.15.2:0/1296877072 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dac107900 0x7f8dac109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.561+0000 7f8db1843640 1 --2- 172.21.15.2:0/1296877072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac104fd0 0x7f8dac1073c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.561+0000 7f8db1843640 1 --2- 172.21.15.2:0/1296877072 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac1026a0 0x7f8dac104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.561+0000 7f8db1843640 1 -- 172.21.15.2:0/1296877072 >> 172.21.15.2:0/1296877072 conn(0x7f8dac0fc2a0 msgr2=0x7f8dac0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.561+0000 7f8db1843640 1 -- 172.21.15.2:0/1296877072 shutdown_connections 2024-09-15T23:13:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.561+0000 7f8db1843640 1 -- 172.21.15.2:0/1296877072 wait complete. 2024-09-15T23:13:59.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.562+0000 7f8db1843640 1 Processor -- start 2024-09-15T23:13:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.562+0000 7f8db1843640 1 -- start start 2024-09-15T23:13:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.562+0000 7f8db1843640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dac1026a0 0x7f8dac197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.562+0000 7f8db1843640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac104fd0 0x7f8dac198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.562+0000 7f8db1843640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac107900 0x7f8dac19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.562+0000 7f8db1843640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac10d7f0 con 0x7f8dac104fd0 2024-09-15T23:13:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.562+0000 7f8db1843640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac10d670 con 0x7f8dac107900 2024-09-15T23:13:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.562+0000 7f8db1843640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac10d970 con 0x7f8dac1026a0 2024-09-15T23:13:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.562+0000 7f8daa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac104fd0 0x7f8dac198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8daa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac104fd0 0x7f8dac198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54850/0 (socket says 172.21.15.2:54850) 2024-09-15T23:13:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8daa7fc640 1 -- 172.21.15.2:0/2748474318 learned_addr learned my addr 172.21.15.2:0/2748474318 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:13:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8dab7fe640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac107900 0x7f8dac19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8daaffd640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dac1026a0 0x7f8dac197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8daa7fc640 1 -- 172.21.15.2:0/2748474318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dac1026a0 msgr2=0x7f8dac197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8daa7fc640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dac1026a0 0x7f8dac197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8daa7fc640 1 -- 172.21.15.2:0/2748474318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac107900 msgr2=0x7f8dac19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8daa7fc640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac107900 0x7f8dac19f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8daa7fc640 1 -- 172.21.15.2:0/2748474318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac19fb30 con 0x7f8dac104fd0 2024-09-15T23:13:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8daa7fc640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac104fd0 0x7f8dac198440 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8da00314e0 tx=0x7f8da0003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8db0841640 1 -- 172.21.15.2:0/2748474318 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da003f070 con 0x7f8dac104fd0 2024-09-15T23:13:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8db0841640 1 -- 172.21.15.2:0/2748474318 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8da0031e40 con 0x7f8dac104fd0 2024-09-15T23:13:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8db1843640 1 -- 172.21.15.2:0/2748474318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dac19fdc0 con 0x7f8dac104fd0 2024-09-15T23:13:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8db0841640 1 -- 172.21.15.2:0/2748474318 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0035030 con 0x7f8dac104fd0 2024-09-15T23:13:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.563+0000 7f8db1843640 1 -- 172.21.15.2:0/2748474318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dac1a02c0 con 0x7f8dac104fd0 2024-09-15T23:13:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.564+0000 7f8db1843640 1 -- 172.21.15.2:0/2748474318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dac0fdd90 con 0x7f8dac104fd0 2024-09-15T23:13:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.565+0000 7f8db0841640 1 -- 172.21.15.2:0/2748474318 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8da0042070 con 0x7f8dac104fd0 2024-09-15T23:13:59.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.566+0000 7f8db0841640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8d940a3300 0x7f8d940a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:59.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.566+0000 7f8daaffd640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8d940a3300 0x7f8d940a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:59.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.566+0000 7f8db0841640 1 -- 172.21.15.2:0/2748474318 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f8da00f03c0 con 0x7f8dac104fd0 2024-09-15T23:13:59.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.567+0000 7f8daaffd640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8d940a3300 0x7f8d940a57c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005fd0 tx=0x7f8d9c009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:59.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.570+0000 7f8db0841640 1 -- 172.21.15.2:0/2748474318 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8da00bcf60 con 0x7f8dac104fd0 2024-09-15T23:13:59.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:13:59 smithi145 ceph-mon[34901]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T23:13:59.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:13:59 smithi112 ceph-mon[34367]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T23:13:59.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.763+0000 7f8db1843640 1 -- 172.21.15.2:0/2748474318 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f8dac062630 con 0x7f8d940a3300 2024-09-15T23:13:59.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.764+0000 7f8db0841640 1 -- 172.21.15.2:0/2748474318 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f8dac062630 con 0x7f8d940a3300 2024-09-15T23:13:59.766 INFO:teuthology.orchestra.run.smithi002.stdout:Backend: cephadm 2024-09-15T23:13:59.766 INFO:teuthology.orchestra.run.smithi002.stdout:Available: Yes 2024-09-15T23:13:59.766 INFO:teuthology.orchestra.run.smithi002.stdout:Paused: No 2024-09-15T23:13:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.766+0000 7f8db1843640 1 -- 172.21.15.2:0/2748474318 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8d940a3300 msgr2=0x7f8d940a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.766+0000 7f8db1843640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8d940a3300 0x7f8d940a57c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005fd0 tx=0x7f8d9c009870 comp rx=0 tx=0).stop 2024-09-15T23:13:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.766+0000 7f8db1843640 1 -- 172.21.15.2:0/2748474318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac104fd0 msgr2=0x7f8dac198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.766+0000 7f8db1843640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac104fd0 0x7f8dac198440 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8da00314e0 tx=0x7f8da0003c80 comp rx=0 tx=0).stop 2024-09-15T23:13:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.767+0000 7f8db1843640 1 -- 172.21.15.2:0/2748474318 shutdown_connections 2024-09-15T23:13:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.767+0000 7f8db1843640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8d940a3300 0x7f8d940a57c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.767+0000 7f8db1843640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8dac107900 0x7f8dac19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.767+0000 7f8db1843640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dac104fd0 0x7f8dac198440 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.767+0000 7f8db1843640 1 --2- 172.21.15.2:0/2748474318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dac1026a0 0x7f8dac197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.767+0000 7f8db1843640 1 -- 172.21.15.2:0/2748474318 >> 172.21.15.2:0/2748474318 conn(0x7f8dac0fc2a0 msgr2=0x7f8dac103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.767+0000 7f8db1843640 1 -- 172.21.15.2:0/2748474318 shutdown_connections 2024-09-15T23:13:59.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:13:59.767+0000 7f8db1843640 1 -- 172.21.15.2:0/2748474318 wait complete. 2024-09-15T23:14:00.487 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-15T23:14:00.752 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:14:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.256+0000 7f90bb77e640 1 -- 172.21.15.2:0/3874115943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90b4101770 msgr2=0x7f90b4101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.256+0000 7f90bb77e640 1 --2- 172.21.15.2:0/3874115943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90b4101770 0x7f90b4101c20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009ca0 tx=0x7f90ac02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:14:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.256+0000 7f90bb77e640 1 -- 172.21.15.2:0/3874115943 shutdown_connections 2024-09-15T23:14:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.256+0000 7f90bb77e640 1 --2- 172.21.15.2:0/3874115943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90b4101770 0x7f90b4101c20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.256+0000 7f90bb77e640 1 --2- 172.21.15.2:0/3874115943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90b4100dd0 0x7f90b4101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.256+0000 7f90bb77e640 1 --2- 172.21.15.2:0/3874115943 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90b4100490 0x7f90b4100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.256+0000 7f90bb77e640 1 -- 172.21.15.2:0/3874115943 >> 172.21.15.2:0/3874115943 conn(0x7f90b40fc2a0 msgr2=0x7f90b40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.257+0000 7f90bb77e640 1 -- 172.21.15.2:0/3874115943 shutdown_connections 2024-09-15T23:14:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.257+0000 7f90bb77e640 1 -- 172.21.15.2:0/3874115943 wait complete. 2024-09-15T23:14:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.257+0000 7f90bb77e640 1 Processor -- start 2024-09-15T23:14:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.257+0000 7f90bb77e640 1 -- start start 2024-09-15T23:14:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.257+0000 7f90bb77e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90b4100490 0x7f90b4199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:01.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.257+0000 7f90bb77e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90b4100dd0 0x7f90b419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.257+0000 7f90bb77e640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90b4101770 0x7f90b41a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.257+0000 7f90bb77e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f90b410f910 con 0x7f90b4100dd0 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.257+0000 7f90bb77e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f90b410f790 con 0x7f90b4100490 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.257+0000 7f90bb77e640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f90b410fa90 con 0x7f90b4101770 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90b8d19640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90b4100dd0 0x7f90b419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90b8d19640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90b4100dd0 0x7f90b419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54872/0 (socket says 172.21.15.2:54872) 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90b8d19640 1 -- 172.21.15.2:0/2861522135 learned_addr learned my addr 172.21.15.2:0/2861522135 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90b9d1b640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90b4101770 0x7f90b41a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90b951a640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90b4100490 0x7f90b4199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90b8d19640 1 -- 172.21.15.2:0/2861522135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90b4101770 msgr2=0x7f90b41a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90b8d19640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90b4101770 0x7f90b41a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90b8d19640 1 -- 172.21.15.2:0/2861522135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90b4100490 msgr2=0x7f90b4199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90b8d19640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90b4100490 0x7f90b4199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:01.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90b8d19640 1 -- 172.21.15.2:0/2861522135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b41a1bf0 con 0x7f90b4100dd0 2024-09-15T23:14:01.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90b9d1b640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90b4101770 0x7f90b41a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:01.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90b8d19640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90b4100dd0 0x7f90b419a500 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f90a400d950 tx=0x7f90a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:01.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90aa7fc640 1 -- 172.21.15.2:0/2861522135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a4017070 con 0x7f90b4100dd0 2024-09-15T23:14:01.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90aa7fc640 1 -- 172.21.15.2:0/2861522135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f90a4009c30 con 0x7f90b4100dd0 2024-09-15T23:14:01.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90bb77e640 1 -- 172.21.15.2:0/2861522135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b41a1ee0 con 0x7f90b4100dd0 2024-09-15T23:14:01.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90aa7fc640 1 -- 172.21.15.2:0/2861522135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a400f620 con 0x7f90b4100dd0 2024-09-15T23:14:01.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.258+0000 7f90bb77e640 1 -- 172.21.15.2:0/2861522135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b41a23e0 con 0x7f90b4100dd0 2024-09-15T23:14:01.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.259+0000 7f90bb77e640 1 -- 172.21.15.2:0/2861522135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b410b1e0 con 0x7f90b4100dd0 2024-09-15T23:14:01.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.261+0000 7f90aa7fc640 1 -- 172.21.15.2:0/2861522135 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f90a40109a0 con 0x7f90b4100dd0 2024-09-15T23:14:01.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.261+0000 7f90aa7fc640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f90a00a3380 0x7f90a00a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:01.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.261+0000 7f90aa7fc640 1 -- 172.21.15.2:0/2861522135 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f90a40cf660 con 0x7f90b4100dd0 2024-09-15T23:14:01.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.261+0000 7f90b951a640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f90a00a3380 0x7f90a00a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:01.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.262+0000 7f90b951a640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f90a00a3380 0x7f90a00a5840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f90b0005fd0 tx=0x7f90b0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:01.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.265+0000 7f90aa7fc640 1 -- 172.21.15.2:0/2861522135 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90a409c280 con 0x7f90b4100dd0 2024-09-15T23:14:01.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.450+0000 7f90bb77e640 1 -- 172.21.15.2:0/2861522135 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f90b4062630 con 0x7f90a00a3380 2024-09-15T23:14:01.452 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:01 smithi002 ceph-mon[31019]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:14:01.452 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:01 smithi002 ceph-mon[31019]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:01.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.463+0000 7f90aa7fc640 1 -- 172.21.15.2:0/2861522135 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f90b4062630 con 0x7f90a00a3380 2024-09-15T23:14:01.464 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-15T23:14:01.464 INFO:teuthology.orchestra.run.smithi002.stdout:mds.a smithi002 running (92s) 15s ago 92s 16.7M - 19.1.1-326-g8921c8ef f1455bd0219c 6352e2a1cb3b 2024-09-15T23:14:01.464 INFO:teuthology.orchestra.run.smithi002.stdout:mds.b smithi112 running (90s) 21s ago 89s 25.5M - 19.1.1-326-g8921c8ef f1455bd0219c ac2a7a3734e9 2024-09-15T23:14:01.464 INFO:teuthology.orchestra.run.smithi002.stdout:mds.c smithi145 running (104s) 21s ago 103s 14.4M - 19.1.1-326-g8921c8ef f1455bd0219c ca69f1760c07 2024-09-15T23:14:01.464 INFO:teuthology.orchestra.run.smithi002.stdout:mds.d smithi002 running (112s) 15s ago 111s 16.7M - 19.1.1-326-g8921c8ef f1455bd0219c a2362a05268e 2024-09-15T23:14:01.464 INFO:teuthology.orchestra.run.smithi002.stdout:mds.e smithi112 running (109s) 21s ago 108s 13.4M - 19.1.1-326-g8921c8ef f1455bd0219c 7b9493fdbe5f 2024-09-15T23:14:01.464 INFO:teuthology.orchestra.run.smithi002.stdout:mds.f smithi145 running (106s) 21s ago 106s 14.4M - 19.1.1-326-g8921c8ef f1455bd0219c 585e2dda576f 2024-09-15T23:14:01.464 INFO:teuthology.orchestra.run.smithi002.stdout:mds.g smithi002 running (95s) 15s ago 95s 14.3M - 19.1.1-326-g8921c8ef f1455bd0219c be5fc7f04906 2024-09-15T23:14:01.464 INFO:teuthology.orchestra.run.smithi002.stdout:mds.h smithi112 running (101s) 21s ago 100s 15.8M - 19.1.1-326-g8921c8ef f1455bd0219c 5d49d742211b 2024-09-15T23:14:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:mds.i smithi145 running (98s) 21s ago 98s 17.3M - 19.1.1-326-g8921c8ef f1455bd0219c f9d479125847 2024-09-15T23:14:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:mds.j smithi002 running (115s) 15s ago 115s 15.9M - 19.1.1-326-g8921c8ef f1455bd0219c e7f4095fc8c9 2024-09-15T23:14:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:mds.k smithi112 running (118s) 21s ago 118s 15.9M - 19.1.1-326-g8921c8ef f1455bd0219c 73e6b6932b6c 2024-09-15T23:14:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:mds.l smithi145 running (2m) 21s ago 2m 14.5M - 19.1.1-326-g8921c8ef f1455bd0219c 36dfc9e6f2e8 2024-09-15T23:14:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.x smithi002 *:9283,8765 running (9m) 15s ago 9m 508M - 19.1.1-326-g8921c8ef f1455bd0219c 318dcf0efa63 2024-09-15T23:14:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.y smithi112 *:8443,8765 running (7m) 21s ago 7m 442M - 19.1.1-326-g8921c8ef f1455bd0219c 657b3f07186c 2024-09-15T23:14:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.z smithi145 *:8443,8765 running (7m) 21s ago 7m 443M - 19.1.1-326-g8921c8ef f1455bd0219c 443e6d5a71de 2024-09-15T23:14:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:mon.a smithi002 running (9m) 15s ago 9m 53.0M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 0ce84f8b0ca9 2024-09-15T23:14:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:mon.b smithi112 running (7m) 21s ago 7m 43.5M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 13d6f16dcb23 2024-09-15T23:14:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:mon.c smithi145 running (7m) 21s ago 7m 44.4M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 8a6e68471bbd 2024-09-15T23:14:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (7m) 15s ago 7m 60.9M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 7c17064c85c4 2024-09-15T23:14:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi112 running (6m) 21s ago 6m 57.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 843111b734e1 2024-09-15T23:14:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi145 running (6m) 21s ago 6m 46.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c d6594fa4735f 2024-09-15T23:14:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi002 running (5m) 15s ago 5m 57.1M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 5a16018da321 2024-09-15T23:14:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi112 running (5m) 21s ago 5m 42.7M 4272M 19.1.1-326-g8921c8ef f1455bd0219c cbe747376844 2024-09-15T23:14:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi145 running (4m) 21s ago 4m 57.9M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 161fe6a9e782 2024-09-15T23:14:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 smithi002 running (4m) 15s ago 4m 41.0M 4273M 19.1.1-326-g8921c8ef f1455bd0219c f356ae995376 2024-09-15T23:14:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 smithi112 running (4m) 21s ago 4m 56.6M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 3df392ba0541 2024-09-15T23:14:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 smithi145 running (3m) 21s ago 3m 52.8M 4272M 19.1.1-326-g8921c8ef f1455bd0219c db5dfc19f85a 2024-09-15T23:14:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 smithi002 running (3m) 15s ago 3m 43.8M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 0fa6a83017bb 2024-09-15T23:14:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 smithi112 running (2m) 21s ago 2m 43.1M 4272M 19.1.1-326-g8921c8ef f1455bd0219c a9968e37e79b 2024-09-15T23:14:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 smithi145 running (2m) 21s ago 2m 40.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c f592d7856895 2024-09-15T23:14:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.465+0000 7f90bb77e640 1 -- 172.21.15.2:0/2861522135 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f90a00a3380 msgr2=0x7f90a00a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.465+0000 7f90bb77e640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f90a00a3380 0x7f90a00a5840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f90b0005fd0 tx=0x7f90b0005850 comp rx=0 tx=0).stop 2024-09-15T23:14:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.465+0000 7f90bb77e640 1 -- 172.21.15.2:0/2861522135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90b4100dd0 msgr2=0x7f90b419a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.465+0000 7f90bb77e640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90b4100dd0 0x7f90b419a500 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f90a400d950 tx=0x7f90a400de10 comp rx=0 tx=0).stop 2024-09-15T23:14:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.465+0000 7f90bb77e640 1 -- 172.21.15.2:0/2861522135 shutdown_connections 2024-09-15T23:14:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.465+0000 7f90bb77e640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f90a00a3380 0x7f90a00a5840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.465+0000 7f90bb77e640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f90b4101770 0x7f90b41a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.465+0000 7f90bb77e640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90b4100dd0 0x7f90b419a500 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.465+0000 7f90bb77e640 1 --2- 172.21.15.2:0/2861522135 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f90b4100490 0x7f90b4199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:01.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.465+0000 7f90bb77e640 1 -- 172.21.15.2:0/2861522135 >> 172.21.15.2:0/2861522135 conn(0x7f90b40fc2a0 msgr2=0x7f90b40fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.465+0000 7f90bb77e640 1 -- 172.21.15.2:0/2861522135 shutdown_connections 2024-09-15T23:14:01.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:01.465+0000 7f90bb77e640 1 -- 172.21.15.2:0/2861522135 wait complete. 2024-09-15T23:14:01.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:01 smithi145 ceph-mon[34901]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:14:01.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:01 smithi145 ceph-mon[34901]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:01.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:01 smithi112 ceph-mon[34367]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:14:01.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:01 smithi112 ceph-mon[34367]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:02.182 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-15T23:14:02.444 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:14:02.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:02 smithi002 ceph-mon[31019]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:02.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:02 smithi145 ceph-mon[34901]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:02.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:02 smithi112 ceph-mon[34367]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:02.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.960+0000 7ffab9541640 1 -- 172.21.15.2:0/4205357532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab41026d0 msgr2=0x7ffab4108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:02.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.960+0000 7ffab9541640 1 --2- 172.21.15.2:0/4205357532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab41026d0 0x7ffab4108f60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009ca0 tx=0x7ffaac02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:14:02.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.960+0000 7ffab9541640 1 -- 172.21.15.2:0/4205357532 shutdown_connections 2024-09-15T23:14:02.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.960+0000 7ffab9541640 1 --2- 172.21.15.2:0/4205357532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab41026d0 0x7ffab4108f60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:02.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.960+0000 7ffab9541640 1 --2- 172.21.15.2:0/4205357532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffab4101d10 0x7ffab4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.960+0000 7ffab9541640 1 --2- 172.21.15.2:0/4205357532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffab4100b10 0x7ffab4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.960+0000 7ffab9541640 1 -- 172.21.15.2:0/4205357532 >> 172.21.15.2:0/4205357532 conn(0x7ffab40fc2a0 msgr2=0x7ffab40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.960+0000 7ffab9541640 1 -- 172.21.15.2:0/4205357532 shutdown_connections 2024-09-15T23:14:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.960+0000 7ffab9541640 1 -- 172.21.15.2:0/4205357532 wait complete. 2024-09-15T23:14:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab9541640 1 Processor -- start 2024-09-15T23:14:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab9541640 1 -- start start 2024-09-15T23:14:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab9541640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab4100b10 0x7ffab4197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab9541640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffab4101d10 0x7ffab4198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab9541640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffab41026d0 0x7ffab419f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab9541640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffab410d730 con 0x7ffab4100b10 2024-09-15T23:14:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab9541640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffab410d5b0 con 0x7ffab41026d0 2024-09-15T23:14:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab9541640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ffab410d8b0 con 0x7ffab4101d10 2024-09-15T23:14:02.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab4100b10 0x7ffab4197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab4100b10 0x7ffab4197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54892/0 (socket says 172.21.15.2:54892) 2024-09-15T23:14:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab2ffd640 1 -- 172.21.15.2:0/3437071658 learned_addr learned my addr 172.21.15.2:0/3437071658 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab37fe640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffab41026d0 0x7ffab419f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab27fc640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffab4101d10 0x7ffab4198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab2ffd640 1 -- 172.21.15.2:0/3437071658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffab4101d10 msgr2=0x7ffab4198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab2ffd640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffab4101d10 0x7ffab4198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab2ffd640 1 -- 172.21.15.2:0/3437071658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffab41026d0 msgr2=0x7ffab419f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab2ffd640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffab41026d0 0x7ffab419f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab2ffd640 1 -- 172.21.15.2:0/3437071658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab419fa00 con 0x7ffab4100b10 2024-09-15T23:14:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.961+0000 7ffab37fe640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffab41026d0 0x7ffab419f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.962+0000 7ffab2ffd640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab4100b10 0x7ffab4197dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400d770 tx=0x7ffaa400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.962+0000 7ffa9bfff640 1 -- 172.21.15.2:0/3437071658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4017070 con 0x7ffab4100b10 2024-09-15T23:14:02.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.962+0000 7ffa9bfff640 1 -- 172.21.15.2:0/3437071658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffaa4009c30 con 0x7ffab4100b10 2024-09-15T23:14:02.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.962+0000 7ffab9541640 1 -- 172.21.15.2:0/3437071658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab419fcf0 con 0x7ffab4100b10 2024-09-15T23:14:02.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.962+0000 7ffa9bfff640 1 -- 172.21.15.2:0/3437071658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4003d00 con 0x7ffab4100b10 2024-09-15T23:14:02.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.962+0000 7ffab9541640 1 -- 172.21.15.2:0/3437071658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab41a0180 con 0x7ffab4100b10 2024-09-15T23:14:02.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.963+0000 7ffab9541640 1 -- 172.21.15.2:0/3437071658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab4107f10 con 0x7ffab4100b10 2024-09-15T23:14:02.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.964+0000 7ffa9bfff640 1 -- 172.21.15.2:0/3437071658 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ffaa4003ea0 con 0x7ffab4100b10 2024-09-15T23:14:02.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.965+0000 7ffa9bfff640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ffa9c0a3300 0x7ffa9c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:02.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.965+0000 7ffab27fc640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ffa9c0a3300 0x7ffa9c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:02.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.965+0000 7ffa9bfff640 1 -- 172.21.15.2:0/3437071658 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7ffaa40cf4d0 con 0x7ffab4100b10 2024-09-15T23:14:02.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.966+0000 7ffab27fc640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ffa9c0a3300 0x7ffa9c0a57c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8005fd0 tx=0x7ffaa8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:02.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:02.969+0000 7ffa9bfff640 1 -- 172.21.15.2:0/3437071658 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffaa409c070 con 0x7ffab4100b10 2024-09-15T23:14:03.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.154+0000 7ffab9541640 1 -- 172.21.15.2:0/3437071658 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7ffab4062630 con 0x7ffa9c0a3300 2024-09-15T23:14:03.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.161+0000 7ffa9bfff640 1 -- 172.21.15.2:0/3437071658 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7ffab4062630 con 0x7ffa9c0a3300 2024-09-15T23:14:03.161 INFO:teuthology.orchestra.run.smithi002.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-15T23:14:03.161 INFO:teuthology.orchestra.run.smithi002.stdout:mds.all 12/12 23s ago 2m smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi145=c;smithi145=f;smithi145=i;smithi145=l;count:12 2024-09-15T23:14:03.161 INFO:teuthology.orchestra.run.smithi002.stdout:mgr 3/3 23s ago 7m smithi002=x;smithi112=y;smithi145=z;count:3 2024-09-15T23:14:03.161 INFO:teuthology.orchestra.run.smithi002.stdout:mon 3/3 23s ago 7m smithi002:172.21.15.2=a;smithi112:172.21.15.112=b;smithi145:172.21.15.145=c;count:3 2024-09-15T23:14:03.161 INFO:teuthology.orchestra.run.smithi002.stdout:osd 12 23s ago - 2024-09-15T23:14:03.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.163+0000 7ffab9541640 1 -- 172.21.15.2:0/3437071658 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ffa9c0a3300 msgr2=0x7ffa9c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:03.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.163+0000 7ffab9541640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ffa9c0a3300 0x7ffa9c0a57c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8005fd0 tx=0x7ffaa8005850 comp rx=0 tx=0).stop 2024-09-15T23:14:03.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.163+0000 7ffab9541640 1 -- 172.21.15.2:0/3437071658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab4100b10 msgr2=0x7ffab4197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:03.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.163+0000 7ffab9541640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab4100b10 0x7ffab4197dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400d770 tx=0x7ffaa400dc30 comp rx=0 tx=0).stop 2024-09-15T23:14:03.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.163+0000 7ffab9541640 1 -- 172.21.15.2:0/3437071658 shutdown_connections 2024-09-15T23:14:03.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.163+0000 7ffab9541640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ffa9c0a3300 0x7ffa9c0a57c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:03.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.163+0000 7ffab9541640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffab41026d0 0x7ffab419f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:03.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.163+0000 7ffab9541640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffab4101d10 0x7ffab4198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:03.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.163+0000 7ffab9541640 1 --2- 172.21.15.2:0/3437071658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab4100b10 0x7ffab4197dd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:03.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.163+0000 7ffab9541640 1 -- 172.21.15.2:0/3437071658 >> 172.21.15.2:0/3437071658 conn(0x7ffab40fc2a0 msgr2=0x7ffab41050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:03.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.163+0000 7ffab9541640 1 -- 172.21.15.2:0/3437071658 shutdown_connections 2024-09-15T23:14:03.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:03.163+0000 7ffab9541640 1 -- 172.21.15.2:0/3437071658 wait complete. 2024-09-15T23:14:03.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:03 smithi002 ceph-mon[31019]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:03.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:03 smithi145 ceph-mon[34901]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:03.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:03 smithi112 ceph-mon[34367]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:03.855 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-15T23:14:04.111 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:14:04.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:04 smithi002 ceph-mon[31019]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.604+0000 7f8acf349640 1 -- 172.21.15.2:0/2104617430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8101c00 msgr2=0x7f8ac8102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.604+0000 7f8acf349640 1 --2- 172.21.15.2:0/2104617430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8101c00 0x7f8ac8102000 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009900 tx=0x7f8ac402a410 comp rx=0 tx=0).stop 2024-09-15T23:14:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.604+0000 7f8acf349640 1 -- 172.21.15.2:0/2104617430 shutdown_connections 2024-09-15T23:14:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.604+0000 7f8acf349640 1 --2- 172.21.15.2:0/2104617430 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ac81037c0 0x7f8ac810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.604+0000 7f8acf349640 1 --2- 172.21.15.2:0/2104617430 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac8102e00 0x7f8ac8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.604+0000 7f8acf349640 1 --2- 172.21.15.2:0/2104617430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8101c00 0x7f8ac8102000 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.604+0000 7f8acf349640 1 -- 172.21.15.2:0/2104617430 >> 172.21.15.2:0/2104617430 conn(0x7f8ac80fd390 msgr2=0x7f8ac80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.604+0000 7f8acf349640 1 -- 172.21.15.2:0/2104617430 shutdown_connections 2024-09-15T23:14:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.604+0000 7f8acf349640 1 -- 172.21.15.2:0/2104617430 wait complete. 2024-09-15T23:14:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.604+0000 7f8acf349640 1 Processor -- start 2024-09-15T23:14:04.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acf349640 1 -- start start 2024-09-15T23:14:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acf349640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ac8101c00 0x7f8ac8197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acf349640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac8102e00 0x7f8ac81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acf349640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac81037c0 0x7f8ac819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acf349640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac810d790 con 0x7f8ac81037c0 2024-09-15T23:14:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acf349640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac810d610 con 0x7f8ac8102e00 2024-09-15T23:14:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acf349640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac810d910 con 0x7f8ac8101c00 2024-09-15T23:14:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acd8e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac81037c0 0x7f8ac819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acd8e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac81037c0 0x7f8ac819f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54914/0 (socket says 172.21.15.2:54914) 2024-09-15T23:14:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acd8e6640 1 -- 172.21.15.2:0/1986561887 learned_addr learned my addr 172.21.15.2:0/1986561887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acd0e5640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ac8101c00 0x7f8ac8197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acc8e4640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac8102e00 0x7f8ac81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acd8e6640 1 -- 172.21.15.2:0/1986561887 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ac8101c00 msgr2=0x7f8ac8197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acd8e6640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ac8101c00 0x7f8ac8197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acd8e6640 1 -- 172.21.15.2:0/1986561887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac8102e00 msgr2=0x7f8ac81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acd8e6640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac8102e00 0x7f8ac81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acd8e6640 1 -- 172.21.15.2:0/1986561887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac819fae0 con 0x7f8ac81037c0 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acc8e4640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac8102e00 0x7f8ac81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.605+0000 7f8acd0e5640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ac8101c00 0x7f8ac8197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.606+0000 7f8acd8e6640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac81037c0 0x7f8ac819f470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000b970 tx=0x7f8ac000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.606+0000 7f8abe7fc640 1 -- 172.21.15.2:0/1986561887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0019070 con 0x7f8ac81037c0 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.606+0000 7f8abe7fc640 1 -- 172.21.15.2:0/1986561887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ac0014440 con 0x7f8ac81037c0 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.606+0000 7f8abe7fc640 1 -- 172.21.15.2:0/1986561887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00075d0 con 0x7f8ac81037c0 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.606+0000 7f8acf349640 1 -- 172.21.15.2:0/1986561887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac819fdd0 con 0x7f8ac81037c0 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.606+0000 7f8acf349640 1 -- 172.21.15.2:0/1986561887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac81a0300 con 0x7f8ac81037c0 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.607+0000 7f8acf349640 1 -- 172.21.15.2:0/1986561887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac8109050 con 0x7f8ac81037c0 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.608+0000 7f8abe7fc640 1 -- 172.21.15.2:0/1986561887 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8ac001c070 con 0x7f8ac81037c0 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.609+0000 7f8abe7fc640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ab40a3380 0x7f8ab40a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.609+0000 7f8acd0e5640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ab40a3380 0x7f8ab40a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:04.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.609+0000 7f8abe7fc640 1 -- 172.21.15.2:0/1986561887 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f8ac00cef50 con 0x7f8ac81037c0 2024-09-15T23:14:04.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.609+0000 7f8acd0e5640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ab40a3380 0x7f8ab40a5840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4000c00 tx=0x7f8ac4032d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:04.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.613+0000 7f8abe7fc640 1 -- 172.21.15.2:0/1986561887 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ac009bc00 con 0x7f8ac81037c0 2024-09-15T23:14:04.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:04 smithi145 ceph-mon[34901]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:04.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:04 smithi112 ceph-mon[34367]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:04.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.795+0000 7f8acf349640 1 -- 172.21.15.2:0/1986561887 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f8ac8062630 con 0x7f8ab40a3380 2024-09-15T23:14:04.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.796+0000 7f8abe7fc640 1 -- 172.21.15.2:0/1986561887 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f8ac8062630 con 0x7f8ab40a3380 2024-09-15T23:14:04.798 INFO:teuthology.orchestra.run.smithi002.stdout:HOST ADDR LABELS STATUS 2024-09-15T23:14:04.798 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 172.21.15.2 2024-09-15T23:14:04.798 INFO:teuthology.orchestra.run.smithi002.stdout:smithi112 172.21.15.112 2024-09-15T23:14:04.798 INFO:teuthology.orchestra.run.smithi002.stdout:smithi145 172.21.15.145 2024-09-15T23:14:04.798 INFO:teuthology.orchestra.run.smithi002.stdout:3 hosts in cluster 2024-09-15T23:14:04.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.798+0000 7f8acf349640 1 -- 172.21.15.2:0/1986561887 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ab40a3380 msgr2=0x7f8ab40a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:04.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.798+0000 7f8acf349640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ab40a3380 0x7f8ab40a5840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4000c00 tx=0x7f8ac4032d20 comp rx=0 tx=0).stop 2024-09-15T23:14:04.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.798+0000 7f8acf349640 1 -- 172.21.15.2:0/1986561887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac81037c0 msgr2=0x7f8ac819f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:04.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.798+0000 7f8acf349640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac81037c0 0x7f8ac819f470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000b970 tx=0x7f8ac000be30 comp rx=0 tx=0).stop 2024-09-15T23:14:04.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.798+0000 7f8acf349640 1 -- 172.21.15.2:0/1986561887 shutdown_connections 2024-09-15T23:14:04.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.798+0000 7f8acf349640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ab40a3380 0x7f8ab40a5840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:04.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.798+0000 7f8acf349640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac81037c0 0x7f8ac819f470 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:04.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.798+0000 7f8acf349640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8ac8102e00 0x7f8ac81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:04.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.798+0000 7f8acf349640 1 --2- 172.21.15.2:0/1986561887 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ac8101c00 0x7f8ac8197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:04.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.798+0000 7f8acf349640 1 -- 172.21.15.2:0/1986561887 >> 172.21.15.2:0/1986561887 conn(0x7f8ac80fd390 msgr2=0x7f8ac8106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:04.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.799+0000 7f8acf349640 1 -- 172.21.15.2:0/1986561887 shutdown_connections 2024-09-15T23:14:04.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:04.799+0000 7f8acf349640 1 -- 172.21.15.2:0/1986561887 wait complete. 2024-09-15T23:14:05.511 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:05 smithi002 ceph-mon[31019]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:14:05.543 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-15T23:14:05.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:05 smithi145 ceph-mon[34901]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:14:05.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:05 smithi112 ceph-mon[34367]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:14:05.805 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:14:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.290+0000 7f00b58a6640 1 -- 172.21.15.2:0/1119688208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b0107900 msgr2=0x7f00b0109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.290+0000 7f00b58a6640 1 --2- 172.21.15.2:0/1119688208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b0107900 0x7f00b0109d50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009ca0 tx=0x7f00a802a8c0 comp rx=0 tx=0).stop 2024-09-15T23:14:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.290+0000 7f00b58a6640 1 -- 172.21.15.2:0/1119688208 shutdown_connections 2024-09-15T23:14:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.290+0000 7f00b58a6640 1 --2- 172.21.15.2:0/1119688208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b0107900 0x7f00b0109d50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.290+0000 7f00b58a6640 1 --2- 172.21.15.2:0/1119688208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b0104fd0 0x7f00b01073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.290+0000 7f00b58a6640 1 --2- 172.21.15.2:0/1119688208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00b01026a0 0x7f00b0104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.290+0000 7f00b58a6640 1 -- 172.21.15.2:0/1119688208 >> 172.21.15.2:0/1119688208 conn(0x7f00b00fc2a0 msgr2=0x7f00b00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.290+0000 7f00b58a6640 1 -- 172.21.15.2:0/1119688208 shutdown_connections 2024-09-15T23:14:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.290+0000 7f00b58a6640 1 -- 172.21.15.2:0/1119688208 wait complete. 2024-09-15T23:14:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.290+0000 7f00b58a6640 1 Processor -- start 2024-09-15T23:14:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.290+0000 7f00b58a6640 1 -- start start 2024-09-15T23:14:06.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00b58a6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b01026a0 0x7f00b0197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00b58a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b0104fd0 0x7f00b01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00b58a6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00b0107900 0x7f00b019f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00b58a6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f00b010d770 con 0x7f00b0104fd0 2024-09-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00b58a6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f00b010d5f0 con 0x7f00b01026a0 2024-09-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00b58a6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f00b010d8f0 con 0x7f00b0107900 2024-09-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00ae7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b0104fd0 0x7f00b01983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00ae7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b0104fd0 0x7f00b01983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54930/0 (socket says 172.21.15.2:54930) 2024-09-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00ae7fc640 1 -- 172.21.15.2:0/1257018538 learned_addr learned my addr 172.21.15.2:0/1257018538 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00af7fe640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00b0107900 0x7f00b019f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00aeffd640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b01026a0 0x7f00b0197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00ae7fc640 1 -- 172.21.15.2:0/1257018538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00b0107900 msgr2=0x7f00b019f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00ae7fc640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00b0107900 0x7f00b019f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:06.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00ae7fc640 1 -- 172.21.15.2:0/1257018538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b01026a0 msgr2=0x7f00b0197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00ae7fc640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b01026a0 0x7f00b0197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00ae7fc640 1 -- 172.21.15.2:0/1257018538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b019fab0 con 0x7f00b0104fd0 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00ae7fc640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b0104fd0 0x7f00b01983c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f00a0005fd0 tx=0x7f00a000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00b48a4640 1 -- 172.21.15.2:0/1257018538 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a0017070 con 0x7f00b0104fd0 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00b48a4640 1 -- 172.21.15.2:0/1257018538 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f00a0009c30 con 0x7f00b0104fd0 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00b48a4640 1 -- 172.21.15.2:0/1257018538 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a0003d40 con 0x7f00b0104fd0 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00b58a6640 1 -- 172.21.15.2:0/1257018538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b019fda0 con 0x7f00b0104fd0 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.291+0000 7f00b58a6640 1 -- 172.21.15.2:0/1257018538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b01a0250 con 0x7f00b0104fd0 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.292+0000 7f00b58a6640 1 -- 172.21.15.2:0/1257018538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b00fdd90 con 0x7f00b0104fd0 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.294+0000 7f00b48a4640 1 -- 172.21.15.2:0/1257018538 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f00a0003ee0 con 0x7f00b0104fd0 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.294+0000 7f00b48a4640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f009c0a3300 0x7f009c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.295+0000 7f00aeffd640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f009c0a3300 0x7f009c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.295+0000 7f00b48a4640 1 -- 172.21.15.2:0/1257018538 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f00a00cf6f0 con 0x7f00b0104fd0 2024-09-15T23:14:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.295+0000 7f00aeffd640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f009c0a3300 0x7f009c0a57c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0098005fd0 tx=0x7f0098005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:06.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.299+0000 7f00b48a4640 1 -- 172.21.15.2:0/1257018538 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00a0020030 con 0x7f00b0104fd0 2024-09-15T23:14:06.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.483+0000 7f00b58a6640 1 -- 172.21.15.2:0/1257018538 --> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f00b0062630 con 0x7f009c0a3300 2024-09-15T23:14:06.484 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:06 smithi002 ceph-mon[31019]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:06.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.484+0000 7f00b48a4640 1 -- 172.21.15.2:0/1257018538 <== mgr.14150 v2:172.21.15.2:6800/2564114882 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f00b0062630 con 0x7f009c0a3300 2024-09-15T23:14:06.486 INFO:teuthology.orchestra.run.smithi002.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-15T23:14:06.486 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EV480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-15T23:14:06.486 INFO:teuthology.orchestra.run.smithi002.stdout:smithi112 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NV400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-15T23:14:06.486 INFO:teuthology.orchestra.run.smithi002.stdout:smithi145 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500N9400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-15T23:14:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.487+0000 7f00b58a6640 1 -- 172.21.15.2:0/1257018538 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f009c0a3300 msgr2=0x7f009c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.487+0000 7f00b58a6640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f009c0a3300 0x7f009c0a57c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0098005fd0 tx=0x7f0098005850 comp rx=0 tx=0).stop 2024-09-15T23:14:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.487+0000 7f00b58a6640 1 -- 172.21.15.2:0/1257018538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b0104fd0 msgr2=0x7f00b01983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.487+0000 7f00b58a6640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b0104fd0 0x7f00b01983c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f00a0005fd0 tx=0x7f00a000dde0 comp rx=0 tx=0).stop 2024-09-15T23:14:06.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.487+0000 7f00b58a6640 1 -- 172.21.15.2:0/1257018538 shutdown_connections 2024-09-15T23:14:06.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.487+0000 7f00b58a6640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f009c0a3300 0x7f009c0a57c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:06.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.487+0000 7f00b58a6640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00b0107900 0x7f00b019f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:06.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.487+0000 7f00b58a6640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00b0104fd0 0x7f00b01983c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:06.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.487+0000 7f00b58a6640 1 --2- 172.21.15.2:0/1257018538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f00b01026a0 0x7f00b0197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:06.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.487+0000 7f00b58a6640 1 -- 172.21.15.2:0/1257018538 >> 172.21.15.2:0/1257018538 conn(0x7f00b00fc2a0 msgr2=0x7f00b0103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:06.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.487+0000 7f00b58a6640 1 -- 172.21.15.2:0/1257018538 shutdown_connections 2024-09-15T23:14:06.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:06.487+0000 7f00b58a6640 1 -- 172.21.15.2:0/1257018538 wait complete. 2024-09-15T23:14:06.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:06 smithi145 ceph-mon[34901]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:06.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:06 smithi112 ceph-mon[34367]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:07.213 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T23:14:07.223 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-15T23:14:07.223 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-15T23:14:07.486 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:14:07.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:07 smithi002 ceph-mon[31019]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:07.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:07 smithi145 ceph-mon[34901]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:07.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:07 smithi112 ceph-mon[34367]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:07.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.971+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3362935485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f9c076220 msgr2=0x7f5f9c074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:07.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.971+0000 7f5fa36d4640 1 --2- 172.21.15.2:0/3362935485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f9c076220 0x7f5f9c074680 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009900 tx=0x7f5f9802a410 comp rx=0 tx=0).stop 2024-09-15T23:14:07.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.971+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3362935485 shutdown_connections 2024-09-15T23:14:07.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.971+0000 7f5fa36d4640 1 --2- 172.21.15.2:0/3362935485 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c10e1e0 0x7f5f9c1105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:07.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.971+0000 7f5fa36d4640 1 --2- 172.21.15.2:0/3362935485 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c074c50 0x7f5f9c0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:07.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.971+0000 7f5fa36d4640 1 --2- 172.21.15.2:0/3362935485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f9c076220 0x7f5f9c074680 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:07.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.971+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3362935485 >> 172.21.15.2:0/3362935485 conn(0x7f5f9c0fd390 msgr2=0x7f5f9c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:07.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.971+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3362935485 shutdown_connections 2024-09-15T23:14:07.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.972+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3362935485 wait complete. 2024-09-15T23:14:07.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.972+0000 7f5fa36d4640 1 Processor -- start 2024-09-15T23:14:07.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.972+0000 7f5fa36d4640 1 -- start start 2024-09-15T23:14:07.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.972+0000 7f5fa36d4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c074c50 0x7f5f9c19e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:07.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.972+0000 7f5fa36d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f9c076220 0x7f5f9c19e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:07.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.972+0000 7f5fa36d4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c10e1e0 0x7f5f9c1a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.972+0000 7f5fa36d4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c113d20 con 0x7f5f9c076220 2024-09-15T23:14:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.972+0000 7f5fa36d4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c113ba0 con 0x7f5f9c10e1e0 2024-09-15T23:14:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.972+0000 7f5fa36d4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c113ea0 con 0x7f5f9c074c50 2024-09-15T23:14:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.972+0000 7f5fa0c6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f9c076220 0x7f5f9c19e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.972+0000 7f5fa0c6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f9c076220 0x7f5f9c19e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54814/0 (socket says 172.21.15.2:54814) 2024-09-15T23:14:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.972+0000 7f5fa0c6f640 1 -- 172.21.15.2:0/3478263706 learned_addr learned my addr 172.21.15.2:0/3478263706 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.973+0000 7f5fa1c71640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c10e1e0 0x7f5f9c1a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.973+0000 7f5fa1470640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c074c50 0x7f5f9c19e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.973+0000 7f5fa0c6f640 1 -- 172.21.15.2:0/3478263706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c074c50 msgr2=0x7f5f9c19e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.973+0000 7f5fa0c6f640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c074c50 0x7f5f9c19e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.973+0000 7f5fa0c6f640 1 -- 172.21.15.2:0/3478263706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c10e1e0 msgr2=0x7f5f9c1a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.973+0000 7f5fa0c6f640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c10e1e0 0x7f5f9c1a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.973+0000 7f5fa0c6f640 1 -- 172.21.15.2:0/3478263706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c1a6060 con 0x7f5f9c076220 2024-09-15T23:14:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.973+0000 7f5fa0c6f640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f9c076220 0x7f5f9c19e970 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00c890 tx=0x7f5f8c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.973+0000 7f5f927fc640 1 -- 172.21.15.2:0/3478263706 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c004220 con 0x7f5f9c076220 2024-09-15T23:14:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.973+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3478263706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9c1a6350 con 0x7f5f9c076220 2024-09-15T23:14:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.973+0000 7f5f927fc640 1 -- 172.21.15.2:0/3478263706 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f8c0043c0 con 0x7f5f9c076220 2024-09-15T23:14:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.973+0000 7f5f927fc640 1 -- 172.21.15.2:0/3478263706 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c004a00 con 0x7f5f9c076220 2024-09-15T23:14:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.973+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3478263706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f9c1a68e0 con 0x7f5f9c076220 2024-09-15T23:14:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.974+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3478263706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9c103b80 con 0x7f5f9c076220 2024-09-15T23:14:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.975+0000 7f5f927fc640 1 -- 172.21.15.2:0/3478263706 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5f8c004ba0 con 0x7f5f9c076220 2024-09-15T23:14:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.976+0000 7f5f927fc640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f5f880a3380 0x7f5f880a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.976+0000 7f5fa1470640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f5f880a3380 0x7f5f880a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.976+0000 7f5f927fc640 1 -- 172.21.15.2:0/3478263706 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f5f8c0cf610 con 0x7f5f9c076220 2024-09-15T23:14:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.976+0000 7f5fa1470640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f5f880a3380 0x7f5f880a5840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f98004770 tx=0x7f5f98000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:07.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:07.980+0000 7f5f927fc640 1 -- 172.21.15.2:0/3478263706 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f8c014030 con 0x7f5f9c076220 2024-09-15T23:14:08.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.195+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3478263706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5f9c02d7c0 con 0x7f5f9c076220 2024-09-15T23:14:08.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.195+0000 7f5f927fc640 1 -- 172.21.15.2:0/3478263706 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+3042 (secure 0 0 0) 0x7f5f8c09bb60 con 0x7f5f9c076220 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout:e20 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-15T23:12:51:758295+0000 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 20 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-15T23:12:42.434565+0000 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-15T23:12:51.456432+0000 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-15T23:14:08.197 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 300 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 0 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24464} 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-15T23:14:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-15T23:14:08.199 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-15T23:14:08.199 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data disabled 2024-09-15T23:14:08.199 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-15T23:14:08.199 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-15T23:14:08.199 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 0 2024-09-15T23:14:08.199 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 24464 members: 24464 2024-09-15T23:14:08.199 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b{0:24464} state up:active seq 4 addr [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:14:08.199 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.i{0:24442} state up:standby-replay seq 1 addr [v2:172.21.15.145:6838/3930825714,v1:172.21.15.145:6839/3930825714] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:14:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:14:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:14:08.199 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-15T23:14:08.199 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:14:08.200 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.j{-1:14523} state up:standby seq 1 addr [v2:172.21.15.2:6834/3895460397,v1:172.21.15.2:6835/3895460397] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:14:08.200 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d{-1:14535} state up:standby seq 1 addr [v2:172.21.15.2:6836/2892386790,v1:172.21.15.2:6837/2892386790] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:14:08.200 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.g{-1:14589} state up:standby seq 1 addr [v2:172.21.15.2:6838/1051460220,v1:172.21.15.2:6839/1051460220] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:14:08.200 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a{-1:14595} state up:standby seq 1 addr [v2:172.21.15.2:6840/1583533983,v1:172.21.15.2:6841/1583533983] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:14:08.200 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.l{-1:24388} state up:standby seq 1 addr [v2:172.21.15.145:6832/3192333396,v1:172.21.15.145:6833/3192333396] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:14:08.200 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.k{-1:24395} state up:standby seq 1 addr [v2:172.21.15.112:6832/4192340343,v1:172.21.15.112:6833/4192340343] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:14:08.200 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.e{-1:24410} state up:standby seq 1 addr [v2:172.21.15.112:6834/2358660924,v1:172.21.15.112:6835/2358660924] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:14:08.200 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.f{-1:24418} state up:standby seq 1 addr [v2:172.21.15.145:6834/91315913,v1:172.21.15.145:6835/91315913] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:14:08.200 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c{-1:24424} state up:standby seq 1 addr [v2:172.21.15.145:6836/1066293931,v1:172.21.15.145:6837/1066293931] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:14:08.200 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.h{-1:24431} state up:standby seq 1 addr [v2:172.21.15.112:6836/418078184,v1:172.21.15.112:6837/418078184] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:14:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-09-15T23:14:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.198+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3478263706 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f5f880a3380 msgr2=0x7f5f880a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.198+0000 7f5fa36d4640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f5f880a3380 0x7f5f880a5840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f98004770 tx=0x7f5f98000bc0 comp rx=0 tx=0).stop 2024-09-15T23:14:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.198+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3478263706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f9c076220 msgr2=0x7f5f9c19e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.198+0000 7f5fa36d4640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f9c076220 0x7f5f9c19e970 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00c890 tx=0x7f5f8c00cd50 comp rx=0 tx=0).stop 2024-09-15T23:14:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.198+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3478263706 shutdown_connections 2024-09-15T23:14:08.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.198+0000 7f5fa36d4640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f5f880a3380 0x7f5f880a5840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.198+0000 7f5fa36d4640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f9c10e1e0 0x7f5f9c1a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.198+0000 7f5fa36d4640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f9c076220 0x7f5f9c19e970 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.198+0000 7f5fa36d4640 1 --2- 172.21.15.2:0/3478263706 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f9c074c50 0x7f5f9c19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.198+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3478263706 >> 172.21.15.2:0/3478263706 conn(0x7f5f9c0fd390 msgr2=0x7f5f9c0ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.198+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3478263706 shutdown_connections 2024-09-15T23:14:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:08.199+0000 7f5fa36d4640 1 -- 172.21.15.2:0/3478263706 wait complete. 2024-09-15T23:14:08.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:08 smithi002 ceph-mon[31019]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:08.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:08 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3478263706' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T23:14:08.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:08 smithi145 ceph-mon[34901]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:08.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:08 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3478263706' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T23:14:08.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:08 smithi112 ceph-mon[34367]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:08.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:08 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3478263706' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T23:14:08.942 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-15T23:14:09.197 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:14:09.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:09 smithi002 ceph-mon[31019]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:09.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:09 smithi145 ceph-mon[34901]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:09.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.691+0000 7fbc4bb42640 1 -- 172.21.15.2:0/2076137881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441026a0 msgr2=0x7fbc44104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:09.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.691+0000 7fbc4bb42640 1 --2- 172.21.15.2:0/2076137881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441026a0 0x7fbc44104a90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009900 tx=0x7fbc4002a410 comp rx=0 tx=0).stop 2024-09-15T23:14:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.691+0000 7fbc4bb42640 1 -- 172.21.15.2:0/2076137881 shutdown_connections 2024-09-15T23:14:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.691+0000 7fbc4bb42640 1 --2- 172.21.15.2:0/2076137881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc44107900 0x7fbc44109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.691+0000 7fbc4bb42640 1 --2- 172.21.15.2:0/2076137881 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc44104fd0 0x7fbc441073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.691+0000 7fbc4bb42640 1 --2- 172.21.15.2:0/2076137881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441026a0 0x7fbc44104a90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.691+0000 7fbc4bb42640 1 -- 172.21.15.2:0/2076137881 >> 172.21.15.2:0/2076137881 conn(0x7fbc440fc2a0 msgr2=0x7fbc440fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.691+0000 7fbc4bb42640 1 -- 172.21.15.2:0/2076137881 shutdown_connections 2024-09-15T23:14:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.691+0000 7fbc4bb42640 1 -- 172.21.15.2:0/2076137881 wait complete. 2024-09-15T23:14:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc4bb42640 1 Processor -- start 2024-09-15T23:14:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc4bb42640 1 -- start start 2024-09-15T23:14:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc4bb42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441026a0 0x7fbc44197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc4bb42640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc44104fd0 0x7fbc441983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc4bb42640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc44107900 0x7fbc4419f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:09.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc4bb42640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4410d7f0 con 0x7fbc441026a0 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc4bb42640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4410d670 con 0x7fbc44107900 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc4bb42640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4410d970 con 0x7fbc44104fd0 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc498de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441026a0 0x7fbc44197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc498de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441026a0 0x7fbc44197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54830/0 (socket says 172.21.15.2:54830) 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc498de640 1 -- 172.21.15.2:0/3685708890 learned_addr learned my addr 172.21.15.2:0/3685708890 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc4a0df640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc44107900 0x7fbc4419f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc490dd640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc44104fd0 0x7fbc441983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc498de640 1 -- 172.21.15.2:0/3685708890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc44104fd0 msgr2=0x7fbc441983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc498de640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc44104fd0 0x7fbc441983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc498de640 1 -- 172.21.15.2:0/3685708890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc44107900 msgr2=0x7fbc4419f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc498de640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc44107900 0x7fbc4419f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc498de640 1 -- 172.21.15.2:0/3685708890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4419fae0 con 0x7fbc441026a0 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.692+0000 7fbc4a0df640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc44107900 0x7fbc4419f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:09.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.693+0000 7fbc498de640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441026a0 0x7fbc44197eb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbc40004770 tx=0x7fbc400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:09.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.693+0000 7fbc3affd640 1 -- 172.21.15.2:0/3685708890 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4003f030 con 0x7fbc441026a0 2024-09-15T23:14:09.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.693+0000 7fbc3affd640 1 -- 172.21.15.2:0/3685708890 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc40003cb0 con 0x7fbc441026a0 2024-09-15T23:14:09.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.693+0000 7fbc4bb42640 1 -- 172.21.15.2:0/3685708890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4419fd70 con 0x7fbc441026a0 2024-09-15T23:14:09.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.693+0000 7fbc3affd640 1 -- 172.21.15.2:0/3685708890 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40035070 con 0x7fbc441026a0 2024-09-15T23:14:09.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.693+0000 7fbc4bb42640 1 -- 172.21.15.2:0/3685708890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc441a0260 con 0x7fbc441026a0 2024-09-15T23:14:09.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.694+0000 7fbc4bb42640 1 -- 172.21.15.2:0/3685708890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc440fdd90 con 0x7fbc441026a0 2024-09-15T23:14:09.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.695+0000 7fbc3affd640 1 -- 172.21.15.2:0/3685708890 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fbc40042030 con 0x7fbc441026a0 2024-09-15T23:14:09.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.696+0000 7fbc3affd640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbc300a3380 0x7fbc300a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:09.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.696+0000 7fbc490dd640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbc300a3380 0x7fbc300a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:09.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.696+0000 7fbc3affd640 1 -- 172.21.15.2:0/3685708890 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fbc400f0710 con 0x7fbc441026a0 2024-09-15T23:14:09.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.696+0000 7fbc490dd640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbc300a3380 0x7fbc300a5840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbc441993d0 tx=0x7fbc34008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:09.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.699+0000 7fbc3affd640 1 -- 172.21.15.2:0/3685708890 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc400bd2b0 con 0x7fbc441026a0 2024-09-15T23:14:09.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:09 smithi112 ceph-mon[34367]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:09.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.880+0000 7fbc4bb42640 1 -- 172.21.15.2:0/3685708890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fbc4402d8e0 con 0x7fbc441026a0 2024-09-15T23:14:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.881+0000 7fbc3affd640 1 -- 172.21.15.2:0/3685708890 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v83) ==== 56+0+5296 (secure 0 0 0) 0x7fbc400bcbb0 con 0x7fbc441026a0 2024-09-15T23:14:09.882 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 83 2024-09-15T23:14:09.882 INFO:teuthology.orchestra.run.smithi002.stdout:fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:14:09.882 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-15T23:04:45.101432+0000 2024-09-15T23:14:09.882 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-15T23:13:42.726811+0000 2024-09-15T23:14:09.882 INFO:teuthology.orchestra.run.smithi002.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-15T23:14:09.882 INFO:teuthology.orchestra.run.smithi002.stdout:crush_version 26 2024-09-15T23:14:09.882 INFO:teuthology.orchestra.run.smithi002.stdout:full_ratio 0.95 2024-09-15T23:14:09.883 INFO:teuthology.orchestra.run.smithi002.stdout:backfillfull_ratio 0.9 2024-09-15T23:14:09.883 INFO:teuthology.orchestra.run.smithi002.stdout:nearfull_ratio 0.85 2024-09-15T23:14:09.883 INFO:teuthology.orchestra.run.smithi002.stdout:require_min_compat_client luminous 2024-09-15T23:14:09.883 INFO:teuthology.orchestra.run.smithi002.stdout:min_compat_client luminous 2024-09-15T23:14:09.883 INFO:teuthology.orchestra.run.smithi002.stdout:require_osd_release squid 2024-09-15T23:14:09.883 INFO:teuthology.orchestra.run.smithi002.stdout:stretch_mode_enabled false 2024-09-15T23:14:09.883 INFO:teuthology.orchestra.run.smithi002.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-15T23:14:09.883 INFO:teuthology.orchestra.run.smithi002.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-15T23:14:09.883 INFO:teuthology.orchestra.run.smithi002.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-15T23:14:09.883 INFO:teuthology.orchestra.run.smithi002.stdout:max_osd 12 2024-09-15T23:14:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6802/280991401,v1:172.21.15.2:6803/280991401] [v2:172.21.15.2:6804/280991401,v1:172.21.15.2:6805/280991401] exists,up 40ff4fd9-3904-4178-a9cb-51f4647be540 2024-09-15T23:14:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 up in weight 1 up_from 13 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6800/2649210970,v1:172.21.15.112:6801/2649210970] [v2:172.21.15.112:6802/2649210970,v1:172.21.15.112:6803/2649210970] exists,up af5e265d-fe45-4d9c-a34c-6f0b103d75d2 2024-09-15T23:14:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 up in weight 1 up_from 17 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6800/3485615437,v1:172.21.15.145:6801/3485615437] [v2:172.21.15.145:6802/3485615437,v1:172.21.15.145:6803/3485615437] exists,up 8df9e644-fc51-4626-a1a7-6ac4448a5b20 2024-09-15T23:14:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 up in weight 1 up_from 24 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6810/113061968,v1:172.21.15.2:6811/113061968] [v2:172.21.15.2:6812/113061968,v1:172.21.15.2:6813/113061968] exists,up dbab372a-8fdd-4b0c-bee3-16cd75b35ee3 2024-09-15T23:14:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 up in weight 1 up_from 31 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6808/2519162767,v1:172.21.15.112:6809/2519162767] [v2:172.21.15.112:6810/2519162767,v1:172.21.15.112:6811/2519162767] exists,up 73bab8af-3973-4beb-a034-d00bcf0c572f 2024-09-15T23:14:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 up in weight 1 up_from 36 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6808/712427242,v1:172.21.15.145:6809/712427242] [v2:172.21.15.145:6810/712427242,v1:172.21.15.145:6811/712427242] exists,up 2d163e61-5891-46c1-b1c2-39d50a3b6f98 2024-09-15T23:14:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 up in weight 1 up_from 43 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6818/2930673197,v1:172.21.15.2:6819/2930673197] [v2:172.21.15.2:6820/2930673197,v1:172.21.15.2:6821/2930673197] exists,up bca02c96-10de-4953-96e9-42fc9ddf7c1f 2024-09-15T23:14:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 up in weight 1 up_from 48 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6816/830628191,v1:172.21.15.112:6817/830628191] [v2:172.21.15.112:6818/830628191,v1:172.21.15.112:6819/830628191] exists,up 4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d 2024-09-15T23:14:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 up in weight 1 up_from 55 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6816/3634470540,v1:172.21.15.145:6817/3634470540] [v2:172.21.15.145:6818/3634470540,v1:172.21.15.145:6819/3634470540] exists,up 2733f9dd-3872-4bec-9c22-bcdb64828ae7 2024-09-15T23:14:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 up in weight 1 up_from 63 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6826/1417377702,v1:172.21.15.2:6827/1417377702] [v2:172.21.15.2:6828/1417377702,v1:172.21.15.2:6829/1417377702] exists,up bd1f4a4a-547c-43a9-859a-75b37b06905f 2024-09-15T23:14:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 up in weight 1 up_from 68 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6824/105615908,v1:172.21.15.112:6825/105615908] [v2:172.21.15.112:6826/105615908,v1:172.21.15.112:6827/105615908] exists,up f8b895e8-39f5-4753-9343-03f96da12246 2024-09-15T23:14:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 up in weight 1 up_from 75 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6824/430484289,v1:172.21.15.145:6825/430484289] [v2:172.21.15.145:6826/430484289,v1:172.21.15.145:6827/430484289] exists,up dc018bfc-bc13-4ef2-a712-5cd406a56cba 2024-09-15T23:14:09.884 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.0 [8,4] 2024-09-15T23:14:09.885 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.c [2,4] 2024-09-15T23:14:09.885 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.10 [2,1] 2024-09-15T23:14:09.885 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.1c [8,11] 2024-09-15T23:14:09.885 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.1f [7,11] 2024-09-15T23:14:09.885 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.11 [4,6] 2024-09-15T23:14:09.885 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.23 [4,7] 2024-09-15T23:14:09.885 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.27 [4,8] 2024-09-15T23:14:09.885 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.29 [3,9] 2024-09-15T23:14:09.885 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.33 [5,9] 2024-09-15T23:14:09.885 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2956732837 expires 2024-09-16T23:05:41.416672+0000 2024-09-15T23:14:09.886 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/938645794 expires 2024-09-16T23:05:41.416672+0000 2024-09-15T23:14:09.886 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/938645794 expires 2024-09-16T23:05:41.416672+0000 2024-09-15T23:14:09.886 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/896502743 expires 2024-09-16T23:05:17.756048+0000 2024-09-15T23:14:09.886 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3802152324 expires 2024-09-16T23:05:41.416672+0000 2024-09-15T23:14:09.886 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/1891095221 expires 2024-09-16T23:05:17.756048+0000 2024-09-15T23:14:09.886 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/2652608868 expires 2024-09-16T23:05:17.756048+0000 2024-09-15T23:14:09.886 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/236781836 expires 2024-09-16T23:05:41.416672+0000 2024-09-15T23:14:09.886 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/2652608868 expires 2024-09-16T23:05:17.756048+0000 2024-09-15T23:14:09.886 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2404111366 expires 2024-09-16T23:05:17.756048+0000 2024-09-15T23:14:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.883+0000 7fbc4bb42640 1 -- 172.21.15.2:0/3685708890 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbc300a3380 msgr2=0x7fbc300a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.883+0000 7fbc4bb42640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbc300a3380 0x7fbc300a5840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbc441993d0 tx=0x7fbc34008040 comp rx=0 tx=0).stop 2024-09-15T23:14:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.883+0000 7fbc4bb42640 1 -- 172.21.15.2:0/3685708890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441026a0 msgr2=0x7fbc44197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.883+0000 7fbc4bb42640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441026a0 0x7fbc44197eb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbc40004770 tx=0x7fbc400042f0 comp rx=0 tx=0).stop 2024-09-15T23:14:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.883+0000 7fbc4bb42640 1 -- 172.21.15.2:0/3685708890 shutdown_connections 2024-09-15T23:14:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.883+0000 7fbc4bb42640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7fbc300a3380 0x7fbc300a5840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.883+0000 7fbc4bb42640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc44107900 0x7fbc4419f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.883+0000 7fbc4bb42640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc44104fd0 0x7fbc441983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:09.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.883+0000 7fbc4bb42640 1 --2- 172.21.15.2:0/3685708890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc441026a0 0x7fbc44197eb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:09.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.883+0000 7fbc4bb42640 1 -- 172.21.15.2:0/3685708890 >> 172.21.15.2:0/3685708890 conn(0x7fbc440fc2a0 msgr2=0x7fbc44102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:09.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.883+0000 7fbc4bb42640 1 -- 172.21.15.2:0/3685708890 shutdown_connections 2024-09-15T23:14:09.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:09.883+0000 7fbc4bb42640 1 -- 172.21.15.2:0/3685708890 wait complete. 2024-09-15T23:14:10.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:10 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3685708890' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T23:14:10.678 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-15T23:14:10.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:14:10.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:10 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3685708890' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T23:14:10.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:10 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3685708890' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T23:14:10.956 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:14:11.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:11 smithi002 ceph-mon[31019]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:14:11.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.468+0000 7f7c1e32b640 1 -- 172.21.15.2:0/3700887868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c18106f20 msgr2=0x7f7c1810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:11.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.468+0000 7f7c1e32b640 1 --2- 172.21.15.2:0/3700887868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c18106f20 0x7f7c1810eaa0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009ca0 tx=0x7f7c1002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:14:11.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.469+0000 7f7c1e32b640 1 -- 172.21.15.2:0/3700887868 shutdown_connections 2024-09-15T23:14:11.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.469+0000 7f7c1e32b640 1 --2- 172.21.15.2:0/3700887868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c18106f20 0x7f7c1810eaa0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:11.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.469+0000 7f7c1e32b640 1 --2- 172.21.15.2:0/3700887868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c181027a0 0x7f7c181067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:11.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.469+0000 7f7c1e32b640 1 --2- 172.21.15.2:0/3700887868 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c18101df0 0x7f7c181021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:11.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.469+0000 7f7c1e32b640 1 -- 172.21.15.2:0/3700887868 >> 172.21.15.2:0/3700887868 conn(0x7f7c180fd8f0 msgr2=0x7f7c180ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:11.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.469+0000 7f7c1e32b640 1 -- 172.21.15.2:0/3700887868 shutdown_connections 2024-09-15T23:14:11.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.469+0000 7f7c1e32b640 1 -- 172.21.15.2:0/3700887868 wait complete. 2024-09-15T23:14:11.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.469+0000 7f7c1e32b640 1 Processor -- start 2024-09-15T23:14:11.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.469+0000 7f7c1e32b640 1 -- start start 2024-09-15T23:14:11.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1e32b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c18101df0 0x7f7c1819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1e32b640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c181027a0 0x7f7c1819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1e32b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c18106f20 0x7f7c1819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1e32b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c18111e30 con 0x7f7c18106f20 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1e32b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7c18111cb0 con 0x7f7c18101df0 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1e32b640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7c18111fb0 con 0x7f7c181027a0 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1c8c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c18106f20 0x7f7c1819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1c8c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c18106f20 0x7f7c1819edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54852/0 (socket says 172.21.15.2:54852) 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1c8c8640 1 -- 172.21.15.2:0/1232118257 learned_addr learned my addr 172.21.15.2:0/1232118257 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c17fff640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c18101df0 0x7f7c1819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c177fe640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c181027a0 0x7f7c1819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1c8c8640 1 -- 172.21.15.2:0/1232118257 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c181027a0 msgr2=0x7f7c1819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1c8c8640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c181027a0 0x7f7c1819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1c8c8640 1 -- 172.21.15.2:0/1232118257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c18101df0 msgr2=0x7f7c1819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:11.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1c8c8640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c18101df0 0x7f7c1819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.470+0000 7f7c1c8c8640 1 -- 172.21.15.2:0/1232118257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1819f4a0 con 0x7f7c18106f20 2024-09-15T23:14:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.471+0000 7f7c1c8c8640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c18106f20 0x7f7c1819edc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009dc0 tx=0x7f7c10003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.471+0000 7f7c157fa640 1 -- 172.21.15.2:0/1232118257 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10004040 con 0x7f7c18106f20 2024-09-15T23:14:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.471+0000 7f7c157fa640 1 -- 172.21.15.2:0/1232118257 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c10004690 con 0x7f7c18106f20 2024-09-15T23:14:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.471+0000 7f7c1e32b640 1 -- 172.21.15.2:0/1232118257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1819f730 con 0x7f7c18106f20 2024-09-15T23:14:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.471+0000 7f7c157fa640 1 -- 172.21.15.2:0/1232118257 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10030d90 con 0x7f7c18106f20 2024-09-15T23:14:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.471+0000 7f7c1e32b640 1 -- 172.21.15.2:0/1232118257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c181a7070 con 0x7f7c18106f20 2024-09-15T23:14:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.472+0000 7f7c1e32b640 1 -- 172.21.15.2:0/1232118257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c181021d0 con 0x7f7c18106f20 2024-09-15T23:14:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.474+0000 7f7c157fa640 1 -- 172.21.15.2:0/1232118257 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7c100305c0 con 0x7f7c18106f20 2024-09-15T23:14:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.475+0000 7f7c157fa640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7c000a3350 0x7f7c000a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.475+0000 7f7c157fa640 1 -- 172.21.15.2:0/1232118257 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f7c100f1350 con 0x7f7c18106f20 2024-09-15T23:14:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.477+0000 7f7c17fff640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7c000a3350 0x7f7c000a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:11.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.481+0000 7f7c17fff640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7c000a3350 0x7f7c000a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7c080058c0 tx=0x7f7c0800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:11.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.483+0000 7f7c157fa640 1 -- 172.21.15.2:0/1232118257 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c100bdfa0 con 0x7f7c18106f20 2024-09-15T23:14:11.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:11 smithi145 ceph-mon[34901]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:14:11.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.718+0000 7f7c1e32b640 1 -- 172.21.15.2:0/1232118257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c181a7240 con 0x7f7c18106f20 2024-09-15T23:14:11.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.719+0000 7f7c157fa640 1 -- 172.21.15.2:0/1232118257 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11843 (secure 0 0 0) 0x7f7c100bd8a0 con 0x7f7c18106f20 2024-09-15T23:14:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:14:11.720 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"btime":"2024-09-15T23:12:51:758295+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1051460220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1051460220},{"type":"v1","addr":"172.21.15.2:6839","nonce":1051460220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/1583533983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":1583533983},{"type":"v1","addr":"172.21.15.2:6841","nonce":1583533983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/91315913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":91315913},{"type":"v1","addr":"172.21.15.145:6835","nonce":91315913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1066293931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":1066293931},{"type":"v1","addr":"172.21.15.145:6837","nonce":1066293931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/418078184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":418078184},{"type":"v1","addr":"172.21.15.112:6837","nonce":418078184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:12:42.434565+0000","modified":"2024-09-15T23:12:51.456432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3930825714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3930825714},{"type":"v1","addr":"172.21.15.145:6839","nonce":3930825714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/1380244119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1380244119},{"type":"v1","addr":"172.21.15.112:6839","nonce":1380244119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24464,"qdb_cluster":[24464]},"id":1}]} 2024-09-15T23:14:11.721 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-09-15T23:14:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.722+0000 7f7c1e32b640 1 -- 172.21.15.2:0/1232118257 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7c000a3350 msgr2=0x7f7c000a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.722+0000 7f7c1e32b640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7c000a3350 0x7f7c000a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7c080058c0 tx=0x7f7c0800a2d0 comp rx=0 tx=0).stop 2024-09-15T23:14:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.722+0000 7f7c1e32b640 1 -- 172.21.15.2:0/1232118257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c18106f20 msgr2=0x7f7c1819edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.722+0000 7f7c1e32b640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c18106f20 0x7f7c1819edc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009dc0 tx=0x7f7c10003ba0 comp rx=0 tx=0).stop 2024-09-15T23:14:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.723+0000 7f7c1e32b640 1 -- 172.21.15.2:0/1232118257 shutdown_connections 2024-09-15T23:14:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.723+0000 7f7c1e32b640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f7c000a3350 0x7f7c000a5810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.723+0000 7f7c1e32b640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c18106f20 0x7f7c1819edc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.723+0000 7f7c1e32b640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c181027a0 0x7f7c1819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.723+0000 7f7c1e32b640 1 --2- 172.21.15.2:0/1232118257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c18101df0 0x7f7c1819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.723+0000 7f7c1e32b640 1 -- 172.21.15.2:0/1232118257 >> 172.21.15.2:0/1232118257 conn(0x7f7c180fd8f0 msgr2=0x7f7c180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.723+0000 7f7c1e32b640 1 -- 172.21.15.2:0/1232118257 shutdown_connections 2024-09-15T23:14:11.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:11.723+0000 7f7c1e32b640 1 -- 172.21.15.2:0/1232118257 wait complete. 2024-09-15T23:14:11.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:11 smithi112 ceph-mon[34367]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:14:12.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:12 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1232118257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:14:12.696 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:14:12.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:12 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1232118257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:14:12.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:12 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1232118257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:14:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:14:13.344 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:13 smithi002 ceph-mon[31019]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:13.344 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:13 smithi002 ceph-mon[31019]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-15T23:14:13.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.426+0000 7f3db09a6640 1 -- 172.21.15.2:0/2082216771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dac106a80 msgr2=0x7f3dac106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:13.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.426+0000 7f3db09a6640 1 --2- 172.21.15.2:0/2082216771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dac106a80 0x7f3dac106e60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009930 tx=0x7f3d9c02a420 comp rx=0 tx=0).stop 2024-09-15T23:14:13.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.426+0000 7f3db09a6640 1 -- 172.21.15.2:0/2082216771 shutdown_connections 2024-09-15T23:14:13.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.426+0000 7f3db09a6640 1 --2- 172.21.15.2:0/2082216771 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dac101420 0x7f3dac10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:13.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.426+0000 7f3db09a6640 1 --2- 172.21.15.2:0/2082216771 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dac100a80 0x7f3dac100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:13.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.426+0000 7f3db09a6640 1 --2- 172.21.15.2:0/2082216771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dac106a80 0x7f3dac106e60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:13.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.426+0000 7f3db09a6640 1 -- 172.21.15.2:0/2082216771 >> 172.21.15.2:0/2082216771 conn(0x7f3dac0fc7a0 msgr2=0x7f3dac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:13.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.426+0000 7f3db09a6640 1 -- 172.21.15.2:0/2082216771 shutdown_connections 2024-09-15T23:14:13.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.426+0000 7f3db09a6640 1 -- 172.21.15.2:0/2082216771 wait complete. 2024-09-15T23:14:13.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.426+0000 7f3db09a6640 1 Processor -- start 2024-09-15T23:14:13.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3db09a6640 1 -- start start 2024-09-15T23:14:13.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3db09a6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dac100a80 0x7f3dac199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:13.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3db09a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dac101420 0x7f3dac199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:13.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3db09a6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dac106a80 0x7f3dac1a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:13.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3db09a6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac110d50 con 0x7f3dac101420 2024-09-15T23:14:13.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3db09a6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac110bd0 con 0x7f3dac100a80 2024-09-15T23:14:13.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3db09a6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac110ed0 con 0x7f3dac106a80 2024-09-15T23:14:13.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3da9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dac101420 0x7f3dac199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:13.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3da9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dac101420 0x7f3dac199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54858/0 (socket says 172.21.15.2:54858) 2024-09-15T23:14:13.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3da9d9b640 1 -- 172.21.15.2:0/3859622732 learned_addr learned my addr 172.21.15.2:0/3859622732 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:13.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3daa59c640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dac100a80 0x7f3dac199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:13.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3daad9d640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dac106a80 0x7f3dac1a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3da9d9b640 1 -- 172.21.15.2:0/3859622732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dac106a80 msgr2=0x7f3dac1a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3da9d9b640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dac106a80 0x7f3dac1a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3da9d9b640 1 -- 172.21.15.2:0/3859622732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dac100a80 msgr2=0x7f3dac199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3da9d9b640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dac100a80 0x7f3dac199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3da9d9b640 1 -- 172.21.15.2:0/3859622732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac1a4800 con 0x7f3dac101420 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3daad9d640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dac106a80 0x7f3dac1a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.427+0000 7f3da9d9b640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dac101420 0x7f3dac199780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3da000d950 tx=0x7f3da000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.428+0000 7f3d9b7fe640 1 -- 172.21.15.2:0/3859622732 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da0017070 con 0x7f3dac101420 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.428+0000 7f3d9b7fe640 1 -- 172.21.15.2:0/3859622732 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3da0009c30 con 0x7f3dac101420 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.428+0000 7f3db09a6640 1 -- 172.21.15.2:0/3859622732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dac1a49d0 con 0x7f3dac101420 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.428+0000 7f3d9b7fe640 1 -- 172.21.15.2:0/3859622732 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da000f620 con 0x7f3dac101420 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.428+0000 7f3db09a6640 1 -- 172.21.15.2:0/3859622732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dac1a4f10 con 0x7f3dac101420 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.429+0000 7f3db09a6640 1 -- 172.21.15.2:0/3859622732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dac100ee0 con 0x7f3dac101420 2024-09-15T23:14:13.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.430+0000 7f3d9b7fe640 1 -- 172.21.15.2:0/3859622732 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f3da00109a0 con 0x7f3dac101420 2024-09-15T23:14:13.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.430+0000 7f3d9b7fe640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3d940a3240 0x7f3d940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:13.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.430+0000 7f3d9b7fe640 1 -- 172.21.15.2:0/3859622732 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f3da00cf580 con 0x7f3dac101420 2024-09-15T23:14:13.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.431+0000 7f3daa59c640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3d940a3240 0x7f3d940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:13.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.431+0000 7f3daa59c640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3d940a3240 0x7f3d940a5700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009900 tx=0x7f3d9c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:13.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.435+0000 7f3d9b7fe640 1 -- 172.21.15.2:0/3859622732 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3da0009de0 con 0x7f3dac101420 2024-09-15T23:14:13.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.647+0000 7f3db09a6640 1 -- 172.21.15.2:0/3859622732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dac108ff0 con 0x7f3dac101420 2024-09-15T23:14:13.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.648+0000 7f3d9b7fe640 1 -- 172.21.15.2:0/3859622732 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11843 (secure 0 0 0) 0x7f3da009c280 con 0x7f3dac101420 2024-09-15T23:14:13.649 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:14:13.649 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"btime":"2024-09-15T23:12:51:758295+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1051460220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1051460220},{"type":"v1","addr":"172.21.15.2:6839","nonce":1051460220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/1583533983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":1583533983},{"type":"v1","addr":"172.21.15.2:6841","nonce":1583533983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/91315913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":91315913},{"type":"v1","addr":"172.21.15.145:6835","nonce":91315913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1066293931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":1066293931},{"type":"v1","addr":"172.21.15.145:6837","nonce":1066293931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/418078184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":418078184},{"type":"v1","addr":"172.21.15.112:6837","nonce":418078184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:12:42.434565+0000","modified":"2024-09-15T23:12:51.456432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3930825714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3930825714},{"type":"v1","addr":"172.21.15.145:6839","nonce":3930825714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/1380244119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1380244119},{"type":"v1","addr":"172.21.15.112:6839","nonce":1380244119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24464,"qdb_cluster":[24464]},"id":1}]} 2024-09-15T23:14:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-09-15T23:14:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.650+0000 7f3db09a6640 1 -- 172.21.15.2:0/3859622732 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3d940a3240 msgr2=0x7f3d940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.650+0000 7f3db09a6640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3d940a3240 0x7f3d940a5700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009900 tx=0x7f3d9c000bc0 comp rx=0 tx=0).stop 2024-09-15T23:14:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.650+0000 7f3db09a6640 1 -- 172.21.15.2:0/3859622732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dac101420 msgr2=0x7f3dac199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.650+0000 7f3db09a6640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dac101420 0x7f3dac199780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3da000d950 tx=0x7f3da000de10 comp rx=0 tx=0).stop 2024-09-15T23:14:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.650+0000 7f3db09a6640 1 -- 172.21.15.2:0/3859622732 shutdown_connections 2024-09-15T23:14:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.650+0000 7f3db09a6640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f3d940a3240 0x7f3d940a5700 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.650+0000 7f3db09a6640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3dac106a80 0x7f3dac1a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.650+0000 7f3db09a6640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dac101420 0x7f3dac199780 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.650+0000 7f3db09a6640 1 --2- 172.21.15.2:0/3859622732 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dac100a80 0x7f3dac199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.650+0000 7f3db09a6640 1 -- 172.21.15.2:0/3859622732 >> 172.21.15.2:0/3859622732 conn(0x7f3dac0fc7a0 msgr2=0x7f3dac0fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.650+0000 7f3db09a6640 1 -- 172.21.15.2:0/3859622732 shutdown_connections 2024-09-15T23:14:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:13.650+0000 7f3db09a6640 1 -- 172.21.15.2:0/3859622732 wait complete. 2024-09-15T23:14:13.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:13 smithi145 ceph-mon[34901]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:13.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:13 smithi145 ceph-mon[34901]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-15T23:14:13.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:13 smithi112 ceph-mon[34367]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:13.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:13 smithi112 ceph-mon[34367]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-15T23:14:14.295 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:14:14.551 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:14:14.557 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:14 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3859622732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:14:14.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:14 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3859622732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:14:14.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:14 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3859622732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:14:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.975+0000 7f8cc1315640 1 -- 172.21.15.2:0/1315150190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cbc101df0 msgr2=0x7f8cbc1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.975+0000 7f8cc1315640 1 --2- 172.21.15.2:0/1315150190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cbc101df0 0x7f8cbc1021d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009900 tx=0x7f8cac02a410 comp rx=0 tx=0).stop 2024-09-15T23:14:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.975+0000 7f8cc1315640 1 -- 172.21.15.2:0/1315150190 shutdown_connections 2024-09-15T23:14:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.975+0000 7f8cc1315640 1 --2- 172.21.15.2:0/1315150190 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cbc106f20 0x7f8cbc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.975+0000 7f8cc1315640 1 --2- 172.21.15.2:0/1315150190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc1027a0 0x7f8cbc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.975+0000 7f8cc1315640 1 --2- 172.21.15.2:0/1315150190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cbc101df0 0x7f8cbc1021d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.975+0000 7f8cc1315640 1 -- 172.21.15.2:0/1315150190 >> 172.21.15.2:0/1315150190 conn(0x7f8cbc0fd8b0 msgr2=0x7f8cbc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.975+0000 7f8cc1315640 1 -- 172.21.15.2:0/1315150190 shutdown_connections 2024-09-15T23:14:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.975+0000 7f8cc1315640 1 -- 172.21.15.2:0/1315150190 wait complete. 2024-09-15T23:14:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.976+0000 7f8cc1315640 1 Processor -- start 2024-09-15T23:14:14.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.976+0000 7f8cc1315640 1 -- start start 2024-09-15T23:14:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.976+0000 7f8cc1315640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc101df0 0x7f8cbc198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.976+0000 7f8cc1315640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cbc1027a0 0x7f8cbc198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.976+0000 7f8cc1315640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cbc106f20 0x7f8cbc19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.976+0000 7f8cc1315640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc111df0 con 0x7f8cbc106f20 2024-09-15T23:14:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.976+0000 7f8cc1315640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc111c70 con 0x7f8cbc101df0 2024-09-15T23:14:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.976+0000 7f8cc1315640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc111f70 con 0x7f8cbc1027a0 2024-09-15T23:14:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.976+0000 7f8cbb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cbc106f20 0x7f8cbc19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.976+0000 7f8cbaffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc101df0 0x7f8cbc198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.976+0000 7f8cbb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cbc106f20 0x7f8cbc19cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54874/0 (socket says 172.21.15.2:54874) 2024-09-15T23:14:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.976+0000 7f8cbb7fe640 1 -- 172.21.15.2:0/3304115168 learned_addr learned my addr 172.21.15.2:0/3304115168 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.976+0000 7f8cb3fff640 1 --2- 172.21.15.2:0/3304115168 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cbc1027a0 0x7f8cbc198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.977+0000 7f8cbb7fe640 1 -- 172.21.15.2:0/3304115168 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cbc1027a0 msgr2=0x7f8cbc198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:14.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.977+0000 7f8cbb7fe640 1 --2- 172.21.15.2:0/3304115168 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cbc1027a0 0x7f8cbc198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.977+0000 7f8cbb7fe640 1 -- 172.21.15.2:0/3304115168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc101df0 msgr2=0x7f8cbc198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.977+0000 7f8cbb7fe640 1 --2- 172.21.15.2:0/3304115168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc101df0 0x7f8cbc198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.977+0000 7f8cbb7fe640 1 -- 172.21.15.2:0/3304115168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc19d300 con 0x7f8cbc106f20 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.977+0000 7f8cbb7fe640 1 --2- 172.21.15.2:0/3304115168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cbc106f20 0x7f8cbc19cc20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400eaa0 tx=0x7f8cb400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.977+0000 7f8cb8ff9640 1 -- 172.21.15.2:0/3304115168 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb400cdb0 con 0x7f8cbc106f20 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.977+0000 7f8cb8ff9640 1 -- 172.21.15.2:0/3304115168 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8cb4005020 con 0x7f8cbc106f20 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.977+0000 7f8cc1315640 1 -- 172.21.15.2:0/3304115168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cbc19d5f0 con 0x7f8cbc106f20 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.977+0000 7f8cb8ff9640 1 -- 172.21.15.2:0/3304115168 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb40116d0 con 0x7f8cbc106f20 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.977+0000 7f8cc1315640 1 -- 172.21.15.2:0/3304115168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cbc1a4ed0 con 0x7f8cbc106f20 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.978+0000 7f8cc1315640 1 -- 172.21.15.2:0/3304115168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cbc1021d0 con 0x7f8cbc106f20 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.979+0000 7f8cb8ff9640 1 -- 172.21.15.2:0/3304115168 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f8cb40051d0 con 0x7f8cbc106f20 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.980+0000 7f8cb8ff9640 1 --2- 172.21.15.2:0/3304115168 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ca80a3240 0x7f8ca80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.980+0000 7f8cbaffd640 1 --2- 172.21.15.2:0/3304115168 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ca80a3240 0x7f8ca80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:14.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.980+0000 7f8cb8ff9640 1 -- 172.21.15.2:0/3304115168 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f8cb40cfdb0 con 0x7f8cbc106f20 2024-09-15T23:14:14.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.981+0000 7f8cbaffd640 1 --2- 172.21.15.2:0/3304115168 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ca80a3240 0x7f8ca80a5700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8cac031440 tx=0x7f8cac005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:14.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:14.983+0000 7f8cb8ff9640 1 -- 172.21.15.2:0/3304115168 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8cb4016030 con 0x7f8cbc106f20 2024-09-15T23:14:15.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.159+0000 7f8cc1315640 1 -- 172.21.15.2:0/3304115168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cbc1996b0 con 0x7f8cbc106f20 2024-09-15T23:14:15.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.161+0000 7f8cb8ff9640 1 -- 172.21.15.2:0/3304115168 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22723 (secure 0 0 0) 0x7f8cbc1996b0 con 0x7f8cbc106f20 2024-09-15T23:14:15.162 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:14:15.162 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":83,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","created":"2024-09-15T23:04:45.101432+0000","modified":"2024-09-15T23:13:42.726811+0000","last_up_change":"2024-09-15T23:11:49.566858+0000","last_in_change":"2024-09-15T23:11:25.723093+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:07:57.919291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:38.100522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:40.716254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40ff4fd9-3904-4178-a9cb-51f4647be540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6803","nonce":280991401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6805","nonce":280991401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6809","nonce":280991401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6807","nonce":280991401}]},"public_addr":"172.21.15.2:6803/280991401","cluster_addr":"172.21.15.2:6805/280991401","heartbeat_back_addr":"172.21.15.2:6809/280991401","heartbeat_front_addr":"172.21.15.2:6807/280991401","state":["exists","up"]},{"osd":1,"uuid":"af5e265d-fe45-4d9c-a34c-6f0b103d75d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6801","nonce":2649210970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6803","nonce":2649210970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6807","nonce":2649210970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6805","nonce":2649210970}]},"public_addr":"172.21.15.112:6801/2649210970","cluster_addr":"172.21.15.112:6803/2649210970","heartbeat_back_addr":"172.21.15.112:6807/2649210970","heartbeat_front_addr":"172.21.15.112:6805/2649210970","state":["exists","up"]},{"osd":2,"uuid":"8df9e644-fc51-4626-a1a7-6ac4448a5b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6801","nonce":3485615437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6803","nonce":3485615437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6807","nonce":3485615437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6805","nonce":3485615437}]},"public_addr":"172.21.15.145:6801/3485615437","cluster_addr":"172.21.15.145:6803/3485615437","heartbeat_back_addr":"172.21.15.145:6807/3485615437","heartbeat_front_addr":"172.21.15.145:6805/3485615437","state":["exists","up"]},{"osd":3,"uuid":"dbab372a-8fdd-4b0c-bee3-16cd75b35ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6811","nonce":113061968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6813","nonce":113061968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6817","nonce":113061968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6815","nonce":113061968}]},"public_addr":"172.21.15.2:6811/113061968","cluster_addr":"172.21.15.2:6813/113061968","heartbeat_back_addr":"172.21.15.2:6817/113061968","heartbeat_front_addr":"172.21.15.2:6815/113061968","state":["exists","up"]},{"osd":4,"uuid":"73bab8af-3973-4beb-a034-d00bcf0c572f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6809","nonce":2519162767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6811","nonce":2519162767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6815","nonce":2519162767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6813","nonce":2519162767}]},"public_addr":"172.21.15.112:6809/2519162767","cluster_addr":"172.21.15.112:6811/2519162767","heartbeat_back_addr":"172.21.15.112:6815/2519162767","heartbeat_front_addr":"172.21.15.112:6813/2519162767","state":["exists","up"]},{"osd":5,"uuid":"2d163e61-5891-46c1-b1c2-39d50a3b6f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6809","nonce":712427242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6811","nonce":712427242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6815","nonce":712427242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6813","nonce":712427242}]},"public_addr":"172.21.15.145:6809/712427242","cluster_addr":"172.21.15.145:6811/712427242","heartbeat_back_addr":"172.21.15.145:6815/712427242","heartbeat_front_addr":"172.21.15.145:6813/712427242","state":["exists","up"]},{"osd":6,"uuid":"bca02c96-10de-4953-96e9-42fc9ddf7c1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6819","nonce":2930673197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6821","nonce":2930673197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6825","nonce":2930673197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6823","nonce":2930673197}]},"public_addr":"172.21.15.2:6819/2930673197","cluster_addr":"172.21.15.2:6821/2930673197","heartbeat_back_addr":"172.21.15.2:6825/2930673197","heartbeat_front_addr":"172.21.15.2:6823/2930673197","state":["exists","up"]},{"osd":7,"uuid":"4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6817","nonce":830628191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6819","nonce":830628191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6823","nonce":830628191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6821","nonce":830628191}]},"public_addr":"172.21.15.112:6817/830628191","cluster_addr":"172.21.15.112:6819/830628191","heartbeat_back_addr":"172.21.15.112:6823/830628191","heartbeat_front_addr":"172.21.15.112:6821/830628191","state":["exists","up"]},{"osd":8,"uuid":"2733f9dd-3872-4bec-9c22-bcdb64828ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6817","nonce":3634470540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6819","nonce":3634470540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6823","nonce":3634470540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6821","nonce":3634470540}]},"public_addr":"172.21.15.145:6817/3634470540","cluster_addr":"172.21.15.145:6819/3634470540","heartbeat_back_addr":"172.21.15.145:6823/3634470540","heartbeat_front_addr":"172.21.15.145:6821/3634470540","state":["exists","up"]},{"osd":9,"uuid":"bd1f4a4a-547c-43a9-859a-75b37b06905f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6827","nonce":1417377702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6829","nonce":1417377702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6833","nonce":1417377702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6831","nonce":1417377702}]},"public_addr":"172.21.15.2:6827/1417377702","cluster_addr":"172.21.15.2:6829/1417377702","heartbeat_back_addr":"172.21.15.2:6833/1417377702","heartbeat_front_addr":"172.21.15.2:6831/1417377702","state":["exists","up"]},{"osd":10,"uuid":"f8b895e8-39f5-4753-9343-03f96da12246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6825","nonce":105615908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6827","nonce":105615908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6831","nonce":105615908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6829","nonce":105615908}]},"public_addr":"172.21.15.112:6825/105615908","cluster_addr":"172.21.15.112:6827/105615908","heartbeat_back_addr":"172.21.15.112:6831/105615908","heartbeat_front_addr":"172.21.15.112:6829/105615908","state":["exists","up"]},{"osd":11,"uuid":"dc018bfc-bc13-4ef2-a712-5cd406a56cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6825","nonce":430484289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6827","nonce":430484289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6831","nonce":430484289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6829","nonce":430484289}]},"public_addr":"172.21.15.145:6825/430484289","cluster_addr":"172.21.15.145:6827/430484289","heartbeat_back_addr":"172.21.15.145:6831/430484289","heartbeat_front_addr":"172.21.15.145:6829/430484289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:03.938207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:29.814740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:54.853802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:20.802021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:47.028090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:13.226130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:39.003023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:04.465156+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:29.321331+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:55.992585+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:21.623406+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:48.269840+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/2956732837":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6800/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/896502743":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/3802152324":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/1891095221":"2024-09-16T23:05:17.756048+0000","172.21.15.2:6800/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/236781836":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/2404111366":"2024-09-16T23:05:17.756048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:14:15.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.163+0000 7f8cc1315640 1 -- 172.21.15.2:0/3304115168 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ca80a3240 msgr2=0x7f8ca80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:15.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.163+0000 7f8cc1315640 1 --2- 172.21.15.2:0/3304115168 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ca80a3240 0x7f8ca80a5700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8cac031440 tx=0x7f8cac005b50 comp rx=0 tx=0).stop 2024-09-15T23:14:15.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.163+0000 7f8cc1315640 1 -- 172.21.15.2:0/3304115168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cbc106f20 msgr2=0x7f8cbc19cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:15.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.163+0000 7f8cc1315640 1 --2- 172.21.15.2:0/3304115168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cbc106f20 0x7f8cbc19cc20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400eaa0 tx=0x7f8cb400ef60 comp rx=0 tx=0).stop 2024-09-15T23:14:15.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.163+0000 7f8cc1315640 1 -- 172.21.15.2:0/3304115168 shutdown_connections 2024-09-15T23:14:15.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.163+0000 7f8cc1315640 1 --2- 172.21.15.2:0/3304115168 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f8ca80a3240 0x7f8ca80a5700 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:15.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.163+0000 7f8cc1315640 1 --2- 172.21.15.2:0/3304115168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cbc106f20 0x7f8cbc19cc20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:15.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.163+0000 7f8cc1315640 1 --2- 172.21.15.2:0/3304115168 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8cbc1027a0 0x7f8cbc198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:15.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.163+0000 7f8cc1315640 1 --2- 172.21.15.2:0/3304115168 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8cbc101df0 0x7f8cbc198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:15.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.163+0000 7f8cc1315640 1 -- 172.21.15.2:0/3304115168 >> 172.21.15.2:0/3304115168 conn(0x7f8cbc0fd8b0 msgr2=0x7f8cbc0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:15.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.163+0000 7f8cc1315640 1 -- 172.21.15.2:0/3304115168 shutdown_connections 2024-09-15T23:14:15.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:15.163+0000 7f8cc1315640 1 -- 172.21.15.2:0/3304115168 wait complete. 2024-09-15T23:14:15.661 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:15 smithi002 ceph-mon[31019]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:14:15.661 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:15 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3304115168' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:14:15.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:15 smithi145 ceph-mon[34901]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:14:15.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:15 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3304115168' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:14:15.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:15 smithi112 ceph-mon[34367]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:14:15.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:15 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3304115168' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:14:15.961 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T23:12:42.434565+0000', 'modified': '2024-09-15T23:12:51.456432+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24442': {'gid': 24442, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.145:6839/3930825714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6838', 'nonce': 3930825714}, {'type': 'v1', 'addr': '172.21.15.145:6839', 'nonce': 3930825714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.112:6839/1380244119', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6838', 'nonce': 1380244119}, {'type': 'v1', 'addr': '172.21.15.112:6839', 'nonce': 1380244119}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24464, 'qdb_cluster': [24464]} 2024-09-15T23:14:15.961 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:14:15.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T23:14:16.224 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:14:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.763+0000 7f2346d57640 1 -- 172.21.15.2:0/4099478084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23401027a0 msgr2=0x7f23401067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.763+0000 7f2346d57640 1 --2- 172.21.15.2:0/4099478084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23401027a0 0x7f23401067f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f232c009900 tx=0x7f232c02a410 comp rx=0 tx=0).stop 2024-09-15T23:14:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.763+0000 7f2346d57640 1 -- 172.21.15.2:0/4099478084 shutdown_connections 2024-09-15T23:14:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.763+0000 7f2346d57640 1 --2- 172.21.15.2:0/4099478084 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2340106f20 0x7f234010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.763+0000 7f2346d57640 1 --2- 172.21.15.2:0/4099478084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23401027a0 0x7f23401067f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.763+0000 7f2346d57640 1 --2- 172.21.15.2:0/4099478084 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2340101df0 0x7f23401021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.763+0000 7f2346d57640 1 -- 172.21.15.2:0/4099478084 >> 172.21.15.2:0/4099478084 conn(0x7f23400fd8f0 msgr2=0x7f23400ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:16.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.763+0000 7f2346d57640 1 -- 172.21.15.2:0/4099478084 shutdown_connections 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.763+0000 7f2346d57640 1 -- 172.21.15.2:0/4099478084 wait complete. 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.763+0000 7f2346d57640 1 Processor -- start 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.763+0000 7f2346d57640 1 -- start start 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2346d57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340101df0 0x7f23401983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2346d57640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23401027a0 0x7f23401988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2346d57640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2340106f20 0x7f234019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2346d57640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2340111e30 con 0x7f2340101df0 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2346d57640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2340111cb0 con 0x7f2340106f20 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2346d57640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2340111fb0 con 0x7f23401027a0 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2344af3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340101df0 0x7f23401983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2344af3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340101df0 0x7f23401983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45294/0 (socket says 172.21.15.2:45294) 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2344af3640 1 -- 172.21.15.2:0/1009051456 learned_addr learned my addr 172.21.15.2:0/1009051456 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f23452f4640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2340106f20 0x7f234019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f233ffff640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23401027a0 0x7f23401988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2344af3640 1 -- 172.21.15.2:0/1009051456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23401027a0 msgr2=0x7f23401988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2344af3640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23401027a0 0x7f23401988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2344af3640 1 -- 172.21.15.2:0/1009051456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2340106f20 msgr2=0x7f234019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2344af3640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2340106f20 0x7f234019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2344af3640 1 -- 172.21.15.2:0/1009051456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234019d360 con 0x7f2340101df0 2024-09-15T23:14:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2344af3640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340101df0 0x7f23401983b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f233400c920 tx=0x7f233400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f233dffb640 1 -- 172.21.15.2:0/1009051456 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334007c70 con 0x7f2340101df0 2024-09-15T23:14:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f233dffb640 1 -- 172.21.15.2:0/1009051456 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2334007e10 con 0x7f2340101df0 2024-09-15T23:14:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f2346d57640 1 -- 172.21.15.2:0/1009051456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234019d650 con 0x7f2340101df0 2024-09-15T23:14:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.764+0000 7f233dffb640 1 -- 172.21.15.2:0/1009051456 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334018820 con 0x7f2340101df0 2024-09-15T23:14:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.765+0000 7f2346d57640 1 -- 172.21.15.2:0/1009051456 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23401a4f30 con 0x7f2340101df0 2024-09-15T23:14:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.767+0000 7f233dffb640 1 -- 172.21.15.2:0/1009051456 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f23340189c0 con 0x7f2340101df0 2024-09-15T23:14:16.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f2349130740 1 Processor -- start 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f2349130740 1 -- start start 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f2349130740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff058b0 0x55c4dff05c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f2349130740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff061d0 0x55c4dff14a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f2349130740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff14fc0 0x55c4dff173b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f2349130740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c4dfe6c090 con 0x55c4dff058b0 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f2349130740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c4dfe13a70 con 0x55c4dff14fc0 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f2349130740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c4dfe68050 con 0x55c4dff061d0 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f23452f4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff058b0 0x55c4dff05c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f23452f4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff058b0 0x55c4dff05c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45304/0 (socket says 172.21.15.2:45304) 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f23452f4640 1 -- 172.21.15.2:0/66627955 learned_addr learned my addr 172.21.15.2:0/66627955 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f233dffb640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23300a32c0 0x7f23300a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f233ffff640 1 --2- 172.21.15.2:0/66627955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff14fc0 0x55c4dff173b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.768+0000 7f2344af3640 1 --2- 172.21.15.2:0/66627955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff061d0 0x55c4dff14a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.769+0000 7f23452f4640 1 -- 172.21.15.2:0/66627955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff061d0 msgr2=0x55c4dff14a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.769+0000 7f23452f4640 1 --2- 172.21.15.2:0/66627955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff061d0 0x55c4dff14a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.769+0000 7f23452f4640 1 -- 172.21.15.2:0/66627955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff14fc0 msgr2=0x55c4dff173b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.769+0000 7f23452f4640 1 --2- 172.21.15.2:0/66627955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff14fc0 0x55c4dff173b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.769+0000 7f23452f4640 1 -- 172.21.15.2:0/66627955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4dfe20130 con 0x55c4dff058b0 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.769+0000 7f2344af3640 1 --2- 172.21.15.2:0/66627955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff061d0 0x55c4dff14a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.769+0000 7f23452f4640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23300a32c0 0x7f23300a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.769+0000 7f233dffb640 1 -- 172.21.15.2:0/1009051456 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f23340cf990 con 0x7f2340101df0 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.769+0000 7f23452f4640 1 --2- 172.21.15.2:0/66627955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff058b0 0x55c4dff05c90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2338010440 tx=0x7f2338010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1529db0b0930498a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.769+0000 7f232affd640 1 -- 172.21.15.2:0/66627955 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233801d400 con 0x55c4dff058b0 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.769+0000 7f232affd640 1 -- 172.21.15.2:0/66627955 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2338013520 con 0x55c4dff058b0 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.769+0000 7f232affd640 1 -- 172.21.15.2:0/66627955 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338011860 con 0x55c4dff058b0 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.769+0000 7f23452f4640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23300a32c0 0x7f23300a5780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2338021000 tx=0x7f233801e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.770+0000 7f2349130740 1 -- 172.21.15.2:0/66627955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff058b0 msgr2=0x55c4dff05c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:16.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.770+0000 7f2349130740 1 --2- 172.21.15.2:0/66627955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff058b0 0x55c4dff05c90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2338010440 tx=0x7f2338010900 comp rx=0 tx=0).stop 2024-09-15T23:14:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.770+0000 7f2349130740 1 -- 172.21.15.2:0/66627955 shutdown_connections 2024-09-15T23:14:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.770+0000 7f2349130740 1 --2- 172.21.15.2:0/66627955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff14fc0 0x55c4dff173b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.770+0000 7f2349130740 1 --2- 172.21.15.2:0/66627955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff061d0 0x55c4dff14a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.770+0000 7f2349130740 1 --2- 172.21.15.2:0/66627955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff058b0 0x55c4dff05c90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.770+0000 7f2349130740 1 -- 172.21.15.2:0/66627955 >> 172.21.15.2:0/66627955 conn(0x55c4dff01f60 msgr2=0x55c4dff02340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.770+0000 7f2349130740 1 -- 172.21.15.2:0/66627955 shutdown_connections 2024-09-15T23:14:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.770+0000 7f2349130740 1 -- 172.21.15.2:0/66627955 wait complete. 2024-09-15T23:14:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.770+0000 7f2349130740 1 -- start start 2024-09-15T23:14:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.770+0000 7f2349130740 1 Processor -- start 2024-09-15T23:14:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f2349130740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff058b0 0x55c4dff147c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f2349130740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 0x55c4dff11b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f2349130740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff14fc0 0x55c4dff120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f2349130740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c4dff17b90 con 0x55c4dff061d0 2024-09-15T23:14:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f2349130740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c4dfe26f20 con 0x55c4dff058b0 2024-09-15T23:14:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f2349130740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c4dff17d10 con 0x55c4dff14fc0 2024-09-15T23:14:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f2349130740 10 client.0 _ll_register_callbacks cb 0x55c4dfdf0030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f233ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 0x55c4dff11b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f233ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 0x55c4dff11b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45306/0 (socket says 172.21.15.2:45306) 2024-09-15T23:14:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f233ffff640 1 -- 172.21.15.2:0/1298203859 learned_addr learned my addr 172.21.15.2:0/1298203859 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f2344af3640 1 --2- 172.21.15.2:0/1298203859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff058b0 0x55c4dff147c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f23452f4640 1 --2- 172.21.15.2:0/1298203859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff14fc0 0x55c4dff120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f233ffff640 1 -- 172.21.15.2:0/1298203859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff14fc0 msgr2=0x55c4dff120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f233ffff640 1 --2- 172.21.15.2:0/1298203859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff14fc0 0x55c4dff120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f233ffff640 1 -- 172.21.15.2:0/1298203859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff058b0 msgr2=0x55c4dff147c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f233ffff640 1 --2- 172.21.15.2:0/1298203859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff058b0 0x55c4dff147c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f233ffff640 1 -- 172.21.15.2:0/1298203859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4dfbdd2b0 con 0x55c4dff061d0 2024-09-15T23:14:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f233ffff640 1 --2- 172.21.15.2:0/1298203859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 0x55c4dff11b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f232c009900 tx=0x7f232c0316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90eaf4ac9f215f8e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f231ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-15T23:14:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.771+0000 7f231ffff640 1 -- 172.21.15.2:0/1298203859 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c035040 con 0x55c4dff061d0 2024-09-15T23:14:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f231ffff640 1 -- 172.21.15.2:0/1298203859 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f232c004040 con 0x55c4dff061d0 2024-09-15T23:14:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f2349130740 1 -- 172.21.15.2:0/1298203859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2338013520 con 0x55c4dff061d0 2024-09-15T23:14:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f231ffff640 1 -- 172.21.15.2:0/1298203859 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f232c032e10 con 0x55c4dff061d0 2024-09-15T23:14:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f2349130740 10 client.15024 fetch_fsmap learned FSMap version 20 2024-09-15T23:14:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f2349130740 1 -- 172.21.15.2:0/1298203859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c4dff23400 con 0x55c4dff061d0 2024-09-15T23:14:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f231ffff640 1 -- 172.21.15.2:0/1298203859 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2338013520 con 0x55c4dff061d0 2024-09-15T23:14:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f231ffff640 1 -- 172.21.15.2:0/1298203859 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f232c0048e0 con 0x55c4dff061d0 2024-09-15T23:14:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f2349130740 10 client.15024 fetch_fsmap finished waiting for FSMap version 20 2024-09-15T23:14:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f2349130740 10 client.15024 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T23:14:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f2349130740 20 client.15024 populate_metadata read hostname 'smithi002' 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f2349130740 1 --2- 172.21.15.2:0/1298203859 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x55c4dff25a50 0x55c4dff26ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f2349130740 4 client.15024 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f2349130740 1 -- 172.21.15.2:0/1298203859 --> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4dfe79600 con 0x55c4dff25a50 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.772+0000 7f2344af3640 1 --2- 172.21.15.2:0/1298203859 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x55c4dff25a50 0x55c4dff26ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.773+0000 7f2344af3640 1 --2- 172.21.15.2:0/1298203859 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x55c4dff25a50 0x55c4dff26ec0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28b0d523402f3227 server_cookie=665c01922b67db71 in_seq=0 out_seq=0 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.773+0000 7f231ffff640 10 client.15024 ms_handle_connect on v2:172.21.15.112:6838/1380244119 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f231ffff640 1 -- 172.21.15.2:0/1298203859 <== mds.0 v2:172.21.15.112:6838/1380244119 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4dfe79600 con 0x55c4dff25a50 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f231ffff640 10 client.15024 handle_command_reply: tid=0 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f2349130740 1 client.15024 shutdown 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f2349130740 1 -- 172.21.15.2:0/1298203859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 msgr2=0x55c4dff11b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f2349130740 1 --2- 172.21.15.2:0/1298203859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 0x55c4dff11b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f232c009900 tx=0x7f232c0316d0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f2349130740 1 -- 172.21.15.2:0/1298203859 shutdown_connections 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f2349130740 1 --2- 172.21.15.2:0/1298203859 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x55c4dff25a50 0x55c4dff26ec0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f2349130740 1 --2- 172.21.15.2:0/1298203859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff14fc0 0x55c4dff120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f2349130740 1 --2- 172.21.15.2:0/1298203859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 0x55c4dff11b60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f2349130740 1 --2- 172.21.15.2:0/1298203859 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff058b0 0x55c4dff147c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f231ffff640 0 client.15024 ms_handle_reset on v2:172.21.15.112:6838/1380244119 2024-09-15T23:14:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f2349130740 1 -- 172.21.15.2:0/1298203859 >> 172.21.15.2:0/1298203859 conn(0x55c4dff01f60 msgr2=0x55c4dff07cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f2349130740 1 -- 172.21.15.2:0/1298203859 shutdown_connections 2024-09-15T23:14:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f2349130740 1 -- 172.21.15.2:0/1298203859 wait complete. 2024-09-15T23:14:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.774+0000 7f2349130740 20 client.15024 trim_cache size 0 max 16384 2024-09-15T23:14:16.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f2349130740 1 Processor -- start 2024-09-15T23:14:16.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f2349130740 1 -- start start 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f2349130740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff058b0 0x55c4dff26ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f2349130740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 0x55c4dff0d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f2349130740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff14fc0 0x55c4dff0edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f2349130740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c4dff25200 con 0x55c4dff061d0 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f2349130740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c4dff258d0 con 0x55c4dff14fc0 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f2349130740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c4dff25fa0 con 0x55c4dff058b0 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f233ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 0x55c4dff0d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f233ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 0x55c4dff0d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45320/0 (socket says 172.21.15.2:45320) 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f233ffff640 1 -- 172.21.15.2:0/3643866679 learned_addr learned my addr 172.21.15.2:0/3643866679 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f233ffff640 1 -- 172.21.15.2:0/3643866679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff058b0 msgr2=0x55c4dff26ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f233ffff640 1 --2- 172.21.15.2:0/3643866679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff058b0 0x55c4dff26ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f233ffff640 1 -- 172.21.15.2:0/3643866679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff14fc0 msgr2=0x55c4dff0edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f233ffff640 1 --2- 172.21.15.2:0/3643866679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff14fc0 0x55c4dff0edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f233ffff640 1 -- 172.21.15.2:0/3643866679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4dff14b30 con 0x55c4dff061d0 2024-09-15T23:14:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.792+0000 7f233ffff640 1 --2- 172.21.15.2:0/3643866679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 0x55c4dff0d130 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f232c004e70 tx=0x7f232c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c831b57151feda server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.793+0000 7f232a7fc640 1 -- 172.21.15.2:0/3643866679 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c035030 con 0x55c4dff061d0 2024-09-15T23:14:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.793+0000 7f232a7fc640 1 -- 172.21.15.2:0/3643866679 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f232c005850 con 0x55c4dff061d0 2024-09-15T23:14:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.793+0000 7f232a7fc640 1 -- 172.21.15.2:0/3643866679 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c0319a0 con 0x55c4dff061d0 2024-09-15T23:14:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.793+0000 7f2349130740 1 -- 172.21.15.2:0/3643866679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 msgr2=0x55c4dff0d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.793+0000 7f2349130740 1 --2- 172.21.15.2:0/3643866679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 0x55c4dff0d130 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f232c004e70 tx=0x7f232c02a410 comp rx=0 tx=0).stop 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.793+0000 7f2349130740 1 -- 172.21.15.2:0/3643866679 shutdown_connections 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.793+0000 7f2349130740 1 --2- 172.21.15.2:0/3643866679 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff14fc0 0x55c4dff0edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.793+0000 7f2349130740 1 --2- 172.21.15.2:0/3643866679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff061d0 0x55c4dff0d130 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.793+0000 7f2349130740 1 --2- 172.21.15.2:0/3643866679 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff058b0 0x55c4dff26ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.793+0000 7f2349130740 1 -- 172.21.15.2:0/3643866679 >> 172.21.15.2:0/3643866679 conn(0x55c4dff01f60 msgr2=0x55c4dff0ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.793+0000 7f2349130740 1 -- 172.21.15.2:0/3643866679 shutdown_connections 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.793+0000 7f2349130740 1 -- 172.21.15.2:0/3643866679 wait complete. 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f2349130740 1 -- start start 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f2349130740 1 Processor -- start 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f2349130740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff058b0 0x55c4dff28e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f2349130740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff061d0 0x55c4dff29340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f2349130740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff14fc0 0x55c4dff29880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f2349130740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c4dff26d40 con 0x55c4dff14fc0 2024-09-15T23:14:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f2349130740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c4dff26670 con 0x55c4dff058b0 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f2349130740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c4dff27410 con 0x55c4dff061d0 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f2349130740 10 client.0 _ll_register_callbacks cb 0x7f232c005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f23452f4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff14fc0 0x55c4dff29880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f23452f4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff14fc0 0x55c4dff29880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45334/0 (socket says 172.21.15.2:45334) 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f23452f4640 1 -- 172.21.15.2:0/3671944014 learned_addr learned my addr 172.21.15.2:0/3671944014 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f2344af3640 1 --2- 172.21.15.2:0/3671944014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff058b0 0x55c4dff28e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.794+0000 7f233ffff640 1 --2- 172.21.15.2:0/3671944014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff061d0 0x55c4dff29340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f23452f4640 1 -- 172.21.15.2:0/3671944014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff061d0 msgr2=0x55c4dff29340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f23452f4640 1 --2- 172.21.15.2:0/3671944014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff061d0 0x55c4dff29340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f23452f4640 1 -- 172.21.15.2:0/3671944014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff058b0 msgr2=0x55c4dff28e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f23452f4640 1 --2- 172.21.15.2:0/3671944014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff058b0 0x55c4dff28e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f23452f4640 1 -- 172.21.15.2:0/3671944014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4dff2d5f0 con 0x55c4dff14fc0 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f23452f4640 1 --2- 172.21.15.2:0/3671944014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff14fc0 0x55c4dff29880 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f23380114f0 tx=0x7f2338011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3983a5197d8a842a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f231ffff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-15T23:14:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f231ffff640 1 -- 172.21.15.2:0/3671944014 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338011e60 con 0x55c4dff14fc0 2024-09-15T23:14:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f2349130740 1 -- 172.21.15.2:0/3671944014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f232c005850 con 0x55c4dff14fc0 2024-09-15T23:14:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f231ffff640 1 -- 172.21.15.2:0/3671944014 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f2338003b80 con 0x55c4dff14fc0 2024-09-15T23:14:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f231ffff640 1 -- 172.21.15.2:0/3671944014 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2338013520 con 0x55c4dff14fc0 2024-09-15T23:14:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f2349130740 10 client.15030 fetch_fsmap learned FSMap version 20 2024-09-15T23:14:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f2349130740 1 -- 172.21.15.2:0/3671944014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c4dff903e0 con 0x55c4dff14fc0 2024-09-15T23:14:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f231ffff640 1 -- 172.21.15.2:0/3671944014 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f232c005850 con 0x55c4dff14fc0 2024-09-15T23:14:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.795+0000 7f231ffff640 1 -- 172.21.15.2:0/3671944014 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f233800f040 con 0x55c4dff14fc0 2024-09-15T23:14:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f2349130740 10 client.15030 fetch_fsmap finished waiting for FSMap version 20 2024-09-15T23:14:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f2349130740 10 client.15030 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T23:14:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f2349130740 20 client.15030 populate_metadata read hostname 'smithi002' 2024-09-15T23:14:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f2349130740 1 --2- 172.21.15.2:0/3671944014 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x55c4dff94de0 0x55c4dff93af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f2349130740 4 client.15030 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f2349130740 1 -- 172.21.15.2:0/3671944014 --> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] -- command(tid 0: {"prefix": "status"}) -- 0x55c4dfe73b10 con 0x55c4dff94de0 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f2344af3640 1 --2- 172.21.15.2:0/3671944014 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x55c4dff94de0 0x55c4dff93af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f2344af3640 1 --2- 172.21.15.2:0/3671944014 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x55c4dff94de0 0x55c4dff93af0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1768089600779705 server_cookie=b38c7fce4c06628e in_seq=0 out_seq=0 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f231ffff640 10 client.15030 ms_handle_connect on v2:172.21.15.112:6838/1380244119 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f231ffff640 1 -- 172.21.15.2:0/3671944014 <== mds.0 v2:172.21.15.112:6838/1380244119 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c4dfe73b10 con 0x55c4dff94de0 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f231ffff640 10 client.15030 handle_command_reply: tid=0 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f2349130740 1 client.15030 shutdown 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f2349130740 1 -- 172.21.15.2:0/3671944014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff14fc0 msgr2=0x55c4dff29880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.796+0000 7f2349130740 1 --2- 172.21.15.2:0/3671944014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff14fc0 0x55c4dff29880 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f23380114f0 tx=0x7f2338011cf0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2349130740 1 -- 172.21.15.2:0/3671944014 shutdown_connections 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2349130740 1 --2- 172.21.15.2:0/3671944014 >> [v2:172.21.15.112:6838/1380244119,v1:172.21.15.112:6839/1380244119] conn(0x55c4dff94de0 0x55c4dff93af0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2349130740 1 --2- 172.21.15.2:0/3671944014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c4dff14fc0 0x55c4dff29880 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2349130740 1 --2- 172.21.15.2:0/3671944014 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4dff061d0 0x55c4dff29340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f231ffff640 0 client.15030 ms_handle_reset on v2:172.21.15.112:6838/1380244119 2024-09-15T23:14:16.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2349130740 1 --2- 172.21.15.2:0/3671944014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c4dff058b0 0x55c4dff28e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2349130740 1 -- 172.21.15.2:0/3671944014 >> 172.21.15.2:0/3671944014 conn(0x55c4dff01f60 msgr2=0x55c4dff073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:16.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2349130740 1 -- 172.21.15.2:0/3671944014 shutdown_connections 2024-09-15T23:14:16.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2349130740 1 -- 172.21.15.2:0/3671944014 wait complete. 2024-09-15T23:14:16.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2349130740 20 client.15030 trim_cache size 0 max 16384 2024-09-15T23:14:16.803 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-15T23:14:16.803 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "cb7ab3ae-73b6-11ef-bceb-c7b262605968", 2024-09-15T23:14:16.803 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-15T23:14:16.803 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24464, 2024-09-15T23:14:16.804 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-15T23:14:16.804 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-15T23:14:16.804 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-15T23:14:16.804 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 94.066604416000004, 2024-09-15T23:14:16.804 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 20, 2024-09-15T23:14:16.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 83, 2024-09-15T23:14:16.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 81, 2024-09-15T23:14:16.804 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 105.14296588400001 2024-09-15T23:14:16.804 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-15T23:14:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2346d57640 1 -- 172.21.15.2:0/1009051456 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23300a32c0 msgr2=0x7f23300a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2346d57640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23300a32c0 0x7f23300a5780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2338021000 tx=0x7f233801e000 comp rx=0 tx=0).stop 2024-09-15T23:14:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2346d57640 1 -- 172.21.15.2:0/1009051456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340101df0 msgr2=0x7f23401983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2346d57640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340101df0 0x7f23401983b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f233400c920 tx=0x7f233400cde0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2346d57640 1 -- 172.21.15.2:0/1009051456 shutdown_connections 2024-09-15T23:14:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.797+0000 7f2346d57640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f23300a32c0 0x7f23300a5780 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.798+0000 7f2346d57640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2340106f20 0x7f234019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.798+0000 7f2346d57640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23401027a0 0x7f23401988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.798+0000 7f2346d57640 1 --2- 172.21.15.2:0/1009051456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340101df0 0x7f23401983b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.798+0000 7f2346d57640 1 -- 172.21.15.2:0/1009051456 >> 172.21.15.2:0/1009051456 conn(0x7f23400fd8f0 msgr2=0x7f23400feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.798+0000 7f2346d57640 1 -- 172.21.15.2:0/1009051456 shutdown_connections 2024-09-15T23:14:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:16.798+0000 7f2346d57640 1 -- 172.21.15.2:0/1009051456 wait complete. 2024-09-15T23:14:17.493 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:17 smithi002 ceph-mon[31019]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:14:17.522 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T23:14:17.532 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T23:14:17.532 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T23:14:17.533 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T23:14:17.533 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-15T23:14:17.533 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T23:14:17.534 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-15T23:14:17.534 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-15T23:14:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.638+0000 7f4c9fa82640 1 -- 172.21.15.2:0/1526521659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c98102610 msgr2=0x7f4c98108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.638+0000 7f4c9fa82640 1 --2- 172.21.15.2:0/1526521659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c98102610 0x7f4c98108ea0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009ca0 tx=0x7f4c9002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:14:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 -- 172.21.15.2:0/1526521659 shutdown_connections 2024-09-15T23:14:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 --2- 172.21.15.2:0/1526521659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c98102610 0x7f4c98108ea0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 --2- 172.21.15.2:0/1526521659 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c98101c50 0x7f4c981020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 --2- 172.21.15.2:0/1526521659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c98100a60 0x7f4c98100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 -- 172.21.15.2:0/1526521659 >> 172.21.15.2:0/1526521659 conn(0x7f4c980fc1e0 msgr2=0x7f4c980fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 -- 172.21.15.2:0/1526521659 shutdown_connections 2024-09-15T23:14:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 -- 172.21.15.2:0/1526521659 wait complete. 2024-09-15T23:14:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 Processor -- start 2024-09-15T23:14:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 -- start start 2024-09-15T23:14:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c98100a60 0x7f4c981049f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:17.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c98101c50 0x7f4c98103030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c98102610 0x7f4c98103570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9810c690 con 0x7f4c98101c50 2024-09-15T23:14:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9810c510 con 0x7f4c98102610 2024-09-15T23:14:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.639+0000 7f4c9fa82640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9810c810 con 0x7f4c98100a60 2024-09-15T23:14:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c9d01d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c98101c50 0x7f4c98103030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c9d01d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c98101c50 0x7f4c98103030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45342/0 (socket says 172.21.15.2:45342) 2024-09-15T23:14:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c9d01d640 1 -- 172.21.15.2:0/3023479031 learned_addr learned my addr 172.21.15.2:0/3023479031 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c9d81e640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c98100a60 0x7f4c981049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c9e01f640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c98102610 0x7f4c98103570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c9d01d640 1 -- 172.21.15.2:0/3023479031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c98100a60 msgr2=0x7f4c981049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c9d01d640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c98100a60 0x7f4c981049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c9d01d640 1 -- 172.21.15.2:0/3023479031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c98102610 msgr2=0x7f4c98103570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:17.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c9d01d640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c98102610 0x7f4c98103570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c9d01d640 1 -- 172.21.15.2:0/3023479031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c98103e00 con 0x7f4c98101c50 2024-09-15T23:14:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c9d01d640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c98101c50 0x7f4c98103030 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800b4a0 tx=0x7f4c8800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c8effd640 1 -- 172.21.15.2:0/3023479031 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88014070 con 0x7f4c98101c50 2024-09-15T23:14:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c8effd640 1 -- 172.21.15.2:0/3023479031 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4c88010ac0 con 0x7f4c98101c50 2024-09-15T23:14:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c9fa82640 1 -- 172.21.15.2:0/3023479031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c981a1ed0 con 0x7f4c98101c50 2024-09-15T23:14:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c8effd640 1 -- 172.21.15.2:0/3023479031 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88017c30 con 0x7f4c98101c50 2024-09-15T23:14:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.640+0000 7f4c9fa82640 1 -- 172.21.15.2:0/3023479031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c981a23c0 con 0x7f4c98101c50 2024-09-15T23:14:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.641+0000 7f4c9fa82640 1 -- 172.21.15.2:0/3023479031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c981a26b0 con 0x7f4c98101c50 2024-09-15T23:14:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.642+0000 7f4c8effd640 1 -- 172.21.15.2:0/3023479031 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4c88017070 con 0x7f4c98101c50 2024-09-15T23:14:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.643+0000 7f4c8effd640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f4c840a3370 0x7f4c840a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.643+0000 7f4c9d81e640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f4c840a3370 0x7f4c840a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.643+0000 7f4c8effd640 1 -- 172.21.15.2:0/3023479031 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f4c880cf190 con 0x7f4c98101c50 2024-09-15T23:14:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.644+0000 7f4c9d81e640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f4c840a3370 0x7f4c840a5830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4c98101ab0 tx=0x7f4c94008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.646+0000 7f4c8effd640 1 -- 172.21.15.2:0/3023479031 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c8809be90 con 0x7f4c98101c50 2024-09-15T23:14:17.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:17 smithi145 ceph-mon[34901]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:14:17.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:17 smithi112 ceph-mon[34367]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:14:17.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:17.876+0000 7f4c9fa82640 1 -- 172.21.15.2:0/3023479031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f4c981a2880 con 0x7f4c98101c50 2024-09-15T23:14:18.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:18.320+0000 7f4c8effd640 1 -- 172.21.15.2:0/3023479031 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f4c8809b790 con 0x7f4c98101c50 2024-09-15T23:14:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:18.324+0000 7f4c9fa82640 1 -- 172.21.15.2:0/3023479031 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f4c840a3370 msgr2=0x7f4c840a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:18.324+0000 7f4c9fa82640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f4c840a3370 0x7f4c840a5830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4c98101ab0 tx=0x7f4c94008040 comp rx=0 tx=0).stop 2024-09-15T23:14:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:18.324+0000 7f4c9fa82640 1 -- 172.21.15.2:0/3023479031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c98101c50 msgr2=0x7f4c98103030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:18.324+0000 7f4c9fa82640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c98101c50 0x7f4c98103030 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800b4a0 tx=0x7f4c8800b960 comp rx=0 tx=0).stop 2024-09-15T23:14:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:18.324+0000 7f4c9fa82640 1 -- 172.21.15.2:0/3023479031 shutdown_connections 2024-09-15T23:14:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:18.324+0000 7f4c9fa82640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f4c840a3370 0x7f4c840a5830 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:18.324+0000 7f4c9fa82640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4c98102610 0x7f4c98103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:18.324+0000 7f4c9fa82640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c98101c50 0x7f4c98103030 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:18.324+0000 7f4c9fa82640 1 --2- 172.21.15.2:0/3023479031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4c98100a60 0x7f4c981049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:18.324+0000 7f4c9fa82640 1 -- 172.21.15.2:0/3023479031 >> 172.21.15.2:0/3023479031 conn(0x7f4c980fc1e0 msgr2=0x7f4c980fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:18.325+0000 7f4c9fa82640 1 -- 172.21.15.2:0/3023479031 shutdown_connections 2024-09-15T23:14:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:18.325+0000 7f4c9fa82640 1 -- 172.21.15.2:0/3023479031 wait complete. 2024-09-15T23:14:18.343 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-15T23:14:18.369 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-15T23:14:18.369 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-15T23:14:18.369 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-15T23:14:18.370 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:14:18.370 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:18.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:18.370 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-15T23:14:18.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:18.389 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-15T23:14:18.457 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-09-15T23:14:18.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:14:18.459 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-15T23:14:18.459 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-15T23:14:18.459 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-15T23:14:18.676 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:18 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3023479031' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-15T23:14:18.677 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:18 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: ignoring --setuser ceph since I am not root 2024-09-15T23:14:18.677 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:18 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: ignoring --setgroup ceph since I am not root 2024-09-15T23:14:18.677 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:18 smithi145 ceph-mgr[36712]: -- 172.21.15.145:0/3383877028 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bc47c8d0e0 con 0x55bc47c6a800 2024-09-15T23:14:18.677 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:18 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:18.470+0000 7f4c78fad040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:14:18.677 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:18 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:18.526+0000 7f4c78fad040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:14:18.677 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:18 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:18.673+0000 7f4c78fad040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:14:18.678 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:18 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3023479031' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-15T23:14:18.678 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: ignoring --setuser ceph since I am not root 2024-09-15T23:14:18.678 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: ignoring --setgroup ceph since I am not root 2024-09-15T23:14:18.678 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:18 smithi112 ceph-mgr[35735]: -- 172.21.15.112:0/686727905 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55df712f70e0 con 0x55df712d4800 2024-09-15T23:14:18.678 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:18.472+0000 7f3f3be41040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:14:18.678 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:18.528+0000 7f3f3be41040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:14:18.678 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:18.676+0000 7f3f3be41040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:14:18.706 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:18 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3023479031' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-15T23:14:18.707 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:18 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: ignoring --setuser ceph since I am not root 2024-09-15T23:14:18.707 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:18 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: ignoring --setgroup ceph since I am not root 2024-09-15T23:14:18.707 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:18 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:18.482+0000 7f823d98f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:14:18.707 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:18 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:18.543+0000 7f823d98f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:14:18.707 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:18 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:18.705+0000 7f823d98f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:14:18.763 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:14:18.957 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:18 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:18.739+0000 7f4c78fad040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:14:18.957 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:18 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:18.884+0000 7f4c78fad040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:14:18.996 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:18.743+0000 7f3f3be41040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:14:18.996 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:18.890+0000 7f3f3be41040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:14:19.041 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:18 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:18.784+0000 7f823d98f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:14:19.041 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:18 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:18.942+0000 7f823d98f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:14:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.263+0000 7ff79fdfa640 1 -- 172.21.15.2:0/500320713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7981008e0 msgr2=0x7ff798100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:19.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.263+0000 7ff79fdfa640 1 --2- 172.21.15.2:0/500320713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7981008e0 0x7ff798100cc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff794009900 tx=0x7ff79402a410 comp rx=0 tx=0).stop 2024-09-15T23:14:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.263+0000 7ff79fdfa640 1 -- 172.21.15.2:0/500320713 shutdown_connections 2024-09-15T23:14:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.263+0000 7ff79fdfa640 1 --2- 172.21.15.2:0/500320713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff79810e490 0x7ff798110880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.263+0000 7ff79fdfa640 1 --2- 172.21.15.2:0/500320713 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff798101290 0x7ff79810df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.263+0000 7ff79fdfa640 1 --2- 172.21.15.2:0/500320713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7981008e0 0x7ff798100cc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.263+0000 7ff79fdfa640 1 -- 172.21.15.2:0/500320713 >> 172.21.15.2:0/500320713 conn(0x7ff7980fc7d0 msgr2=0x7ff7980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.263+0000 7ff79fdfa640 1 -- 172.21.15.2:0/500320713 shutdown_connections 2024-09-15T23:14:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.263+0000 7ff79fdfa640 1 -- 172.21.15.2:0/500320713 wait complete. 2024-09-15T23:14:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.263+0000 7ff79fdfa640 1 Processor -- start 2024-09-15T23:14:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.263+0000 7ff79fdfa640 1 -- start start 2024-09-15T23:14:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79fdfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7981008e0 0x7ff79819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79fdfa640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff798101290 0x7ff79819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79fdfa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff79810e490 0x7ff79819ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79fdfa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff798114050 con 0x7ff7981008e0 2024-09-15T23:14:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79fdfa640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff798113ed0 con 0x7ff79810e490 2024-09-15T23:14:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79fdfa640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff7981141d0 con 0x7ff798101290 2024-09-15T23:14:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79db96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7981008e0 0x7ff79819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79db96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7981008e0 0x7ff79819a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45378/0 (socket says 172.21.15.2:45378) 2024-09-15T23:14:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79db96640 1 -- 172.21.15.2:0/77316081 learned_addr learned my addr 172.21.15.2:0/77316081 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79e397640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff79810e490 0x7ff79819ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79d395640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff798101290 0x7ff79819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79db96640 1 -- 172.21.15.2:0/77316081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff798101290 msgr2=0x7ff79819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79db96640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff798101290 0x7ff79819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79db96640 1 -- 172.21.15.2:0/77316081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff79810e490 msgr2=0x7ff79819ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79db96640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff79810e490 0x7ff79819ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79db96640 1 -- 172.21.15.2:0/77316081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79819f530 con 0x7ff7981008e0 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79e397640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff79810e490 0x7ff79819ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.264+0000 7ff79db96640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7981008e0 0x7ff79819a580 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff794005940 tx=0x7ff7940040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.265+0000 7ff78effd640 1 -- 172.21.15.2:0/77316081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79403f030 con 0x7ff7981008e0 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.265+0000 7ff79fdfa640 1 -- 172.21.15.2:0/77316081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff79819f7c0 con 0x7ff7981008e0 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.265+0000 7ff78effd640 1 -- 172.21.15.2:0/77316081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff7940044c0 con 0x7ff7981008e0 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.265+0000 7ff78effd640 1 -- 172.21.15.2:0/77316081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff794035070 con 0x7ff7981008e0 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.265+0000 7ff79fdfa640 1 -- 172.21.15.2:0/77316081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7981a7100 con 0x7ff7981008e0 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.266+0000 7ff79fdfa640 1 -- 172.21.15.2:0/77316081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff798100cc0 con 0x7ff7981008e0 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.267+0000 7ff78effd640 1 -- 172.21.15.2:0/77316081 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) ==== 138371+0+0 (secure 0 0 0) 0x7ff794042030 con 0x7ff7981008e0 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.268+0000 7ff78effd640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff7840a3290 0x7ff7840a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.268+0000 7ff79d395640 1 -- 172.21.15.2:0/77316081 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff7840a3290 msgr2=0x7ff7840a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2564114882 2024-09-15T23:14:19.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.268+0000 7ff78effd640 1 -- 172.21.15.2:0/77316081 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7ff7940effe0 con 0x7ff7981008e0 2024-09-15T23:14:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.268+0000 7ff79d395640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff7840a3290 0x7ff7840a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:14:19.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.271+0000 7ff78effd640 1 -- 172.21.15.2:0/77316081 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7940bc690 con 0x7ff7981008e0 2024-09-15T23:14:19.308 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:19 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:19.096+0000 7f823d98f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:14:19.322 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:19 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:19.028+0000 7f4c78fad040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:14:19.322 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:19 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:19.032+0000 7f3f3be41040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:14:19.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.469+0000 7ff79d395640 1 -- 172.21.15.2:0/77316081 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff7840a3290 msgr2=0x7ff7840a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2564114882 2024-09-15T23:14:19.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.469+0000 7ff79d395640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff7840a3290 0x7ff7840a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:14:19.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.491+0000 7ff79fdfa640 1 -- 172.21.15.2:0/77316081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff798109620 con 0x7ff7981008e0 2024-09-15T23:14:19.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.491+0000 7ff78effd640 1 -- 172.21.15.2:0/77316081 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7ff7940c0990 con 0x7ff7981008e0 2024-09-15T23:14:19.493 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:14:19.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.493+0000 7ff79fdfa640 1 -- 172.21.15.2:0/77316081 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff7840a3290 msgr2=0x7ff7840a5750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:14:19.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.493+0000 7ff79fdfa640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff7840a3290 0x7ff7840a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:19.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.493+0000 7ff79fdfa640 1 -- 172.21.15.2:0/77316081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7981008e0 msgr2=0x7ff79819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:19.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.493+0000 7ff79fdfa640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7981008e0 0x7ff79819a580 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff794005940 tx=0x7ff7940040c0 comp rx=0 tx=0).stop 2024-09-15T23:14:19.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.493+0000 7ff79fdfa640 1 -- 172.21.15.2:0/77316081 shutdown_connections 2024-09-15T23:14:19.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.493+0000 7ff79fdfa640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7ff7840a3290 0x7ff7840a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:19.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.493+0000 7ff79fdfa640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff79810e490 0x7ff79819ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:19.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.493+0000 7ff79fdfa640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff798101290 0x7ff79819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:19.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.493+0000 7ff79fdfa640 1 --2- 172.21.15.2:0/77316081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7981008e0 0x7ff79819a580 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:19.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.493+0000 7ff79fdfa640 1 -- 172.21.15.2:0/77316081 >> 172.21.15.2:0/77316081 conn(0x7ff7980fc7d0 msgr2=0x7ff7980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:19.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.494+0000 7ff79fdfa640 1 -- 172.21.15.2:0/77316081 shutdown_connections 2024-09-15T23:14:19.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:19.494+0000 7ff79fdfa640 1 -- 172.21.15.2:0/77316081 wait complete. 2024-09-15T23:14:19.585 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:19 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3023479031' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-15T23:14:19.585 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:19 smithi145 ceph-mon[34901]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-15T23:14:19.585 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:19 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:19.340+0000 7f4c78fad040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:14:19.585 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:19 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:19.401+0000 7f4c78fad040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:14:19.585 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:19 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:19.583+0000 7f4c78fad040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:14:19.590 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:19 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3023479031' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-15T23:14:19.590 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:19 smithi112 ceph-mon[34367]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-15T23:14:19.590 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:19 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:19.345+0000 7f3f3be41040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:14:19.591 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:19 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:19.405+0000 7f3f3be41040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:14:19.591 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:19 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:19.589+0000 7f3f3be41040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:14:19.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:19 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3023479031' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-15T23:14:19.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:19 smithi002 ceph-mon[31019]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-15T23:14:19.698 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:19 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:19.434+0000 7f823d98f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:14:19.698 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:19 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:19.498+0000 7f823d98f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:14:19.698 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:19 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:19.696+0000 7f823d98f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:14:20.205 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:14:20.205 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:14:20.205 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-09-15T23:14:20.205 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:14:20.205 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:20.205 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:14:20.205 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:14:20.205 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:14:20.206 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:14:20.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:20.206 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-09-15T23:14:20.223 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:14:20.223 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:14:20.223 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:14:20.223 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:14:20.224 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-09-15T23:14:20.224 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:14:20.224 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:14:20.224 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:14:20.224 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-09-15T23:14:20.224 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:14:20.224 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:14:20.224 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-09-15T23:14:20.224 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:14:20.224 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:14:20.224 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-09-15T23:14:20.224 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-15T23:14:20.225 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42198sec preferred_lft 42198sec 2024-09-15T23:14:20.225 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-15T23:14:20.225 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:14:20.225 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:14:20.225 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:14:20.225 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-09-15T23:14:20.225 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T23:14:20.225 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:14:20.226 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-15T23:14:20.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-09-15T23:14:20.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-09-15T23:14:20.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-09-15T23:14:20.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T23:14:20.226 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-15T23:14:20.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:14:20.433 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:20 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/77316081' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T23:14:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:14:20.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:20.445 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:14:20.469 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-09-15T23:14:20.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:20.471 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-09-15T23:14:20.546 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-09-15T23:14:20.546 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:14:20.546 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-15T23:14:20.546 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-15T23:14:20.546 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:14:20.547 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:14:20.547 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-15T23:14:20.547 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T23:14:20.547 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T23:14:20.547 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T23:14:20.547 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-15T23:14:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:14:20.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:20 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/77316081' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T23:14:20.707 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:20 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:20.468+0000 7f4c78fad040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:14:20.707 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:20 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:20.534+0000 7f4c78fad040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:14:20.719 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:20 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:20.645+0000 7f823d98f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:14:20.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:20 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/77316081' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T23:14:20.746 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:20 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:20.470+0000 7f3f3be41040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:14:20.746 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:20 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:20.537+0000 7f3f3be41040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:14:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:14:20.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:20.855 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-15T23:14:20.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:20.871 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-09-15T23:14:20.927 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:14:20.927 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-15T23:14:20.927 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:14:20.927 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T23:14:20.927 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-15T23:14:21.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:14:21.026 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:20 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:20.718+0000 7f823d98f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:14:21.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:14:21.048 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T23:14:21.049 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:14:21.049 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-15T23:14:21.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T23:14:21.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T23:14:21.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T23:14:21.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T23:14:21.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T23:14:21.049 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-15T23:14:21.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:14:21.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:14:21.186 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:14:21.186 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-15T23:14:21.186 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-09-15T23:14:21.186 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T23:14:21.186 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-15T23:14:21.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:14:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:14:21.267 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-15T23:14:21.267 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:14:21.267 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:21.284 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:14:21.285 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:14:21.285 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:21.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-15T23:14:21.411 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:14:21.468 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-15T23:14:21.468 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-15T23:14:21.468 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-15T23:14:21.468 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-15T23:14:21.468 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-15T23:14:21.469 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-15T23:14:21.469 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-15T23:14:21.469 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-15T23:14:21.469 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-15T23:14:21.469 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-15T23:14:21.469 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-15T23:14:21.469 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-15T23:14:21.469 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:14:21.469 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-15T23:14:21.469 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-15T23:14:21.469 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-15T23:14:21.470 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-15T23:14:21.470 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-15T23:14:21.470 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-15T23:14:21.470 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:14:21.470 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:14:21.470 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:14:21.470 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:14:21.470 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-15T23:14:21.470 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-15T23:14:21.470 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-09-15T23:14:21.470 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/d7981117a7a7ae506ab5c6f0d16133f1e3f651d7cc8dc811e8b32f23a2e022aa/merged 2024-09-15T23:14:21.470 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/f84b0f0892584941714f70884cf8d429f0aab2638d81a04cd47b0b1075b071a8/merged 2024-09-15T23:14:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-09-15T23:14:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:14:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/dfda242a617f980ee98f85dec2dd939aef50e8edddc6e414020d0db96e9da7c2/merged 2024-09-15T23:14:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/5801e5dc4e2f4c7419ae99404bb2629d2eed7754d615c51712310ea52c363ec4/merged 2024-09-15T23:14:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/20b1612438a1242bfb2d6727a42e52cdb34692d6ca3ea9757eaa4218d207ba9c/merged 2024-09-15T23:14:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/86a4a318f31c4accc1516618ca87ad553dcf5a9e95bdca888f0dc76fc27c7031/merged 2024-09-15T23:14:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/5f851a571909136aea86e86ab4506fdc9451e89d6f77124617502cf02d56b982/merged 2024-09-15T23:14:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/077639d4c4236b68c54fbc98d9b1f24988846da32720970276ca783014893712/merged 2024-09-15T23:14:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/c5ac72b05160b36a452a07c452dfbdfe00c3a72dbb4fe8d66ef0f9563f95409f/merged 2024-09-15T23:14:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/02061c625ed2ec139d94edbc1df77f3a44000eac8094610850b8dbe73967e87f/merged 2024-09-15T23:14:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-15T23:14:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:14:21.471 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:14:21.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:21.472 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-15T23:14:21.496 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:21.244+0000 7f3f3be41040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:14:21.496 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:21.359+0000 7f3f3be41040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:14:21.503 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:21.242+0000 7f4c78fad040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:14:21.503 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:21.358+0000 7f4c78fad040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:14:21.525 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:14:21.526 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/feb3a3b8-51fb-4030-9ca4-6f5bffc6040f --client_fs=cephfs) 2024-09-15T23:14:21.569 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-15T23:14:21.596 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:14:21.652 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-15T23:14:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-15T23:14:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-15T23:14:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-15T23:14:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-15T23:14:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-15T23:14:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:14:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:14:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:14:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:14:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-15T23:14:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-15T23:14:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-09-15T23:14:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/d7981117a7a7ae506ab5c6f0d16133f1e3f651d7cc8dc811e8b32f23a2e022aa/merged 2024-09-15T23:14:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/f84b0f0892584941714f70884cf8d429f0aab2638d81a04cd47b0b1075b071a8/merged 2024-09-15T23:14:21.655 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-09-15T23:14:21.655 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:14:21.655 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/dfda242a617f980ee98f85dec2dd939aef50e8edddc6e414020d0db96e9da7c2/merged 2024-09-15T23:14:21.655 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/5801e5dc4e2f4c7419ae99404bb2629d2eed7754d615c51712310ea52c363ec4/merged 2024-09-15T23:14:21.655 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/20b1612438a1242bfb2d6727a42e52cdb34692d6ca3ea9757eaa4218d207ba9c/merged 2024-09-15T23:14:21.655 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/86a4a318f31c4accc1516618ca87ad553dcf5a9e95bdca888f0dc76fc27c7031/merged 2024-09-15T23:14:21.655 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/5f851a571909136aea86e86ab4506fdc9451e89d6f77124617502cf02d56b982/merged 2024-09-15T23:14:21.655 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/077639d4c4236b68c54fbc98d9b1f24988846da32720970276ca783014893712/merged 2024-09-15T23:14:21.655 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/c5ac72b05160b36a452a07c452dfbdfe00c3a72dbb4fe8d66ef0f9563f95409f/merged 2024-09-15T23:14:21.655 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/02061c625ed2ec139d94edbc1df77f3a44000eac8094610850b8dbe73967e87f/merged 2024-09-15T23:14:21.655 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-15T23:14:21.655 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:14:21.655 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:14:21.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:21.656 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-15T23:14:21.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2024-09-15T23:14:21.708+0000 7faab0c19480 -1 init, newargv = 0x564a52d89d80 newargc=15 2024-09-15T23:14:21.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[79014]: starting ceph client 2024-09-15T23:14:21.716 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[79014]: starting fuse 2024-09-15T23:14:21.779 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:21.496+0000 7f823d98f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:14:21.780 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:21.622+0000 7f823d98f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:14:21.783 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:21.502+0000 7f3f3be41040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:14:21.783 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:21.564+0000 7f3f3be41040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:14:21.783 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:21.713+0000 7f3f3be41040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:14:21.783 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:21.781+0000 7f3f3be41040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:14:21.784 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:21.502+0000 7f4c78fad040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:14:21.784 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:21.564+0000 7f4c78fad040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:14:21.784 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:21.715+0000 7f4c78fad040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:14:21.784 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:21.783+0000 7f4c78fad040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:14:22.058 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:21.778+0000 7f823d98f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:14:22.058 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:21.842+0000 7f823d98f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:14:22.058 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:22.000+0000 7f823d98f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:14:22.067 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:21.841+0000 7f3f3be41040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:14:22.067 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:22 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:22.001+0000 7f3f3be41040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:14:22.067 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:22 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:22.066+0000 7f3f3be41040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:14:22.068 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:21.842+0000 7f4c78fad040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:14:22.068 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:22.001+0000 7f4c78fad040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:14:22.068 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:22.067+0000 7f4c78fad040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:14:22.332 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:22 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:22.132+0000 7f3f3be41040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:14:22.332 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:22 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:22.214+0000 7f3f3be41040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:14:22.332 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:22 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:22.272+0000 7f3f3be41040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:14:22.332 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:22 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:22.330+0000 7f3f3be41040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:14:22.333 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:22.133+0000 7f4c78fad040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:14:22.333 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:22.215+0000 7f4c78fad040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:14:22.333 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:22.273+0000 7f4c78fad040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:14:22.333 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:22.332+0000 7f4c78fad040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:14:22.370 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:22.072+0000 7f823d98f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:14:22.370 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:22.134+0000 7f823d98f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:14:22.370 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:22.301+0000 7f823d98f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:14:22.649 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:22.369+0000 7f823d98f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:14:22.649 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:22.438+0000 7f823d98f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:14:22.650 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:22.524+0000 7f823d98f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:14:22.650 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:22.586+0000 7f823d98f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:14:22.811 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-15T23:14:22.839 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:14:22.896 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-15T23:14:22.896 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-15T23:14:22.896 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-15T23:14:22.896 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-15T23:14:22.896 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-15T23:14:22.896 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-15T23:14:22.896 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-15T23:14:22.896 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-15T23:14:22.896 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-15T23:14:22.896 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-15T23:14:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-15T23:14:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-15T23:14:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:14:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-15T23:14:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-15T23:14:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-15T23:14:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-15T23:14:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-15T23:14:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-15T23:14:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:14:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:14:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:14:22.897 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/d7981117a7a7ae506ab5c6f0d16133f1e3f651d7cc8dc811e8b32f23a2e022aa/merged 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/f84b0f0892584941714f70884cf8d429f0aab2638d81a04cd47b0b1075b071a8/merged 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/dfda242a617f980ee98f85dec2dd939aef50e8edddc6e414020d0db96e9da7c2/merged 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/5801e5dc4e2f4c7419ae99404bb2629d2eed7754d615c51712310ea52c363ec4/merged 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/20b1612438a1242bfb2d6727a42e52cdb34692d6ca3ea9757eaa4218d207ba9c/merged 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/86a4a318f31c4accc1516618ca87ad553dcf5a9e95bdca888f0dc76fc27c7031/merged 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/5f851a571909136aea86e86ab4506fdc9451e89d6f77124617502cf02d56b982/merged 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/077639d4c4236b68c54fbc98d9b1f24988846da32720970276ca783014893712/merged 2024-09-15T23:14:22.898 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/c5ac72b05160b36a452a07c452dfbdfe00c3a72dbb4fe8d66ef0f9563f95409f/merged 2024-09-15T23:14:22.899 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/02061c625ed2ec139d94edbc1df77f3a44000eac8094610850b8dbe73967e87f/merged 2024-09-15T23:14:22.899 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-15T23:14:22.899 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:14:22.899 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:14:22.899 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:22.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:22.899 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-15T23:14:22.952 INFO:teuthology.orchestra.run.smithi002.stdout:120 2024-09-15T23:14:22.952 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-15T23:14:22.952 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:14:22.952 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2024-09-15T23:14:22.952 DEBUG:teuthology.orchestra.run.smithi002:> import re 2024-09-15T23:14:22.952 DEBUG:teuthology.orchestra.run.smithi002:> import os 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2024-09-15T23:14:22.953 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:14:22.954 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:14:22.954 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:14:22.954 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2024-09-15T23:14:22.954 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2024-09-15T23:14:22.954 DEBUG:teuthology.orchestra.run.smithi002:> return f 2024-09-15T23:14:22.954 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:14:22.954 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-15T23:14:22.954 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2024-09-15T23:14:22.954 DEBUG:teuthology.orchestra.run.smithi002:> ' 2024-09-15T23:14:23.014 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:22.648+0000 7f823d98f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:14:23.073 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.79014.asok 2024-09-15T23:14:23.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:14:23.084 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.79014.asok 2024-09-15T23:14:23.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:23.085 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.79014.asok status 2024-09-15T23:14:23.228 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-15T23:14:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2024-09-15T23:14:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:14:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:14:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2024-09-15T23:14:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2024-09-15T23:14:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:14:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "79014", 2024-09-15T23:14:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/volumes/qa/sv_0/feb3a3b8-51fb-4030-9ca4-6f5bffc6040f" 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 15066, 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 15066 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 908619670 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:14:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 908619670 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.15066 192.168.0.1:0/908619670", 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/908619670", 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 5, 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 20, 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 83, 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2024-09-15T23:14:23.230 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-15T23:14:23.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:23.237 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2024-09-15T23:14:23.237 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:23.254 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2024-09-15T23:14:23.254 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:23.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:23.254 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-mon[31019]: Standby manager daemon z restarted 2024-09-15T23:14:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-mon[31019]: Standby manager daemon z started 2024-09-15T23:14:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-mon[31019]: Standby manager daemon y restarted 2024-09-15T23:14:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-mon[31019]: Standby manager daemon y started 2024-09-15T23:14:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.112:0/3020724651' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T23:14:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.145:0/3744128097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T23:14:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.112:0/3020724651' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:14:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.145:0/3744128097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:14:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.145:0/3744128097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T23:14:23.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.112:0/3020724651' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T23:14:23.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.145:0/3744128097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:14:23.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-mon[31019]: from='mgr.? 172.21.15.112:0/3020724651' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:14:23.322 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-15T23:14:23.334 INFO:teuthology.run_tasks:Running task exec... 2024-09-15T23:14:23.372 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T23:14:23.373 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-15T23:14:23.373 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-15T23:14:23.457 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:14:23 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z[36708]: 2024-09-15T23:14:23.122+0000 7f4c78fad040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:14:23.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:23 smithi145 ceph-mon[34901]: Standby manager daemon z restarted 2024-09-15T23:14:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:23 smithi145 ceph-mon[34901]: Standby manager daemon z started 2024-09-15T23:14:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:23 smithi145 ceph-mon[34901]: Standby manager daemon y restarted 2024-09-15T23:14:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:23 smithi145 ceph-mon[34901]: Standby manager daemon y started 2024-09-15T23:14:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:23 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.112:0/3020724651' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T23:14:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:23 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.145:0/3744128097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T23:14:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:23 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.112:0/3020724651' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:14:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:23 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.145:0/3744128097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:14:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:23 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.145:0/3744128097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T23:14:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:23 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.112:0/3020724651' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T23:14:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:23 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.145:0/3744128097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:14:23.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:23 smithi145 ceph-mon[34901]: from='mgr.? 172.21.15.112:0/3020724651' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:14:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.479+0000 7f68551fd640 1 -- 172.21.15.2:0/359148342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6850104fb0 msgr2=0x7f68501073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.479+0000 7f68551fd640 1 --2- 172.21.15.2:0/359148342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6850104fb0 0x7f68501073a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6838009900 tx=0x7f683802a410 comp rx=0 tx=0).stop 2024-09-15T23:14:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.479+0000 7f68551fd640 1 -- 172.21.15.2:0/359148342 shutdown_connections 2024-09-15T23:14:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.479+0000 7f68551fd640 1 --2- 172.21.15.2:0/359148342 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68501078e0 0x7f6850109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.479+0000 7f68551fd640 1 --2- 172.21.15.2:0/359148342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6850104fb0 0x7f68501073a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.479+0000 7f68551fd640 1 --2- 172.21.15.2:0/359148342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6850102680 0x7f6850104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.479+0000 7f68551fd640 1 -- 172.21.15.2:0/359148342 >> 172.21.15.2:0/359148342 conn(0x7f68500fc1e0 msgr2=0x7f68500fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.479+0000 7f68551fd640 1 -- 172.21.15.2:0/359148342 shutdown_connections 2024-09-15T23:14:23.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.479+0000 7f68551fd640 1 -- 172.21.15.2:0/359148342 wait complete. 2024-09-15T23:14:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.479+0000 7f68551fd640 1 Processor -- start 2024-09-15T23:14:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f68551fd640 1 -- start start 2024-09-15T23:14:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f68551fd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6850102680 0x7f6850197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f68551fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6850104fb0 0x7f68501982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f68551fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68501078e0 0x7f685019f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f68551fd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f685010d670 con 0x7f68501078e0 2024-09-15T23:14:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f68551fd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f685010d4f0 con 0x7f6850104fb0 2024-09-15T23:14:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f68551fd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f685010d7f0 con 0x7f6850102680 2024-09-15T23:14:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f684f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68501078e0 0x7f685019f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f684f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68501078e0 0x7f685019f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45388/0 (socket says 172.21.15.2:45388) 2024-09-15T23:14:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f684f59e640 1 -- 172.21.15.2:0/4068827337 learned_addr learned my addr 172.21.15.2:0/4068827337 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f684659c640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6850104fb0 0x7f68501982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f684ed9d640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6850102680 0x7f6850197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f684f59e640 1 -- 172.21.15.2:0/4068827337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6850102680 msgr2=0x7f6850197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f684f59e640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6850102680 0x7f6850197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f684f59e640 1 -- 172.21.15.2:0/4068827337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6850104fb0 msgr2=0x7f68501982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f684f59e640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6850104fb0 0x7f68501982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f684f59e640 1 -- 172.21.15.2:0/4068827337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f685019f9b0 con 0x7f68501078e0 2024-09-15T23:14:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.480+0000 7f684ed9d640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6850102680 0x7f6850197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.481+0000 7f684f59e640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68501078e0 0x7f685019f310 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f684800eaa0 tx=0x7f684800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.481+0000 7f684cd99640 1 -- 172.21.15.2:0/4068827337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684800cdb0 con 0x7f68501078e0 2024-09-15T23:14:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.481+0000 7f684cd99640 1 -- 172.21.15.2:0/4068827337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6848005020 con 0x7f68501078e0 2024-09-15T23:14:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.481+0000 7f68551fd640 1 -- 172.21.15.2:0/4068827337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f685019fca0 con 0x7f68501078e0 2024-09-15T23:14:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.481+0000 7f684cd99640 1 -- 172.21.15.2:0/4068827337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68480116d0 con 0x7f68501078e0 2024-09-15T23:14:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.481+0000 7f68551fd640 1 -- 172.21.15.2:0/4068827337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68501a01a0 con 0x7f68501078e0 2024-09-15T23:14:23.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.482+0000 7f68551fd640 1 -- 172.21.15.2:0/4068827337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68500fdcd0 con 0x7f68501078e0 2024-09-15T23:14:23.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.484+0000 7f684cd99640 1 -- 172.21.15.2:0/4068827337 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 138371+0+0 (secure 0 0 0) 0x7f68480051d0 con 0x7f68501078e0 2024-09-15T23:14:23.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.484+0000 7f684cd99640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f683c0a3340 0x7f683c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.484+0000 7f684ed9d640 1 -- 172.21.15.2:0/4068827337 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f683c0a3340 msgr2=0x7f683c0a5800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2564114882 2024-09-15T23:14:23.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.484+0000 7f684cd99640 1 -- 172.21.15.2:0/4068827337 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f68480cfc30 con 0x7f68501078e0 2024-09-15T23:14:23.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.484+0000 7f684ed9d640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f683c0a3340 0x7f683c0a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:14:23.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.489+0000 7f684cd99640 1 -- 172.21.15.2:0/4068827337 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6848016030 con 0x7f68501078e0 2024-09-15T23:14:23.496 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:14:23 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y[35731]: 2024-09-15T23:14:23.122+0000 7f3f3be41040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:14:23.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:23 smithi112 ceph-mon[34367]: Standby manager daemon z restarted 2024-09-15T23:14:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:23 smithi112 ceph-mon[34367]: Standby manager daemon z started 2024-09-15T23:14:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:23 smithi112 ceph-mon[34367]: Standby manager daemon y restarted 2024-09-15T23:14:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:23 smithi112 ceph-mon[34367]: Standby manager daemon y started 2024-09-15T23:14:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:23 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.112:0/3020724651' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T23:14:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:23 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.145:0/3744128097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T23:14:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:23 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.112:0/3020724651' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:14:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:23 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.145:0/3744128097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:14:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:23 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.145:0/3744128097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T23:14:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:23 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.112:0/3020724651' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T23:14:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:23 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.145:0/3744128097' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:14:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:23 smithi112 ceph-mon[34367]: from='mgr.? 172.21.15.112:0/3020724651' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:14:23.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.516+0000 7f684cd99640 1 -- 172.21.15.2:0/4068827337 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 21) ==== 138040+0+0 (secure 0 0 0) 0x7f6848098810 con 0x7f68501078e0 2024-09-15T23:14:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.516+0000 7f684cd99640 1 -- 172.21.15.2:0/4068827337 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f683c0a3340 msgr2=0x7f683c0a5800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:14:23.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.516+0000 7f684cd99640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f683c0a3340 0x7f683c0a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.745+0000 7f68551fd640 1 -- 172.21.15.2:0/4068827337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f685002d7c0 con 0x7f68501078e0 2024-09-15T23:14:23.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.749+0000 7f684cd99640 1 -- 172.21.15.2:0/4068827337 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v29)=0 v29) ==== 129+0+0 (secure 0 0 0) 0x7f684809c930 con 0x7f68501078e0 2024-09-15T23:14:23.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.752+0000 7f68551fd640 1 -- 172.21.15.2:0/4068827337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68501078e0 msgr2=0x7f685019f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.752+0000 7f68551fd640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68501078e0 0x7f685019f310 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f684800eaa0 tx=0x7f684800ef60 comp rx=0 tx=0).stop 2024-09-15T23:14:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.752+0000 7f68551fd640 1 -- 172.21.15.2:0/4068827337 shutdown_connections 2024-09-15T23:14:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.752+0000 7f68551fd640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.2:6800/2564114882,v1:172.21.15.2:6801/2564114882] conn(0x7f683c0a3340 0x7f683c0a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.752+0000 7f68551fd640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68501078e0 0x7f685019f310 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.752+0000 7f68551fd640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6850104fb0 0x7f68501982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.752+0000 7f68551fd640 1 --2- 172.21.15.2:0/4068827337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6850102680 0x7f6850197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.752+0000 7f68551fd640 1 -- 172.21.15.2:0/4068827337 >> 172.21.15.2:0/4068827337 conn(0x7f68500fc1e0 msgr2=0x7f68501030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.753+0000 7f68551fd640 1 -- 172.21.15.2:0/4068827337 shutdown_connections 2024-09-15T23:14:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.753+0000 7f68551fd640 1 -- 172.21.15.2:0/4068827337 wait complete. 2024-09-15T23:14:23.768 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:23.503+0000 7f823d98f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:14:23.769 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-15T23:14:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.924+0000 7fbf79c53640 1 -- 172.21.15.2:0/2248495566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf741013c0 msgr2=0x7fbf74101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.924+0000 7fbf79c53640 1 --2- 172.21.15.2:0/2248495566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf741013c0 0x7fbf74101840 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009900 tx=0x7fbf6802a3f0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.924+0000 7fbf79c53640 1 -- 172.21.15.2:0/2248495566 shutdown_connections 2024-09-15T23:14:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.925+0000 7fbf79c53640 1 --2- 172.21.15.2:0/2248495566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf74101d80 0x7fbf74108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.925+0000 7fbf79c53640 1 --2- 172.21.15.2:0/2248495566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf741013c0 0x7fbf74101840 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.925+0000 7fbf79c53640 1 --2- 172.21.15.2:0/2248495566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf741001d0 0x7fbf741005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.925+0000 7fbf79c53640 1 -- 172.21.15.2:0/2248495566 >> 172.21.15.2:0/2248495566 conn(0x7fbf740fb930 msgr2=0x7fbf740fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.925+0000 7fbf79c53640 1 -- 172.21.15.2:0/2248495566 shutdown_connections 2024-09-15T23:14:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.925+0000 7fbf79c53640 1 -- 172.21.15.2:0/2248495566 wait complete. 2024-09-15T23:14:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.926+0000 7fbf79c53640 1 Processor -- start 2024-09-15T23:14:23.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.927+0000 7fbf79c53640 1 -- start start 2024-09-15T23:14:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.927+0000 7fbf79c53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf741001d0 0x7fbf74195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.927+0000 7fbf79c53640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf741013c0 0x7fbf74196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.927+0000 7fbf737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf741001d0 0x7fbf74195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.927+0000 7fbf79c53640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf74101d80 0x7fbf7419d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.927+0000 7fbf79c53640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7410b520 con 0x7fbf741001d0 2024-09-15T23:14:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.927+0000 7fbf79c53640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7410b3a0 con 0x7fbf74101d80 2024-09-15T23:14:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.927+0000 7fbf72ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf741013c0 0x7fbf74196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.927+0000 7fbf79c53640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7410b6a0 con 0x7fbf741013c0 2024-09-15T23:14:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.927+0000 7fbf72ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf741013c0 0x7fbf74196090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.2:40112/0 (socket says 172.21.15.2:40112) 2024-09-15T23:14:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.927+0000 7fbf72ffd640 1 -- 172.21.15.2:0/574352590 learned_addr learned my addr 172.21.15.2:0/574352590 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.928+0000 7fbf73fff640 1 --2- 172.21.15.2:0/574352590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf74101d80 0x7fbf7419d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.928+0000 7fbf72ffd640 1 -- 172.21.15.2:0/574352590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf74101d80 msgr2=0x7fbf7419d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.928+0000 7fbf72ffd640 1 --2- 172.21.15.2:0/574352590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf74101d80 0x7fbf7419d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.928+0000 7fbf72ffd640 1 -- 172.21.15.2:0/574352590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf741001d0 msgr2=0x7fbf74195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.928+0000 7fbf72ffd640 1 --2- 172.21.15.2:0/574352590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf741001d0 0x7fbf74195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.928+0000 7fbf72ffd640 1 -- 172.21.15.2:0/574352590 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7419f980 con 0x7fbf741013c0 2024-09-15T23:14:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.928+0000 7fbf737fe640 1 --2- 172.21.15.2:0/574352590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf741001d0 0x7fbf74195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.928+0000 7fbf72ffd640 1 --2- 172.21.15.2:0/574352590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf741013c0 0x7fbf74196090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf680314e0 tx=0x7fbf68003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.928+0000 7fbf70ff9640 1 -- 172.21.15.2:0/574352590 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6803f070 con 0x7fbf741013c0 2024-09-15T23:14:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.928+0000 7fbf70ff9640 1 -- 172.21.15.2:0/574352590 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf68031c40 con 0x7fbf741013c0 2024-09-15T23:14:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.928+0000 7fbf70ff9640 1 -- 172.21.15.2:0/574352590 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68035030 con 0x7fbf741013c0 2024-09-15T23:14:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.928+0000 7fbf79c53640 1 -- 172.21.15.2:0/574352590 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7419fc10 con 0x7fbf741013c0 2024-09-15T23:14:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.929+0000 7fbf79c53640 1 -- 172.21.15.2:0/574352590 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf7419fff0 con 0x7fbf741013c0 2024-09-15T23:14:23.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.930+0000 7fbf79c53640 1 -- 172.21.15.2:0/574352590 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf74107570 con 0x7fbf741013c0 2024-09-15T23:14:23.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.931+0000 7fbf70ff9640 1 -- 172.21.15.2:0/574352590 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 21) ==== 138040+0+0 (secure 0 0 0) 0x7fbf68042070 con 0x7fbf741013c0 2024-09-15T23:14:23.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.932+0000 7fbf70ff9640 1 -- 172.21.15.2:0/574352590 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8527+0+0 (secure 0 0 0) 0x7fbf680efd90 con 0x7fbf741013c0 2024-09-15T23:14:23.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:23.936+0000 7fbf70ff9640 1 -- 172.21.15.2:0/574352590 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf680bcd30 con 0x7fbf741013c0 2024-09-15T23:14:24.046 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:23.801+0000 7f81a77a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:14:24.046 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:23.801+0000 7f81a77a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:14:24.046 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:23.801+0000 7f81a77a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:14:24.046 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:23.801+0000 7f81a77a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:14:24.046 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:23.801+0000 7f81a77a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:14:24.046 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:23.802+0000 7f81a47a0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:14:24.046 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:23.802+0000 7f81a47a0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:14:24.047 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:23.802+0000 7f81a47a0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:14:24.047 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:23.802+0000 7f81a47a0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:14:24.047 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:23.802+0000 7f81a47a0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:14:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.140+0000 7fbf79c53640 1 -- 172.21.15.2:0/574352590 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fbf74062df0 con 0x7fbf741013c0 2024-09-15T23:14:24.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.145+0000 7fbf70ff9640 1 -- 172.21.15.2:0/574352590 <== mon.1 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v30)=0 v30) ==== 138+0+0 (secure 0 0 0) 0x7fbf680bc630 con 0x7fbf741013c0 2024-09-15T23:14:24.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.148+0000 7fbf79c53640 1 -- 172.21.15.2:0/574352590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf741013c0 msgr2=0x7fbf74196090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.148+0000 7fbf79c53640 1 --2- 172.21.15.2:0/574352590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf741013c0 0x7fbf74196090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf680314e0 tx=0x7fbf68003c10 comp rx=0 tx=0).stop 2024-09-15T23:14:24.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.149+0000 7fbf79c53640 1 -- 172.21.15.2:0/574352590 shutdown_connections 2024-09-15T23:14:24.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.149+0000 7fbf79c53640 1 --2- 172.21.15.2:0/574352590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf74101d80 0x7fbf7419d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.149+0000 7fbf79c53640 1 --2- 172.21.15.2:0/574352590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbf741013c0 0x7fbf74196090 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.149+0000 7fbf79c53640 1 --2- 172.21.15.2:0/574352590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf741001d0 0x7fbf74195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.149+0000 7fbf79c53640 1 -- 172.21.15.2:0/574352590 >> 172.21.15.2:0/574352590 conn(0x7fbf740fb930 msgr2=0x7fbf74104740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:24.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.149+0000 7fbf79c53640 1 -- 172.21.15.2:0/574352590 shutdown_connections 2024-09-15T23:14:24.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.149+0000 7fbf79c53640 1 -- 172.21.15.2:0/574352590 wait complete. 2024-09-15T23:14:24.164 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-15T23:14:24.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.272+0000 7fcbc9242640 1 -- 172.21.15.2:0/3053108270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc4102660 msgr2=0x7fcbc4104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.272+0000 7fcbc9242640 1 --2- 172.21.15.2:0/3053108270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc4102660 0x7fcbc4104a50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009900 tx=0x7fcbb402a410 comp rx=0 tx=0).stop 2024-09-15T23:14:24.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.272+0000 7fcbc9242640 1 -- 172.21.15.2:0/3053108270 shutdown_connections 2024-09-15T23:14:24.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.272+0000 7fcbc9242640 1 --2- 172.21.15.2:0/3053108270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc41078c0 0x7fcbc4109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.272+0000 7fcbc9242640 1 --2- 172.21.15.2:0/3053108270 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbc4104f90 0x7fcbc4107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.272+0000 7fcbc9242640 1 --2- 172.21.15.2:0/3053108270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc4102660 0x7fcbc4104a50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.272+0000 7fcbc9242640 1 -- 172.21.15.2:0/3053108270 >> 172.21.15.2:0/3053108270 conn(0x7fcbc40fc1e0 msgr2=0x7fcbc40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:24.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.272+0000 7fcbc9242640 1 -- 172.21.15.2:0/3053108270 shutdown_connections 2024-09-15T23:14:24.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.272+0000 7fcbc9242640 1 -- 172.21.15.2:0/3053108270 wait complete. 2024-09-15T23:14:24.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.273+0000 7fcbc9242640 1 Processor -- start 2024-09-15T23:14:24.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.273+0000 7fcbc9242640 1 -- start start 2024-09-15T23:14:24.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.273+0000 7fcbc9242640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc4102660 0x7fcbc4197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:24.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.273+0000 7fcbc9242640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc4104f90 0x7fcbc41982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.273+0000 7fcbc9242640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbc41078c0 0x7fcbc419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.273+0000 7fcbc9242640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc410d6b0 con 0x7fcbc4104f90 2024-09-15T23:14:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.273+0000 7fcbc9242640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc410d530 con 0x7fcbc4102660 2024-09-15T23:14:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.273+0000 7fcbc9242640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc410d830 con 0x7fcbc41078c0 2024-09-15T23:14:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc4104f90 0x7fcbc41982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc4104f90 0x7fcbc41982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45552/0 (socket says 172.21.15.2:45552) 2024-09-15T23:14:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc259c640 1 -- 172.21.15.2:0/3684202915 learned_addr learned my addr 172.21.15.2:0/3684202915 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc4102660 0x7fcbc4197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc359e640 1 --2- 172.21.15.2:0/3684202915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbc41078c0 0x7fcbc419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc259c640 1 -- 172.21.15.2:0/3684202915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbc41078c0 msgr2=0x7fcbc419f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc259c640 1 --2- 172.21.15.2:0/3684202915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbc41078c0 0x7fcbc419f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc259c640 1 -- 172.21.15.2:0/3684202915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc4102660 msgr2=0x7fcbc4197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc259c640 1 --2- 172.21.15.2:0/3684202915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc4102660 0x7fcbc4197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc259c640 1 -- 172.21.15.2:0/3684202915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc419f9b0 con 0x7fcbc4104f90 2024-09-15T23:14:24.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc2d9d640 1 --2- 172.21.15.2:0/3684202915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc4102660 0x7fcbc4197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:24.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc259c640 1 --2- 172.21.15.2:0/3684202915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc4104f90 0x7fcbc41982e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800e9f0 tx=0x7fcbb800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:24.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbabfff640 1 -- 172.21.15.2:0/3684202915 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb800ccc0 con 0x7fcbc4104f90 2024-09-15T23:14:24.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc9242640 1 -- 172.21.15.2:0/3684202915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc419fca0 con 0x7fcbc4104f90 2024-09-15T23:14:24.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbabfff640 1 -- 172.21.15.2:0/3684202915 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcbb80054d0 con 0x7fcbc4104f90 2024-09-15T23:14:24.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbabfff640 1 -- 172.21.15.2:0/3684202915 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8010430 con 0x7fcbc4104f90 2024-09-15T23:14:24.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.274+0000 7fcbc9242640 1 -- 172.21.15.2:0/3684202915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc41a01a0 con 0x7fcbc4104f90 2024-09-15T23:14:24.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.276+0000 7fcbc9242640 1 -- 172.21.15.2:0/3684202915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc40fdcd0 con 0x7fcbc4104f90 2024-09-15T23:14:24.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.277+0000 7fcbabfff640 1 -- 172.21.15.2:0/3684202915 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 21) ==== 138040+0+0 (secure 0 0 0) 0x7fcbb8005020 con 0x7fcbc4104f90 2024-09-15T23:14:24.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.278+0000 7fcbabfff640 1 -- 172.21.15.2:0/3684202915 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8527+0+0 (secure 0 0 0) 0x7fcbb80cf8f0 con 0x7fcbc4104f90 2024-09-15T23:14:24.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.282+0000 7fcbabfff640 1 -- 172.21.15.2:0/3684202915 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcbb809c8f0 con 0x7fcbc4104f90 2024-09-15T23:14:24.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-09-15T23:14:24.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: Active manager daemon x restarted 2024-09-15T23:14:24.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: Activating manager daemon x 2024-09-15T23:14:24.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T23:14:24.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: mgrmap e21: x(active, starting, since 0.012009s), standbys: z, y 2024-09-15T23:14:24.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:14:24.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:14:24.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:14:24.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T23:14:24.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T23:14:24.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T23:14:24.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T23:14:24.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T23:14:24.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T23:14:24.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T23:14:24.309 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T23:14:24.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T23:14:24.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T23:14:24.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:14:24.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:14:24.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T23:14:24.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T23:14:24.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T23:14:24.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:14:24.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:14:24.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:14:24.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:14:24.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:14:24.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:14:24.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:14:24.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:14:24.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:14:24.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:14:24.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:14:24.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:14:24.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T23:14:24.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T23:14:24.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T23:14:24.311 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: Manager daemon x is now available 2024-09-15T23:14:24.312 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:14:24.312 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T23:14:24.312 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T23:14:24.312 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/4068827337' entity='client.admin' 2024-09-15T23:14:24.312 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:24 smithi002 ceph-mon[31019]: from='client.? ' entity='client.admin' 2024-09-15T23:14:24.322 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-09-15T23:14:24.322 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: Active manager daemon x restarted 2024-09-15T23:14:24.322 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: Activating manager daemon x 2024-09-15T23:14:24.322 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T23:14:24.322 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: mgrmap e21: x(active, starting, since 0.012009s), standbys: z, y 2024-09-15T23:14:24.323 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:14:24.323 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:14:24.323 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:14:24.323 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T23:14:24.323 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T23:14:24.323 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T23:14:24.323 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T23:14:24.323 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T23:14:24.323 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T23:14:24.323 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T23:14:24.323 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T23:14:24.323 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T23:14:24.323 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T23:14:24.324 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:14:24.324 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:14:24.324 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T23:14:24.324 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T23:14:24.324 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T23:14:24.324 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:14:24.324 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:14:24.324 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:14:24.324 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:14:24.324 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:14:24.324 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:14:24.325 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:14:24.325 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:14:24.325 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:14:24.325 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:14:24.325 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:14:24.325 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:14:24.325 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T23:14:24.325 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T23:14:24.325 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T23:14:24.325 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: Manager daemon x is now available 2024-09-15T23:14:24.325 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:14:24.325 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T23:14:24.326 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T23:14:24.326 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/4068827337' entity='client.admin' 2024-09-15T23:14:24.326 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:24 smithi145 ceph-mon[34901]: from='client.? ' entity='client.admin' 2024-09-15T23:14:24.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.468+0000 7fcbc9242640 1 -- 172.21.15.2:0/3684202915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fcbc402d7c0 con 0x7fcbc4104f90 2024-09-15T23:14:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.472+0000 7fcbabfff640 1 -- 172.21.15.2:0/3684202915 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v31)=0 v31) ==== 133+0+0 (secure 0 0 0) 0x7fcbb809c1f0 con 0x7fcbc4104f90 2024-09-15T23:14:24.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.475+0000 7fcbc9242640 1 -- 172.21.15.2:0/3684202915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc4104f90 msgr2=0x7fcbc41982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.475+0000 7fcbc9242640 1 --2- 172.21.15.2:0/3684202915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc4104f90 0x7fcbc41982e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800e9f0 tx=0x7fcbb800eeb0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.475+0000 7fcbc9242640 1 -- 172.21.15.2:0/3684202915 shutdown_connections 2024-09-15T23:14:24.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.475+0000 7fcbc9242640 1 --2- 172.21.15.2:0/3684202915 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcbc41078c0 0x7fcbc419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.475+0000 7fcbc9242640 1 --2- 172.21.15.2:0/3684202915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc4104f90 0x7fcbc41982e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.475+0000 7fcbc9242640 1 --2- 172.21.15.2:0/3684202915 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbc4102660 0x7fcbc4197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.475+0000 7fcbc9242640 1 -- 172.21.15.2:0/3684202915 >> 172.21.15.2:0/3684202915 conn(0x7fcbc40fc1e0 msgr2=0x7fcbc4102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:24.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.475+0000 7fcbc9242640 1 -- 172.21.15.2:0/3684202915 shutdown_connections 2024-09-15T23:14:24.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.475+0000 7fcbc9242640 1 -- 172.21.15.2:0/3684202915 wait complete. 2024-09-15T23:14:24.491 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-15T23:14:24.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-09-15T23:14:24.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: Active manager daemon x restarted 2024-09-15T23:14:24.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: Activating manager daemon x 2024-09-15T23:14:24.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T23:14:24.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: mgrmap e21: x(active, starting, since 0.012009s), standbys: z, y 2024-09-15T23:14:24.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:14:24.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:14:24.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:14:24.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T23:14:24.498 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T23:14:24.499 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:14:24.499 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:14:24.499 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:14:24.499 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:14:24.499 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:14:24.499 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:14:24.499 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:14:24.499 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:14:24.499 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:14:24.499 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:14:24.499 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:14:24.499 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:14:24.500 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T23:14:24.500 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T23:14:24.500 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T23:14:24.500 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: Manager daemon x is now available 2024-09-15T23:14:24.500 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:14:24.500 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T23:14:24.500 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T23:14:24.500 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/4068827337' entity='client.admin' 2024-09-15T23:14:24.500 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:24 smithi112 ceph-mon[34367]: from='client.? ' entity='client.admin' 2024-09-15T23:14:24.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.613+0000 7f0083277640 1 -- 172.21.15.2:0/4042557851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007c107820 msgr2=0x7f007c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.613+0000 7f0083277640 1 --2- 172.21.15.2:0/4042557851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007c107820 0x7f007c109c90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0074009ca0 tx=0x7f007402a8c0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.613+0000 7f0083277640 1 -- 172.21.15.2:0/4042557851 shutdown_connections 2024-09-15T23:14:24.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.613+0000 7f0083277640 1 --2- 172.21.15.2:0/4042557851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007c107820 0x7f007c109c90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.613+0000 7f0083277640 1 --2- 172.21.15.2:0/4042557851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f007c104ef0 0x7f007c1072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.613+0000 7f0083277640 1 --2- 172.21.15.2:0/4042557851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f007c1025c0 0x7f007c1049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.613+0000 7f0083277640 1 -- 172.21.15.2:0/4042557851 >> 172.21.15.2:0/4042557851 conn(0x7f007c0fc1e0 msgr2=0x7f007c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.613+0000 7f0083277640 1 -- 172.21.15.2:0/4042557851 shutdown_connections 2024-09-15T23:14:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.613+0000 7f0083277640 1 -- 172.21.15.2:0/4042557851 wait complete. 2024-09-15T23:14:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0083277640 1 Processor -- start 2024-09-15T23:14:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0083277640 1 -- start start 2024-09-15T23:14:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0083277640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f007c1025c0 0x7f007c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0083277640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f007c104ef0 0x7f007c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0083277640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007c107820 0x7f007c19f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0083277640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f007c10d710 con 0x7f007c107820 2024-09-15T23:14:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0083277640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f007c10d590 con 0x7f007c104ef0 2024-09-15T23:14:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0083277640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f007c10d890 con 0x7f007c1025c0 2024-09-15T23:14:24.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0081814640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007c107820 0x7f007c19f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0081814640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007c107820 0x7f007c19f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45572/0 (socket says 172.21.15.2:45572) 2024-09-15T23:14:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0081814640 1 -- 172.21.15.2:0/2497171938 learned_addr learned my addr 172.21.15.2:0/2497171938 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0081013640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f007c1025c0 0x7f007c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0080812640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f007c104ef0 0x7f007c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0081814640 1 -- 172.21.15.2:0/2497171938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f007c1025c0 msgr2=0x7f007c197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0081814640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f007c1025c0 0x7f007c197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0081814640 1 -- 172.21.15.2:0/2497171938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f007c104ef0 msgr2=0x7f007c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0081814640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f007c104ef0 0x7f007c1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0081814640 1 -- 172.21.15.2:0/2497171938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007c19f9c0 con 0x7f007c107820 2024-09-15T23:14:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.614+0000 7f0081814640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007c107820 0x7f007c19f320 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0074031040 tx=0x7f0074003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.615+0000 7f00727fc640 1 -- 172.21.15.2:0/2497171938 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074004040 con 0x7f007c107820 2024-09-15T23:14:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.615+0000 7f00727fc640 1 -- 172.21.15.2:0/2497171938 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0074004690 con 0x7f007c107820 2024-09-15T23:14:24.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.615+0000 7f0083277640 1 -- 172.21.15.2:0/2497171938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007c19fc50 con 0x7f007c107820 2024-09-15T23:14:24.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.615+0000 7f00727fc640 1 -- 172.21.15.2:0/2497171938 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074030ad0 con 0x7f007c107820 2024-09-15T23:14:24.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.615+0000 7f0083277640 1 -- 172.21.15.2:0/2497171938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f007c1a01a0 con 0x7f007c107820 2024-09-15T23:14:24.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.616+0000 7f0083277640 1 -- 172.21.15.2:0/2497171938 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007c0fdcd0 con 0x7f007c107820 2024-09-15T23:14:24.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.618+0000 7f00727fc640 1 -- 172.21.15.2:0/2497171938 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7f0074030c70 con 0x7f007c107820 2024-09-15T23:14:24.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.618+0000 7f00727fc640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f00680a3100 0x7f00680a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:24.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.618+0000 7f0081013640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f00680a3100 0x7f00680a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:24.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.618+0000 7f00727fc640 1 -- 172.21.15.2:0/2497171938 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8527+0+0 (secure 0 0 0) 0x7f00740f0e10 con 0x7f007c107820 2024-09-15T23:14:24.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.619+0000 7f0081013640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f00680a3100 0x7f00680a55c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f007c199280 tx=0x7f0078009110 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:24.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.622+0000 7f00727fc640 1 -- 172.21.15.2:0/2497171938 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00740bdd00 con 0x7f007c107820 2024-09-15T23:14:24.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.825+0000 7f0083277640 1 -- 172.21.15.2:0/2497171938 --> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f007c062630 con 0x7f00680a3100 2024-09-15T23:14:24.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.891+0000 7f00727fc640 1 -- 172.21.15.2:0/2497171938 <== mgr.15054 v2:172.21.15.2:6800/1306494062 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f007c062630 con 0x7f00680a3100 2024-09-15T23:14:24.892 INFO:teuthology.orchestra.run.smithi002.stdout:Schedule set for path / 2024-09-15T23:14:24.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.893+0000 7f0083277640 1 -- 172.21.15.2:0/2497171938 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f00680a3100 msgr2=0x7f00680a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.893+0000 7f0083277640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f00680a3100 0x7f00680a55c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f007c199280 tx=0x7f0078009110 comp rx=0 tx=0).stop 2024-09-15T23:14:24.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.893+0000 7f0083277640 1 -- 172.21.15.2:0/2497171938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007c107820 msgr2=0x7f007c19f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.893+0000 7f0083277640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007c107820 0x7f007c19f320 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0074031040 tx=0x7f0074003ba0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.893+0000 7f0083277640 1 -- 172.21.15.2:0/2497171938 shutdown_connections 2024-09-15T23:14:24.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.893+0000 7f0083277640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f00680a3100 0x7f00680a55c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.893+0000 7f0083277640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f007c107820 0x7f007c19f320 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.893+0000 7f0083277640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f007c104ef0 0x7f007c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.893+0000 7f0083277640 1 --2- 172.21.15.2:0/2497171938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f007c1025c0 0x7f007c197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.893+0000 7f0083277640 1 -- 172.21.15.2:0/2497171938 >> 172.21.15.2:0/2497171938 conn(0x7f007c0fc1e0 msgr2=0x7f007c102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:24.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.893+0000 7f0083277640 1 -- 172.21.15.2:0/2497171938 shutdown_connections 2024-09-15T23:14:24.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:24.893+0000 7f0083277640 1 -- 172.21.15.2:0/2497171938 wait complete. 2024-09-15T23:14:24.906 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-15T23:14:25.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.018+0000 7f7092552640 1 -- 172.21.15.2:0/841935631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f708c107820 msgr2=0x7f708c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.018+0000 7f7092552640 1 --2- 172.21.15.2:0/841935631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f708c107820 0x7f708c109c90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7084009ca0 tx=0x7f708402a8c0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.018+0000 7f7092552640 1 -- 172.21.15.2:0/841935631 shutdown_connections 2024-09-15T23:14:25.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.018+0000 7f7092552640 1 --2- 172.21.15.2:0/841935631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f708c107820 0x7f708c109c90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.018+0000 7f7092552640 1 --2- 172.21.15.2:0/841935631 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f708c104ef0 0x7f708c1072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.018+0000 7f7092552640 1 --2- 172.21.15.2:0/841935631 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f708c1025c0 0x7f708c1049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.018+0000 7f7092552640 1 -- 172.21.15.2:0/841935631 >> 172.21.15.2:0/841935631 conn(0x7f708c0fc1e0 msgr2=0x7f708c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:25.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.018+0000 7f7092552640 1 -- 172.21.15.2:0/841935631 shutdown_connections 2024-09-15T23:14:25.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.018+0000 7f7092552640 1 -- 172.21.15.2:0/841935631 wait complete. 2024-09-15T23:14:25.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7092552640 1 Processor -- start 2024-09-15T23:14:25.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7092552640 1 -- start start 2024-09-15T23:14:25.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7092552640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f708c1025c0 0x7f708c197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7092552640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f708c104ef0 0x7f708c198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7092552640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f708c107820 0x7f708c19f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7092552640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f708c10d6b0 con 0x7f708c107820 2024-09-15T23:14:25.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7092552640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f708c10d530 con 0x7f708c1025c0 2024-09-15T23:14:25.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7092552640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f708c10d830 con 0x7f708c104ef0 2024-09-15T23:14:25.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7090aef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f708c107820 0x7f708c19f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7090aef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f708c107820 0x7f708c19f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45584/0 (socket says 172.21.15.2:45584) 2024-09-15T23:14:25.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7090aef640 1 -- 172.21.15.2:0/1887786578 learned_addr learned my addr 172.21.15.2:0/1887786578 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:25.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f708b7fe640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f708c104ef0 0x7f708c198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f708bfff640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f708c1025c0 0x7f708c197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7090aef640 1 -- 172.21.15.2:0/1887786578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f708c104ef0 msgr2=0x7f708c198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7090aef640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f708c104ef0 0x7f708c198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7090aef640 1 -- 172.21.15.2:0/1887786578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f708c1025c0 msgr2=0x7f708c197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7090aef640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f708c1025c0 0x7f708c197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.019+0000 7f7090aef640 1 -- 172.21.15.2:0/1887786578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c19f960 con 0x7f708c107820 2024-09-15T23:14:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.020+0000 7f708b7fe640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f708c104ef0 0x7f708c198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.020+0000 7f708bfff640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f708c1025c0 0x7f708c197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.020+0000 7f7090aef640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f708c107820 0x7f708c19f2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7084031970 tx=0x7f7084009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.020+0000 7f70897fa640 1 -- 172.21.15.2:0/1887786578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084003c30 con 0x7f708c107820 2024-09-15T23:14:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.020+0000 7f70897fa640 1 -- 172.21.15.2:0/1887786578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7084003dd0 con 0x7f708c107820 2024-09-15T23:14:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.020+0000 7f7092552640 1 -- 172.21.15.2:0/1887786578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f708c19fbf0 con 0x7f708c107820 2024-09-15T23:14:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.020+0000 7f70897fa640 1 -- 172.21.15.2:0/1887786578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084030b80 con 0x7f708c107820 2024-09-15T23:14:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.020+0000 7f7092552640 1 -- 172.21.15.2:0/1887786578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f708c1a0190 con 0x7f708c107820 2024-09-15T23:14:25.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.021+0000 7f7092552640 1 -- 172.21.15.2:0/1887786578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f708c0fdcd0 con 0x7f708c107820 2024-09-15T23:14:25.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.022+0000 7f70897fa640 1 -- 172.21.15.2:0/1887786578 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7f7084004040 con 0x7f708c107820 2024-09-15T23:14:25.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.023+0000 7f70897fa640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f70740a3180 0x7f70740a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.023+0000 7f708bfff640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f70740a3180 0x7f70740a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.023+0000 7f70897fa640 1 -- 172.21.15.2:0/1887786578 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8527+0+0 (secure 0 0 0) 0x7f70840f0c50 con 0x7f708c107820 2024-09-15T23:14:25.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.023+0000 7f708bfff640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f70740a3180 0x7f70740a5640 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f707c009c20 tx=0x7f707c005f90 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.027+0000 7f70897fa640 1 -- 172.21.15.2:0/1887786578 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70840bdb90 con 0x7f708c107820 2024-09-15T23:14:25.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.227+0000 7f7092552640 1 -- 172.21.15.2:0/1887786578 --> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f708c0626d0 con 0x7f70740a3180 2024-09-15T23:14:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.281+0000 7f70897fa640 1 -- 172.21.15.2:0/1887786578 <== mgr.15054 v2:172.21.15.2:6800/1306494062 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f708c0626d0 con 0x7f70740a3180 2024-09-15T23:14:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:Retention added to path / 2024-09-15T23:14:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.283+0000 7f7092552640 1 -- 172.21.15.2:0/1887786578 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f70740a3180 msgr2=0x7f70740a5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.283+0000 7f7092552640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f70740a3180 0x7f70740a5640 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f707c009c20 tx=0x7f707c005f90 comp rx=0 tx=0).stop 2024-09-15T23:14:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.283+0000 7f7092552640 1 -- 172.21.15.2:0/1887786578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f708c107820 msgr2=0x7f708c19f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.283+0000 7f7092552640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f708c107820 0x7f708c19f2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7084031970 tx=0x7f7084009800 comp rx=0 tx=0).stop 2024-09-15T23:14:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.283+0000 7f7092552640 1 -- 172.21.15.2:0/1887786578 shutdown_connections 2024-09-15T23:14:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.283+0000 7f7092552640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f70740a3180 0x7f70740a5640 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.283+0000 7f7092552640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f708c107820 0x7f708c19f2f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.283+0000 7f7092552640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f708c104ef0 0x7f708c198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.283+0000 7f7092552640 1 --2- 172.21.15.2:0/1887786578 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f708c1025c0 0x7f708c197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.283+0000 7f7092552640 1 -- 172.21.15.2:0/1887786578 >> 172.21.15.2:0/1887786578 conn(0x7f708c0fc1e0 msgr2=0x7f708c102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.283+0000 7f7092552640 1 -- 172.21.15.2:0/1887786578 shutdown_connections 2024-09-15T23:14:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.283+0000 7f7092552640 1 -- 172.21.15.2:0/1887786578 wait complete. 2024-09-15T23:14:25.295 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-15T23:14:25.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.413+0000 7fc67c0e4640 1 -- 172.21.15.2:0/2137112627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc674107890 msgr2=0x7fc674109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.413+0000 7fc67c0e4640 1 --2- 172.21.15.2:0/2137112627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc674107890 0x7fc674109ca0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009ca0 tx=0x7fc66c02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.413+0000 7fc67c0e4640 1 -- 172.21.15.2:0/2137112627 shutdown_connections 2024-09-15T23:14:25.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.413+0000 7fc67c0e4640 1 --2- 172.21.15.2:0/2137112627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc674107890 0x7fc674109ca0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.413+0000 7fc67c0e4640 1 --2- 172.21.15.2:0/2137112627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc674104f60 0x7fc674107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.413+0000 7fc67c0e4640 1 --2- 172.21.15.2:0/2137112627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc674102630 0x7fc674104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.413+0000 7fc67c0e4640 1 -- 172.21.15.2:0/2137112627 >> 172.21.15.2:0/2137112627 conn(0x7fc6740fc1b0 msgr2=0x7fc6740fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:25.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.413+0000 7fc67c0e4640 1 -- 172.21.15.2:0/2137112627 shutdown_connections 2024-09-15T23:14:25.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.413+0000 7fc67c0e4640 1 -- 172.21.15.2:0/2137112627 wait complete. 2024-09-15T23:14:25.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.414+0000 7fc67c0e4640 1 Processor -- start 2024-09-15T23:14:25.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.414+0000 7fc67c0e4640 1 -- start start 2024-09-15T23:14:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.414+0000 7fc67c0e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc674102630 0x7fc674197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.414+0000 7fc67c0e4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc674104f60 0x7fc6741982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.414+0000 7fc67c0e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc674107890 0x7fc67419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.414+0000 7fc67c0e4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc67410d6c0 con 0x7fc674102630 2024-09-15T23:14:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.414+0000 7fc67c0e4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc67410d540 con 0x7fc674107890 2024-09-15T23:14:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.414+0000 7fc67c0e4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc67410d840 con 0x7fc674104f60 2024-09-15T23:14:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.414+0000 7fc679e80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc674102630 0x7fc674197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.414+0000 7fc679e80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc674102630 0x7fc674197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45600/0 (socket says 172.21.15.2:45600) 2024-09-15T23:14:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc67967f640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc674104f60 0x7fc6741982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc67a681640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc674107890 0x7fc67419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc679e80640 1 -- 172.21.15.2:0/558172181 learned_addr learned my addr 172.21.15.2:0/558172181 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc67967f640 1 -- 172.21.15.2:0/558172181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc674107890 msgr2=0x7fc67419f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc67967f640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc674107890 0x7fc67419f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc67967f640 1 -- 172.21.15.2:0/558172181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc674102630 msgr2=0x7fc674197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc67967f640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc674102630 0x7fc674197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc67967f640 1 -- 172.21.15.2:0/558172181 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67419f990 con 0x7fc674104f60 2024-09-15T23:14:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc67967f640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc674104f60 0x7fc6741982b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc66400e9c0 tx=0x7fc66400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc66affd640 1 -- 172.21.15.2:0/558172181 <== mon.1 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66400ccc0 con 0x7fc674104f60 2024-09-15T23:14:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc66affd640 1 -- 172.21.15.2:0/558172181 <== mon.1 v2:172.21.15.145:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc664005020 con 0x7fc674104f60 2024-09-15T23:14:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc67c0e4640 1 -- 172.21.15.2:0/558172181 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc67419fc80 con 0x7fc674104f60 2024-09-15T23:14:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc66affd640 1 -- 172.21.15.2:0/558172181 <== mon.1 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc664004a00 con 0x7fc674104f60 2024-09-15T23:14:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.415+0000 7fc67c0e4640 1 -- 172.21.15.2:0/558172181 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6741a01d0 con 0x7fc674104f60 2024-09-15T23:14:25.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.416+0000 7fc67c0e4640 1 -- 172.21.15.2:0/558172181 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6740fdca0 con 0x7fc674104f60 2024-09-15T23:14:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.418+0000 7fc66affd640 1 -- 172.21.15.2:0/558172181 <== mon.1 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7fc6640051d0 con 0x7fc674104f60 2024-09-15T23:14:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.418+0000 7fc66affd640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fc6600a3180 0x7fc6600a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.418+0000 7fc679e80640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fc6600a3180 0x7fc6600a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.418+0000 7fc66affd640 1 -- 172.21.15.2:0/558172181 <== mon.1 v2:172.21.15.145:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8527+0+0 (secure 0 0 0) 0x7fc6640cf8b0 con 0x7fc674104f60 2024-09-15T23:14:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.419+0000 7fc679e80640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fc6600a3180 0x7fc6600a5640 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc670009c90 tx=0x7fc670005f90 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:25.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.422+0000 7fc66affd640 1 -- 172.21.15.2:0/558172181 <== mon.1 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc66409c760 con 0x7fc674104f60 2024-09-15T23:14:25.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.648+0000 7fc67c0e4640 1 -- 172.21.15.2:0/558172181 --> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fc674062630 con 0x7fc6600a3180 2024-09-15T23:14:25.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.655+0000 7fc66affd640 1 -- 172.21.15.2:0/558172181 <== mgr.15054 v2:172.21.15.2:6800/1306494062 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fc674062630 con 0x7fc6600a3180 2024-09-15T23:14:25.657 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-15T00:00:00", "created": "2024-09-15T23:14:24", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.657+0000 7fc67c0e4640 1 -- 172.21.15.2:0/558172181 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fc6600a3180 msgr2=0x7fc6600a5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.657+0000 7fc67c0e4640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fc6600a3180 0x7fc6600a5640 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc670009c90 tx=0x7fc670005f90 comp rx=0 tx=0).stop 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.657+0000 7fc67c0e4640 1 -- 172.21.15.2:0/558172181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc674104f60 msgr2=0x7fc6741982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.657+0000 7fc67c0e4640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc674104f60 0x7fc6741982b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc66400e9c0 tx=0x7fc66400ee80 comp rx=0 tx=0).stop 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.657+0000 7fc67c0e4640 1 -- 172.21.15.2:0/558172181 shutdown_connections 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.657+0000 7fc67c0e4640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fc6600a3180 0x7fc6600a5640 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.657+0000 7fc67c0e4640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc674107890 0x7fc67419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.657+0000 7fc67c0e4640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc674104f60 0x7fc6741982b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.657+0000 7fc67c0e4640 1 --2- 172.21.15.2:0/558172181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc674102630 0x7fc674197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.657+0000 7fc67c0e4640 1 -- 172.21.15.2:0/558172181 >> 172.21.15.2:0/558172181 conn(0x7fc6740fc1b0 msgr2=0x7fc674102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.658+0000 7fc67c0e4640 1 -- 172.21.15.2:0/558172181 shutdown_connections 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.658+0000 7fc67c0e4640 1 -- 172.21.15.2:0/558172181 wait complete. 2024-09-15T23:14:25.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-15T23:14:25.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:25 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3684202915' entity='client.admin' 2024-09-15T23:14:25.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:25 smithi145 ceph-mon[34901]: mgrmap e22: x(active, since 1.01931s), standbys: z, y 2024-09-15T23:14:25.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:25 smithi145 ceph-mon[34901]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:14:25.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:25 smithi145 ceph-mon[34901]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:25.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:25 smithi145 ceph-mon[34901]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:25.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:25 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3684202915' entity='client.admin' 2024-09-15T23:14:25.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:25 smithi112 ceph-mon[34367]: mgrmap e22: x(active, since 1.01931s), standbys: z, y 2024-09-15T23:14:25.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:25 smithi112 ceph-mon[34367]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:14:25.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:25 smithi112 ceph-mon[34367]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:25.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:25 smithi112 ceph-mon[34367]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:25.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3684202915' entity='client.admin' 2024-09-15T23:14:25.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-mon[31019]: mgrmap e22: x(active, since 1.01931s), standbys: z, y 2024-09-15T23:14:25.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-mon[31019]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:14:25.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-mon[31019]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:25.762 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-mon[31019]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.796+0000 7f4eeda3c640 1 -- 172.21.15.2:0/2346782026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee8100a40 msgr2=0x7f4ee8100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.796+0000 7f4eeda3c640 1 --2- 172.21.15.2:0/2346782026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee8100a40 0x7f4ee8100e40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009ca0 tx=0x7f4ed802a8c0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.796+0000 7f4eeda3c640 1 -- 172.21.15.2:0/2346782026 shutdown_connections 2024-09-15T23:14:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.796+0000 7f4eeda3c640 1 --2- 172.21.15.2:0/2346782026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ee81025f0 0x7f4ee8108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.796+0000 7f4eeda3c640 1 --2- 172.21.15.2:0/2346782026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ee8101c30 0x7f4ee81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.796+0000 7f4eeda3c640 1 --2- 172.21.15.2:0/2346782026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee8100a40 0x7f4ee8100e40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.796+0000 7f4eeda3c640 1 -- 172.21.15.2:0/2346782026 >> 172.21.15.2:0/2346782026 conn(0x7f4ee80fc1e0 msgr2=0x7f4ee80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.796+0000 7f4eeda3c640 1 -- 172.21.15.2:0/2346782026 shutdown_connections 2024-09-15T23:14:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.796+0000 7f4eeda3c640 1 -- 172.21.15.2:0/2346782026 wait complete. 2024-09-15T23:14:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.797+0000 7f4eeda3c640 1 Processor -- start 2024-09-15T23:14:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.797+0000 7f4eeda3c640 1 -- start start 2024-09-15T23:14:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.797+0000 7f4eeda3c640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ee8100a40 0x7f4ee8197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.797+0000 7f4eeda3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee8101c30 0x7f4ee8198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.797+0000 7f4eeda3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ee81025f0 0x7f4ee819f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.797+0000 7f4eeda3c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee810d720 con 0x7f4ee8101c30 2024-09-15T23:14:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.797+0000 7f4eeda3c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee810d5a0 con 0x7f4ee81025f0 2024-09-15T23:14:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.797+0000 7f4eeda3c640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee810d8a0 con 0x7f4ee8100a40 2024-09-15T23:14:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.797+0000 7f4ee67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee8101c30 0x7f4ee8198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.797+0000 7f4ee67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee8101c30 0x7f4ee8198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45634/0 (socket says 172.21.15.2:45634) 2024-09-15T23:14:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.797+0000 7f4ee67fc640 1 -- 172.21.15.2:0/504086192 learned_addr learned my addr 172.21.15.2:0/504086192 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:14:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.797+0000 7f4ee77fe640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ee81025f0 0x7f4ee819f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.797+0000 7f4ee6ffd640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ee8100a40 0x7f4ee8197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.798+0000 7f4ee67fc640 1 -- 172.21.15.2:0/504086192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ee8100a40 msgr2=0x7f4ee8197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.798+0000 7f4ee67fc640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ee8100a40 0x7f4ee8197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.798+0000 7f4ee67fc640 1 -- 172.21.15.2:0/504086192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ee81025f0 msgr2=0x7f4ee819f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.798+0000 7f4ee67fc640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ee81025f0 0x7f4ee819f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.798+0000 7f4ee67fc640 1 -- 172.21.15.2:0/504086192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee819f960 con 0x7f4ee8101c30 2024-09-15T23:14:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.798+0000 7f4ee67fc640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee8101c30 0x7f4ee8198280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000e9f0 tx=0x7f4ed000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.798+0000 7f4eeca3a640 1 -- 172.21.15.2:0/504086192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed000cd80 con 0x7f4ee8101c30 2024-09-15T23:14:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.798+0000 7f4eeda3c640 1 -- 172.21.15.2:0/504086192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee819fc50 con 0x7f4ee8101c30 2024-09-15T23:14:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.798+0000 7f4eeca3a640 1 -- 172.21.15.2:0/504086192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ed00108e0 con 0x7f4ee8101c30 2024-09-15T23:14:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.798+0000 7f4eeca3a640 1 -- 172.21.15.2:0/504086192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0018920 con 0x7f4ee8101c30 2024-09-15T23:14:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.798+0000 7f4eeda3c640 1 -- 172.21.15.2:0/504086192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee81a01a0 con 0x7f4ee8101c30 2024-09-15T23:14:25.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.799+0000 7f4eeda3c640 1 -- 172.21.15.2:0/504086192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee8107e00 con 0x7f4ee8101c30 2024-09-15T23:14:25.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.800+0000 7f4eeca3a640 1 -- 172.21.15.2:0/504086192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 138167+0+0 (secure 0 0 0) 0x7f4ed0010a90 con 0x7f4ee8101c30 2024-09-15T23:14:25.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.801+0000 7f4eeca3a640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f4ed40a3100 0x7f4ed40a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.801+0000 7f4eeca3a640 1 -- 172.21.15.2:0/504086192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8527+0+0 (secure 0 0 0) 0x7f4ed00cf900 con 0x7f4ee8101c30 2024-09-15T23:14:25.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.801+0000 7f4ee6ffd640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f4ed40a3100 0x7f4ed40a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.802+0000 7f4ee6ffd640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f4ed40a3100 0x7f4ed40a55c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8000f80 tx=0x7f4ed8031000 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:25.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:25.806+0000 7f4eeca3a640 1 -- 172.21.15.2:0/504086192 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ed009c1a0 con 0x7f4ee8101c30 2024-09-15T23:14:26.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.005+0000 7f4eeda3c640 1 -- 172.21.15.2:0/504086192 --> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f4ee8062630 con 0x7f4ed40a3100 2024-09-15T23:14:26.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.019+0000 7f4eeca3a640 1 -- 172.21.15.2:0/504086192 <== mgr.15054 v2:172.21.15.2:6800/1306494062 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f4ee8062630 con 0x7f4ed40a3100 2024-09-15T23:14:26.020 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-09-15T23:14:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.021+0000 7f4eeda3c640 1 -- 172.21.15.2:0/504086192 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f4ed40a3100 msgr2=0x7f4ed40a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.021+0000 7f4eeda3c640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f4ed40a3100 0x7f4ed40a55c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8000f80 tx=0x7f4ed8031000 comp rx=0 tx=0).stop 2024-09-15T23:14:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.021+0000 7f4eeda3c640 1 -- 172.21.15.2:0/504086192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee8101c30 msgr2=0x7f4ee8198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.021+0000 7f4eeda3c640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee8101c30 0x7f4ee8198280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000e9f0 tx=0x7f4ed000eeb0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.021+0000 7f4eeda3c640 1 -- 172.21.15.2:0/504086192 shutdown_connections 2024-09-15T23:14:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.021+0000 7f4eeda3c640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f4ed40a3100 0x7f4ed40a55c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.021+0000 7f4eeda3c640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ee81025f0 0x7f4ee819f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.021+0000 7f4eeda3c640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ee8101c30 0x7f4ee8198280 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.021+0000 7f4eeda3c640 1 --2- 172.21.15.2:0/504086192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ee8100a40 0x7f4ee8197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.021+0000 7f4eeda3c640 1 -- 172.21.15.2:0/504086192 >> 172.21.15.2:0/504086192 conn(0x7f4ee80fc1e0 msgr2=0x7f4ee8104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:26.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.021+0000 7f4eeda3c640 1 -- 172.21.15.2:0/504086192 shutdown_connections 2024-09-15T23:14:26.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:14:26.021+0000 7f4eeda3c640 1 -- 172.21.15.2:0/504086192 wait complete. 2024-09-15T23:14:26.034 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-15T23:14:26.034 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:25.759+0000 7f818c9b1640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:23:14:25] ENGINE Error in HTTPServer.serve 2024-09-15T23:14:26.034 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: Traceback (most recent call last): 2024-09-15T23:14:26.035 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T23:14:26.035 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: self._connections.run(self.expiration_interval) 2024-09-15T23:14:26.035 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T23:14:26.035 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: self._run(expiration_interval) 2024-09-15T23:14:26.035 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T23:14:26.035 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T23:14:26.035 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T23:14:26.035 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T23:14:26.036 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T23:14:26.036 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: s = self.context.wrap_socket( 2024-09-15T23:14:26.036 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T23:14:26.037 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: return self.sslsocket_class._create( 2024-09-15T23:14:26.037 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T23:14:26.037 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: self.do_handshake() 2024-09-15T23:14:26.037 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T23:14:26.037 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: self._sslobj.do_handshake() 2024-09-15T23:14:26.037 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T23:14:26.037 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:14:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:14:26.068 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-15T23:14:26.079 INFO:teuthology.run_tasks:Running task workunit... 2024-09-15T23:14:26.134 INFO:tasks.workunit:Pulling workunits from ref ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T23:14:26.134 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-15T23:14:26.135 INFO:tasks.workunit:timeout=3h 2024-09-15T23:14:26.135 INFO:tasks.workunit:cleanup=True 2024-09-15T23:14:26.135 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:26.151 INFO:teuthology.orchestra.run.smithi002.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:26.151 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-15T23:14:26.151 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-15T23:14:26.151 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:14:26.151 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-15T23:14:26.151 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-15 23:12:55.212262824 +0000 2024-09-15T23:14:26.152 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-15 23:12:55.212262824 +0000 2024-09-15T23:14:26.152 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-15 23:14:23.319225922 +0000 2024-09-15T23:14:26.152 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2024-09-15T23:14:26.152 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:26.152 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-15T23:14:26.226 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T23:14:26.282 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-15T23:14:26.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: [15/Sep/2024:23:14:25] ENGINE Bus STARTING 2024-09-15T23:14:26.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='client.24787 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:26.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: [15/Sep/2024:23:14:25] ENGINE Serving on https://172.21.15.2:7150 2024-09-15T23:14:26.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: [15/Sep/2024:23:14:25] ENGINE Error in HTTPServer.serve 2024-09-15T23:14:26.958 INFO:journalctl@ceph.mon.c.smithi145.stdout: Traceback (most recent call last): 2024-09-15T23:14:26.958 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T23:14:26.958 INFO:journalctl@ceph.mon.c.smithi145.stdout: self._connections.run(self.expiration_interval) 2024-09-15T23:14:26.958 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T23:14:26.958 INFO:journalctl@ceph.mon.c.smithi145.stdout: self._run(expiration_interval) 2024-09-15T23:14:26.958 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T23:14:26.959 INFO:journalctl@ceph.mon.c.smithi145.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T23:14:26.959 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T23:14:26.959 INFO:journalctl@ceph.mon.c.smithi145.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T23:14:26.959 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T23:14:26.959 INFO:journalctl@ceph.mon.c.smithi145.stdout: s = self.context.wrap_socket( 2024-09-15T23:14:26.959 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T23:14:26.959 INFO:journalctl@ceph.mon.c.smithi145.stdout: return self.sslsocket_class._create( 2024-09-15T23:14:26.959 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T23:14:26.959 INFO:journalctl@ceph.mon.c.smithi145.stdout: self.do_handshake() 2024-09-15T23:14:26.959 INFO:journalctl@ceph.mon.c.smithi145.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T23:14:26.959 INFO:journalctl@ceph.mon.c.smithi145.stdout: self._sslobj.do_handshake() 2024-09-15T23:14:26.959 INFO:journalctl@ceph.mon.c.smithi145.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T23:14:26.960 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.960 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.960 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: [15/Sep/2024:23:14:25] ENGINE Serving on http://172.21.15.2:8765 2024-09-15T23:14:26.960 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: [15/Sep/2024:23:14:25] ENGINE Bus STARTED 2024-09-15T23:14:26.960 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:26.960 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.960 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.960 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.960 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.960 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.961 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.961 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi112 to 176.0M 2024-09-15T23:14:26.961 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: Unable to set osd_memory_target on smithi112 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-15T23:14:26.961 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.961 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.961 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.961 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.961 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.961 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.961 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-15T23:14:26.961 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: Unable to set osd_memory_target on smithi145 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-15T23:14:26.961 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-09-15T23:14:26.961 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.962 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.962 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.962 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.962 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.962 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.962 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:14:26.962 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:26 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:14:26.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: [15/Sep/2024:23:14:25] ENGINE Bus STARTING 2024-09-15T23:14:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='client.24787 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: [15/Sep/2024:23:14:25] ENGINE Serving on https://172.21.15.2:7150 2024-09-15T23:14:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: [15/Sep/2024:23:14:25] ENGINE Error in HTTPServer.serve 2024-09-15T23:14:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout: Traceback (most recent call last): 2024-09-15T23:14:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T23:14:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-15T23:14:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T23:14:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout: self._run(expiration_interval) 2024-09-15T23:14:26.997 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout: s = self.context.wrap_socket( 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout: return self.sslsocket_class._create( 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout: self.do_handshake() 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout: self._sslobj.do_handshake() 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: [15/Sep/2024:23:14:25] ENGINE Serving on http://172.21.15.2:8765 2024-09-15T23:14:26.999 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: [15/Sep/2024:23:14:25] ENGINE Bus STARTED 2024-09-15T23:14:26.999 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:26.999 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.999 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.999 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.999 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.999 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.999 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:26.999 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi112 to 176.0M 2024-09-15T23:14:26.999 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: Unable to set osd_memory_target on smithi112 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-15T23:14:26.999 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.999 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:26.999 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.000 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.000 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.000 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.000 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-15T23:14:27.000 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: Unable to set osd_memory_target on smithi145 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-15T23:14:27.000 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-09-15T23:14:27.000 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.000 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.000 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.000 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.000 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.000 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.000 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:14:27.001 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:26 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:14:27.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: [15/Sep/2024:23:14:25] ENGINE Bus STARTING 2024-09-15T23:14:27.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='client.24787 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:27.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: [15/Sep/2024:23:14:25] ENGINE Serving on https://172.21.15.2:7150 2024-09-15T23:14:27.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: [15/Sep/2024:23:14:25] ENGINE Error in HTTPServer.serve 2024-09-15T23:14:27.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: Traceback (most recent call last): 2024-09-15T23:14:27.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T23:14:27.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-15T23:14:27.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T23:14:27.059 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._run(expiration_interval) 2024-09-15T23:14:27.060 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T23:14:27.060 INFO:journalctl@ceph.mon.a.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T23:14:27.060 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T23:14:27.060 INFO:journalctl@ceph.mon.a.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T23:14:27.060 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T23:14:27.060 INFO:journalctl@ceph.mon.a.smithi002.stdout: s = self.context.wrap_socket( 2024-09-15T23:14:27.060 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T23:14:27.060 INFO:journalctl@ceph.mon.a.smithi002.stdout: return self.sslsocket_class._create( 2024-09-15T23:14:27.060 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T23:14:27.060 INFO:journalctl@ceph.mon.a.smithi002.stdout: self.do_handshake() 2024-09-15T23:14:27.060 INFO:journalctl@ceph.mon.a.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T23:14:27.060 INFO:journalctl@ceph.mon.a.smithi002.stdout: self._sslobj.do_handshake() 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: [15/Sep/2024:23:14:25] ENGINE Serving on http://172.21.15.2:8765 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: [15/Sep/2024:23:14:25] ENGINE Bus STARTED 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi112 to 176.0M 2024-09-15T23:14:27.061 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: Unable to set osd_memory_target on smithi112 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: Unable to set osd_memory_target on smithi145 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:14:27.062 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:14:27.063 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:26 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:14:27.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-15T23:14:27.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Unable to set osd_memory_target on smithi002 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Updating smithi112:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Updating smithi145:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Updating smithi002:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Updating smithi112:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Updating smithi145:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: Updating smithi002:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.959 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:27 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-15T23:14:27.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Unable to set osd_memory_target on smithi002 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-15T23:14:27.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-15T23:14:27.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-15T23:14:27.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-15T23:14:27.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Updating smithi112:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:14:27.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Updating smithi145:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:14:27.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Updating smithi002:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:14:27.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:14:27.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:14:27.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:14:27.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Updating smithi112:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:14:27.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Updating smithi145:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:14:27.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: Updating smithi002:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:14:27.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:27.998 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:27 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:28.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-15T23:14:28.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Unable to set osd_memory_target on smithi002 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-15T23:14:28.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-15T23:14:28.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-15T23:14:28.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-15T23:14:28.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Updating smithi112:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Updating smithi145:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Updating smithi002:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Updating smithi112:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Updating smithi145:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: Updating smithi002:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:28.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:28.060 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:27 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:28.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:28 smithi145 ceph-mon[34901]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:14:28.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:28 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:14:28.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:28 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:14:28.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:28 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:14:28.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:28 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:28.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:28 smithi145 ceph-mon[34901]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-09-15T23:14:28.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:28 smithi112 ceph-mon[34367]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:14:28.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:28 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:14:28.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:28 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:14:28.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:28 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:14:28.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:28 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:28.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:28 smithi112 ceph-mon[34367]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-09-15T23:14:29.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:28 smithi002 ceph-mon[31019]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:14:29.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:28 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:14:29.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:28 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:14:29.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:28 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:14:29.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:28 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:14:29.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:28 smithi002 ceph-mon[31019]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-09-15T23:14:30.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:30 smithi002 ceph-mon[31019]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:14:30.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:30 smithi145 ceph-mon[34901]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:14:30.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:30 smithi112 ceph-mon[34367]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:14:32.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:32 smithi145 ceph-mon[34901]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 132 KiB/s wr, 73 op/s 2024-09-15T23:14:32.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:32 smithi112 ceph-mon[34367]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 132 KiB/s wr, 73 op/s 2024-09-15T23:14:33.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:32 smithi002 ceph-mon[31019]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 132 KiB/s wr, 73 op/s 2024-09-15T23:14:34.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:34 smithi145 ceph-mon[34901]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 102 KiB/s wr, 57 op/s 2024-09-15T23:14:34.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:34 smithi112 ceph-mon[34367]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 102 KiB/s wr, 57 op/s 2024-09-15T23:14:35.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:34 smithi002 ceph-mon[31019]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 102 KiB/s wr, 57 op/s 2024-09-15T23:14:36.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:36 smithi145 ceph-mon[34901]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 47 op/s 2024-09-15T23:14:36.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:36 smithi112 ceph-mon[34367]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 47 op/s 2024-09-15T23:14:37.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:36 smithi002 ceph-mon[31019]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 84 KiB/s wr, 47 op/s 2024-09-15T23:14:38.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:38 smithi145 ceph-mon[34901]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-15T23:14:38.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:38 smithi112 ceph-mon[34367]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-15T23:14:39.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:38 smithi002 ceph-mon[31019]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-15T23:14:40.887 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:40 smithi002 ceph-mon[31019]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-15T23:14:40.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:40 smithi145 ceph-mon[34901]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-15T23:14:40.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:40 smithi112 ceph-mon[34367]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-09-15T23:14:42.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:42 smithi145 ceph-mon[34901]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-09-15T23:14:42.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:42 smithi112 ceph-mon[34367]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-09-15T23:14:43.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:42 smithi002 ceph-mon[31019]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-09-15T23:14:44.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:44 smithi145 ceph-mon[34901]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T23:14:44.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:44 smithi112 ceph-mon[34367]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T23:14:45.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:44 smithi002 ceph-mon[31019]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T23:14:47.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:47 smithi002 ceph-mon[31019]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T23:14:47.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:47 smithi145 ceph-mon[34901]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T23:14:47.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:47 smithi112 ceph-mon[34367]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T23:14:49.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:49 smithi002 ceph-mon[31019]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-15T23:14:49.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:49 smithi145 ceph-mon[34901]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-15T23:14:49.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:49 smithi112 ceph-mon[34367]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-15T23:14:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:51 smithi002 ceph-mon[31019]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-15T23:14:51.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:51 smithi145 ceph-mon[34901]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-15T23:14:51.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:51 smithi112 ceph-mon[34367]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-15T23:14:53.299 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:53 smithi112 ceph-mon[34367]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-15T23:14:53.307 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:53 smithi002 ceph-mon[31019]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-15T23:14:53.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:53 smithi145 ceph-mon[34901]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-15T23:14:55.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:55 smithi002 ceph-mon[31019]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:55.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:55 smithi145 ceph-mon[34901]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:55.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:55 smithi112 ceph-mon[34367]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:57.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:57 smithi002 ceph-mon[31019]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:14:57.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:57 smithi145 ceph-mon[34901]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:14:57.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:57 smithi112 ceph-mon[34367]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:14:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:14:59 smithi002 ceph-mon[31019]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:59.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:14:59 smithi145 ceph-mon[34901]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:14:59.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:14:59 smithi112 ceph-mon[34367]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:15:00.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:15:00 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:15:00.292+0000 7f81909f9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:15:00.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:15:00 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:15:00.292+0000 7f81909f9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:15:00.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:15:00 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:15:00.292+0000 7f81909f9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:15:00.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:15:00 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:15:00.292+0000 7f81909f9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:15:00.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:15:00 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:15:00.292+0000 7f81909f9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:15:01.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:01 smithi002 ceph-mon[31019]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:15:01.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:01 smithi145 ceph-mon[34901]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:15:01.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:01 smithi112 ceph-mon[34367]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:15:03.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:03 smithi145 ceph-mon[34901]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:15:03.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:03 smithi145 ceph-mon[34901]: mgrmap e25: x(active, since 38s), standbys: z, y 2024-09-15T23:15:03.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:03 smithi112 ceph-mon[34367]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:15:03.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:03 smithi112 ceph-mon[34367]: mgrmap e25: x(active, since 38s), standbys: z, y 2024-09-15T23:15:03.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:03 smithi002 ceph-mon[31019]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:15:03.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:03 smithi002 ceph-mon[31019]: mgrmap e25: x(active, since 38s), standbys: z, y 2024-09-15T23:15:05.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:05 smithi145 ceph-mon[34901]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:15:05.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:05 smithi112 ceph-mon[34367]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:15:05.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:05 smithi002 ceph-mon[31019]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:15:07.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:07 smithi145 ceph-mon[34901]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T23:15:07.518 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:07 smithi112 ceph-mon[34367]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T23:15:07.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:07 smithi002 ceph-mon[31019]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T23:15:09.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:09 smithi145 ceph-mon[34901]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T23:15:09.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:09 smithi112 ceph-mon[34367]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T23:15:09.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:09 smithi002 ceph-mon[31019]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T23:15:11.359 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:11 smithi002 ceph-mon[31019]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T23:15:11.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:11 smithi145 ceph-mon[34901]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T23:15:11.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:11 smithi112 ceph-mon[34367]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T23:15:13.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:13 smithi145 ceph-mon[34901]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T23:15:13.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:13 smithi112 ceph-mon[34367]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T23:15:13.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:13 smithi002 ceph-mon[31019]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T23:15:15.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:15 smithi145 ceph-mon[34901]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T23:15:15.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:15 smithi112 ceph-mon[34367]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T23:15:15.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:15 smithi002 ceph-mon[31019]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T23:15:17.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:17 smithi145 ceph-mon[34901]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T23:15:17.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:17 smithi112 ceph-mon[34367]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T23:15:17.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:17 smithi002 ceph-mon[31019]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T23:15:19.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:19 smithi145 ceph-mon[34901]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T23:15:19.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:19 smithi112 ceph-mon[34367]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T23:15:19.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:19 smithi002 ceph-mon[31019]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T23:15:21.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:21 smithi145 ceph-mon[34901]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T23:15:21.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:21 smithi112 ceph-mon[34367]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T23:15:21.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:21 smithi002 ceph-mon[31019]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T23:15:23.286 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 91% (11806/12889) Updating files: 92% (11858/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-15T23:15:23.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:23 smithi145 ceph-mon[34901]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T23:15:23.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:23 smithi112 ceph-mon[34367]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T23:15:23.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:23 smithi002 ceph-mon[31019]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T23:15:23.890 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-15T23:15:23.890 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-15T23:15:23.890 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-15T23:15:23.890 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-15T23:15:23.890 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-15T23:15:23.890 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-15T23:15:23.890 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-15T23:15:23.890 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-15T23:15:23.890 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-15T23:15:23.890 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-15T23:15:23.891 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-15T23:15:23.891 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-15T23:15:23.891 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-15T23:15:23.891 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-15T23:15:23.891 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-15T23:15:23.891 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-15T23:15:23.891 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-15T23:15:23.891 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-15T23:15:23.895 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-15T23:15:23.972 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-15T23:15:23.974 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T23:15:23.975 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-15T23:15:24.307 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:24 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-15T23:15:24.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:24 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-15T23:15:24.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:24 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-15T23:15:24.625 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-15T23:15:24.694 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-15T23:15:24.735 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T23:15:24.736 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T23:15:24.736 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-15T23:15:24.776 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T23:15:24.780 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:15:24.780 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-15T23:15:24.836 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-09-15T23:15:24.838 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-09-15T23:15:24.838 DEBUG:teuthology.orchestra.run.smithi002:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-09-15T23:15:24.903 INFO:tasks.workunit.client.0.smithi002.stdout:getting blogbench 2024-09-15T23:15:24.903 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'getting blogbench' 2024-09-15T23:15:24.903 INFO:tasks.workunit.client.0.smithi002.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-15T23:15:24.928 INFO:tasks.workunit.client.0.smithi002.stderr:--2024-09-15 23:15:24-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-15T23:15:24.929 INFO:tasks.workunit.client.0.smithi002.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-15T23:15:24.951 INFO:tasks.workunit.client.0.smithi002.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-15T23:15:24.971 INFO:tasks.workunit.client.0.smithi002.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-15T23:15:24.971 INFO:tasks.workunit.client.0.smithi002.stderr:Length: 103355 (101K) [application/octet-stream] 2024-09-15T23:15:24.974 INFO:tasks.workunit.client.0.smithi002.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-09-15T23:15:24.977 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-15T23:15:25.013 INFO:tasks.workunit.client.0.smithi002.stderr: 0K .......... .......... .......... .......... .......... 49% 1.25M 0s 2024-09-15T23:15:25.033 INFO:tasks.workunit.client.0.smithi002.stderr: 50K .......... .......... .......... .......... .......... 99% 2.42M 0s 2024-09-15T23:15:25.033 INFO:tasks.workunit.client.0.smithi002.stderr: 100K 100% 1.74T=0.06s 2024-09-15T23:15:25.033 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-15T23:15:25.034 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-15 23:15:25 (1.67 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-09-15T23:15:25.034 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-15T23:15:25.034 INFO:tasks.workunit.client.0.smithi002.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-09-15T23:15:25.069 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/ 2024-09-15T23:15:25.071 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/m4/ 2024-09-15T23:15:25.073 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-09-15T23:15:25.076 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/man/ 2024-09-15T23:15:25.078 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/man/blogbench.8 2024-09-15T23:15:25.080 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/man/Makefile.am 2024-09-15T23:15:25.082 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/man/Makefile.in 2024-09-15T23:15:25.085 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/ 2024-09-15T23:15:25.087 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/mysnprintf.c 2024-09-15T23:15:25.090 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/mysnprintf.h 2024-09-15T23:15:25.092 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/blogbench.c 2024-09-15T23:15:25.094 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/blogbench.h 2024-09-15T23:15:25.096 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/fakesnprintf.c 2024-09-15T23:15:25.098 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/fakesnprintf.h 2024-09-15T23:15:25.100 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/blogbench_p.h 2024-09-15T23:15:25.103 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-09-15T23:15:25.106 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-09-15T23:15:25.109 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/Makefile.am 2024-09-15T23:15:25.111 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/Makefile.in 2024-09-15T23:15:25.113 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/process.c 2024-09-15T23:15:25.116 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/globals.h 2024-09-15T23:15:25.118 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/commenter.c 2024-09-15T23:15:25.120 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/rewriter.c 2024-09-15T23:15:25.122 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/reader.c 2024-09-15T23:15:25.124 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/writer.c 2024-09-15T23:15:25.126 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/src/helpers.c 2024-09-15T23:15:25.129 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/NEWS 2024-09-15T23:15:25.131 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/compile 2024-09-15T23:15:25.133 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/depcomp 2024-09-15T23:15:25.136 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/aclocal.m4 2024-09-15T23:15:25.138 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/README 2024-09-15T23:15:25.140 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/configure 2024-09-15T23:15:25.149 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/configure.ac 2024-09-15T23:15:25.151 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/config.guess 2024-09-15T23:15:25.154 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/install-sh 2024-09-15T23:15:25.156 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/config.sub 2024-09-15T23:15:25.158 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/missing 2024-09-15T23:15:25.161 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/mkinstalldirs 2024-09-15T23:15:25.162 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/Makefile.am 2024-09-15T23:15:25.164 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/Makefile.in 2024-09-15T23:15:25.166 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/config.h.in 2024-09-15T23:15:25.168 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/AUTHORS 2024-09-15T23:15:25.170 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/INSTALL 2024-09-15T23:15:25.172 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/ChangeLog 2024-09-15T23:15:25.173 INFO:tasks.workunit.client.0.smithi002.stdout:blogbench-1.0/COPYING 2024-09-15T23:15:25.176 INFO:tasks.workunit.client.0.smithi002.stderr:+ cd blogbench-1.0/ 2024-09-15T23:15:25.177 INFO:tasks.workunit.client.0.smithi002.stdout:making blogbench 2024-09-15T23:15:25.177 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'making blogbench' 2024-09-15T23:15:25.178 INFO:tasks.workunit.client.0.smithi002.stderr:+ ./configure 2024-09-15T23:15:25.285 INFO:tasks.workunit.client.0.smithi002.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-15T23:15:25.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:25 smithi145 ceph-mon[34901]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:15:25.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:25 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-15T23:15:25.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:25 smithi145 ceph-mon[34901]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T23:15:25.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:25 smithi112 ceph-mon[34367]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:15:25.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:25 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-15T23:15:25.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:25 smithi112 ceph-mon[34367]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T23:15:25.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:25 smithi002 ceph-mon[31019]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:15:25.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:25 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-15T23:15:25.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:25 smithi002 ceph-mon[31019]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T23:15:26.297 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether build environment is sane... yes 2024-09-15T23:15:26.314 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gawk... gawk 2024-09-15T23:15:26.338 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether make sets $(MAKE)... yes 2024-09-15T23:15:26.365 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gcc... gcc 2024-09-15T23:15:26.443 INFO:tasks.workunit.client.0.smithi002.stdout:checking for C compiler default output file name... a.out 2024-09-15T23:15:26.446 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether the C compiler works... yes 2024-09-15T23:15:26.450 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether we are cross compiling... no 2024-09-15T23:15:26.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:26 smithi145 ceph-mon[34901]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T23:15:26.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:26 smithi112 ceph-mon[34367]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T23:15:26.500 INFO:tasks.workunit.client.0.smithi002.stdout:checking for suffix of executables... 2024-09-15T23:15:26.548 INFO:tasks.workunit.client.0.smithi002.stdout:checking for suffix of object files... o 2024-09-15T23:15:26.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:26 smithi002 ceph-mon[31019]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T23:15:26.593 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether we are using the GNU C compiler... yes 2024-09-15T23:15:26.637 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether gcc accepts -g... yes 2024-09-15T23:15:26.716 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gcc option to accept ANSI C... none needed 2024-09-15T23:15:26.766 INFO:tasks.workunit.client.0.smithi002.stdout:checking for style of include used by make... GNU 2024-09-15T23:15:26.906 INFO:tasks.workunit.client.0.smithi002.stdout:checking dependency style of gcc... gcc3 2024-09-15T23:15:26.906 INFO:tasks.workunit.client.0.smithi002.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-15T23:15:26.992 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to run the C preprocessor... gcc -E 2024-09-15T23:15:27.050 INFO:tasks.workunit.client.0.smithi002.stdout:checking for egrep... grep -E 2024-09-15T23:15:27.063 INFO:tasks.workunit.client.0.smithi002.stdout:checking for AIX... no 2024-09-15T23:15:27.165 INFO:tasks.workunit.client.0.smithi002.stdout:checking for library containing strerror... none required 2024-09-15T23:15:27.399 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ANSI C header files... yes 2024-09-15T23:15:27.454 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-15T23:15:27.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:27 smithi145 ceph-mon[34901]: pgmap v36: 97 pgs: 1 peering, 96 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:15:27.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:27 smithi145 ceph-mon[34901]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-15T23:15:27.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:27 smithi112 ceph-mon[34367]: pgmap v36: 97 pgs: 1 peering, 96 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:15:27.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:27 smithi112 ceph-mon[34367]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-15T23:15:27.514 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/types.h... yes 2024-09-15T23:15:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:27 smithi002 ceph-mon[31019]: pgmap v36: 97 pgs: 1 peering, 96 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:15:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:27 smithi002 ceph-mon[31019]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-15T23:15:27.581 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/stat.h... yes 2024-09-15T23:15:27.645 INFO:tasks.workunit.client.0.smithi002.stdout:checking for stdlib.h... yes 2024-09-15T23:15:27.709 INFO:tasks.workunit.client.0.smithi002.stdout:checking for string.h... yes 2024-09-15T23:15:27.779 INFO:tasks.workunit.client.0.smithi002.stdout:checking for memory.h... yes 2024-09-15T23:15:27.854 INFO:tasks.workunit.client.0.smithi002.stdout:checking for strings.h... yes 2024-09-15T23:15:27.932 INFO:tasks.workunit.client.0.smithi002.stdout:checking for inttypes.h... yes 2024-09-15T23:15:28.007 INFO:tasks.workunit.client.0.smithi002.stdout:checking for stdint.h... yes 2024-09-15T23:15:28.079 INFO:tasks.workunit.client.0.smithi002.stdout:checking for unistd.h... yes 2024-09-15T23:15:28.098 INFO:tasks.workunit.client.0.smithi002.stdout:checking for memory.h... (cached) yes 2024-09-15T23:15:28.112 INFO:tasks.workunit.client.0.smithi002.stdout:checking for strings.h... (cached) yes 2024-09-15T23:15:28.125 INFO:tasks.workunit.client.0.smithi002.stdout:checking for unistd.h... (cached) yes 2024-09-15T23:15:28.198 INFO:tasks.workunit.client.0.smithi002.stdout:checking locale.h usability... yes 2024-09-15T23:15:28.227 INFO:tasks.workunit.client.0.smithi002.stdout:checking locale.h presence... yes 2024-09-15T23:15:28.228 INFO:tasks.workunit.client.0.smithi002.stdout:checking for locale.h... yes 2024-09-15T23:15:28.251 INFO:tasks.workunit.client.0.smithi002.stdout:checking for stdlib.h... (cached) yes 2024-09-15T23:15:28.264 INFO:tasks.workunit.client.0.smithi002.stdout:checking for string.h... (cached) yes 2024-09-15T23:15:28.347 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/socket.h usability... yes 2024-09-15T23:15:28.377 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/socket.h presence... yes 2024-09-15T23:15:28.379 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/socket.h... yes 2024-09-15T23:15:28.450 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/time.h usability... yes 2024-09-15T23:15:28.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:28 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:15:28.477 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/time.h presence... yes 2024-09-15T23:15:28.478 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/time.h... yes 2024-09-15T23:15:28.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:28 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:15:28.551 INFO:tasks.workunit.client.0.smithi002.stdout:checking fcntl.h usability... yes 2024-09-15T23:15:28.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:28 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:15:28.580 INFO:tasks.workunit.client.0.smithi002.stdout:checking fcntl.h presence... yes 2024-09-15T23:15:28.581 INFO:tasks.workunit.client.0.smithi002.stdout:checking for fcntl.h... yes 2024-09-15T23:15:28.651 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fcntl.h usability... yes 2024-09-15T23:15:28.679 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fcntl.h presence... yes 2024-09-15T23:15:28.680 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/fcntl.h... yes 2024-09-15T23:15:28.797 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/param.h usability... yes 2024-09-15T23:15:28.837 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/param.h presence... yes 2024-09-15T23:15:28.838 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/param.h... yes 2024-09-15T23:15:28.905 INFO:tasks.workunit.client.0.smithi002.stdout:checking ioctl.h usability... no 2024-09-15T23:15:28.937 INFO:tasks.workunit.client.0.smithi002.stdout:checking ioctl.h presence... no 2024-09-15T23:15:28.938 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ioctl.h... no 2024-09-15T23:15:29.005 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/ioctl.h usability... yes 2024-09-15T23:15:29.032 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/ioctl.h presence... yes 2024-09-15T23:15:29.033 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/ioctl.h... yes 2024-09-15T23:15:29.098 INFO:tasks.workunit.client.0.smithi002.stdout:checking return type of signal handlers... void 2024-09-15T23:15:29.157 INFO:tasks.workunit.client.0.smithi002.stdout:checking for size_t... yes 2024-09-15T23:15:29.208 INFO:tasks.workunit.client.0.smithi002.stdout:checking for dev_t... yes 2024-09-15T23:15:29.265 INFO:tasks.workunit.client.0.smithi002.stdout:checking for short... yes 2024-09-15T23:15:29.367 INFO:tasks.workunit.client.0.smithi002.stdout:checking size of short... 2 2024-09-15T23:15:29.428 INFO:tasks.workunit.client.0.smithi002.stdout:checking for int... yes 2024-09-15T23:15:29.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:29 smithi145 ceph-mon[34901]: pgmap v37: 97 pgs: 1 peering, 96 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:15:29.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:29 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:15:29.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:29 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:15:29.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:29 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:15:29.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:29 smithi112 ceph-mon[34367]: pgmap v37: 97 pgs: 1 peering, 96 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:15:29.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:29 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:15:29.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:29 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:15:29.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:29 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:15:29.520 INFO:tasks.workunit.client.0.smithi002.stdout:checking size of int... 4 2024-09-15T23:15:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:29 smithi002 ceph-mon[31019]: pgmap v37: 97 pgs: 1 peering, 96 active+clean; 1.3 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:15:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:29 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:15:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:29 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:15:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:29 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:15:29.581 INFO:tasks.workunit.client.0.smithi002.stdout:checking for long... yes 2024-09-15T23:15:29.674 INFO:tasks.workunit.client.0.smithi002.stdout:checking size of long... 8 2024-09-15T23:15:29.737 INFO:tasks.workunit.client.0.smithi002.stdout:checking for long long... yes 2024-09-15T23:15:29.839 INFO:tasks.workunit.client.0.smithi002.stdout:checking size of long long... 8 2024-09-15T23:15:29.902 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ssize_t... yes 2024-09-15T23:15:29.954 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sig_atomic_t... yes 2024-09-15T23:15:30.017 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether gcc needs -traditional... no 2024-09-15T23:15:30.064 INFO:tasks.workunit.client.0.smithi002.stdout:checking for an ANSI C-conforming const... yes 2024-09-15T23:15:30.099 INFO:tasks.workunit.client.0.smithi002.stdout:checking for inline... inline 2024-09-15T23:15:30.182 INFO:tasks.workunit.client.0.smithi002.stdout:checking for working alloca.h... yes 2024-09-15T23:15:30.254 INFO:tasks.workunit.client.0.smithi002.stdout:checking for alloca... yes 2024-09-15T23:15:30.338 INFO:tasks.workunit.client.0.smithi002.stdout:checking for working memcmp... yes 2024-09-15T23:15:30.419 INFO:tasks.workunit.client.0.smithi002.stdout:checking for strftime... yes 2024-09-15T23:15:30.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:30 smithi145 ceph-mon[34901]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-15T23:15:30.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:30 smithi145 ceph-mon[34901]: Cluster is now healthy 2024-09-15T23:15:30.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:30 smithi112 ceph-mon[34367]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-15T23:15:30.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:30 smithi112 ceph-mon[34367]: Cluster is now healthy 2024-09-15T23:15:30.514 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-09-15T23:15:30.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:30 smithi002 ceph-mon[31019]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-15T23:15:30.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:30 smithi002 ceph-mon[31019]: Cluster is now healthy 2024-09-15T23:15:30.600 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether stat accepts an empty string... no 2024-09-15T23:15:30.682 INFO:tasks.workunit.client.0.smithi002.stdout:checking for vprintf... yes 2024-09-15T23:15:30.762 INFO:tasks.workunit.client.0.smithi002.stdout:checking for _doprnt... no 2024-09-15T23:15:30.797 INFO:tasks.workunit.client.0.smithi002.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-15T23:15:30.810 INFO:tasks.workunit.client.0.smithi002.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-15T23:15:30.888 INFO:tasks.workunit.client.0.smithi002.stdout:checking for the pthreads library -lpthreads... no 2024-09-15T23:15:30.963 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether pthreads work without any flags... yes 2024-09-15T23:15:31.031 INFO:tasks.workunit.client.0.smithi002.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-09-15T23:15:31.031 INFO:tasks.workunit.client.0.smithi002.stdout:checking if more special flags are required for pthreads... no 2024-09-15T23:15:31.031 INFO:tasks.workunit.client.0.smithi002.stdout:checking for cc_r... gcc 2024-09-15T23:15:31.116 INFO:tasks.workunit.client.0.smithi002.stdout:checking for setrlimit... yes 2024-09-15T23:15:31.197 INFO:tasks.workunit.client.0.smithi002.stdout:checking for setproctitle... no 2024-09-15T23:15:31.284 INFO:tasks.workunit.client.0.smithi002.stdout:checking for getopt_long... yes 2024-09-15T23:15:31.369 INFO:tasks.workunit.client.0.smithi002.stdout:checking for strtoull... yes 2024-09-15T23:15:31.454 INFO:tasks.workunit.client.0.smithi002.stdout:checking for strtoq... yes 2024-09-15T23:15:31.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:31 smithi145 ceph-mon[34901]: pgmap v38: 97 pgs: 97 active+clean; 1.9 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 101 KiB/s wr, 38 op/s 2024-09-15T23:15:31.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:31 smithi112 ceph-mon[34367]: pgmap v38: 97 pgs: 97 active+clean; 1.9 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 101 KiB/s wr, 38 op/s 2024-09-15T23:15:31.541 INFO:tasks.workunit.client.0.smithi002.stdout:checking for snprintf... yes 2024-09-15T23:15:31.557 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:31 smithi002 ceph-mon[31019]: pgmap v38: 97 pgs: 97 active+clean; 1.9 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 101 KiB/s wr, 38 op/s 2024-09-15T23:15:31.630 INFO:tasks.workunit.client.0.smithi002.stdout:checking for vsnprintf... yes 2024-09-15T23:15:31.717 INFO:tasks.workunit.client.0.smithi002.stdout:checking for vfprintf... yes 2024-09-15T23:15:31.802 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gethostname... yes 2024-09-15T23:15:31.893 INFO:tasks.workunit.client.0.smithi002.stdout:checking for setlocale... yes 2024-09-15T23:15:31.978 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sync... yes 2024-09-15T23:15:32.063 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether snprintf is C99 conformant... done 2024-09-15T23:15:32.081 INFO:tasks.workunit.client.0.smithi002.stdout:configure: creating ./config.status 2024-09-15T23:15:32.315 INFO:tasks.workunit.client.0.smithi002.stdout:config.status: creating Makefile 2024-09-15T23:15:32.338 INFO:tasks.workunit.client.0.smithi002.stdout:config.status: creating src/Makefile 2024-09-15T23:15:32.365 INFO:tasks.workunit.client.0.smithi002.stdout:config.status: creating man/Makefile 2024-09-15T23:15:32.381 INFO:tasks.workunit.client.0.smithi002.stdout:config.status: creating config.h 2024-09-15T23:15:32.451 INFO:tasks.workunit.client.0.smithi002.stdout:config.status: executing depfiles commands 2024-09-15T23:15:32.626 INFO:tasks.workunit.client.0.smithi002.stderr:+ make 2024-09-15T23:15:32.640 INFO:tasks.workunit.client.0.smithi002.stdout:make all-recursive 2024-09-15T23:15:32.646 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-15T23:15:32.650 INFO:tasks.workunit.client.0.smithi002.stdout:Making all in src 2024-09-15T23:15:32.673 INFO:tasks.workunit.client.0.smithi002.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-15T23:15:32.674 INFO:tasks.workunit.client.0.smithi002.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-09-15T23:15:32.674 INFO:tasks.workunit.client.0.smithi002.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-09-15T23:15:32.776 INFO:tasks.workunit.client.0.smithi002.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-09-15T23:15:32.776 INFO:tasks.workunit.client.0.smithi002.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-09-15T23:15:32.881 INFO:tasks.workunit.client.0.smithi002.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-09-15T23:15:32.881 INFO:tasks.workunit.client.0.smithi002.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-09-15T23:15:32.965 INFO:tasks.workunit.client.0.smithi002.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-09-15T23:15:32.965 INFO:tasks.workunit.client.0.smithi002.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-09-15T23:15:33.046 INFO:tasks.workunit.client.0.smithi002.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-09-15T23:15:33.046 INFO:tasks.workunit.client.0.smithi002.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-09-15T23:15:33.130 INFO:tasks.workunit.client.0.smithi002.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-09-15T23:15:33.130 INFO:tasks.workunit.client.0.smithi002.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-09-15T23:15:33.212 INFO:tasks.workunit.client.0.smithi002.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-09-15T23:15:33.212 INFO:tasks.workunit.client.0.smithi002.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-09-15T23:15:33.322 INFO:tasks.workunit.client.0.smithi002.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-09-15T23:15:33.322 INFO:tasks.workunit.client.0.smithi002.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-09-15T23:15:33.389 INFO:tasks.workunit.client.0.smithi002.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-09-15T23:15:33.389 INFO:tasks.workunit.client.0.smithi002.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-09-15T23:15:33.456 INFO:tasks.workunit.client.0.smithi002.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-09-15T23:15:33.457 INFO:tasks.workunit.client.0.smithi002.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-09-15T23:15:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:33 smithi145 ceph-mon[34901]: pgmap v39: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 423 KiB/s wr, 73 op/s 2024-09-15T23:15:33.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:33 smithi112 ceph-mon[34367]: pgmap v39: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 423 KiB/s wr, 73 op/s 2024-09-15T23:15:33.513 INFO:tasks.workunit.client.0.smithi002.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-09-15T23:15:33.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:33 smithi002 ceph-mon[31019]: pgmap v39: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 423 KiB/s wr, 73 op/s 2024-09-15T23:15:33.573 INFO:tasks.workunit.client.0.smithi002.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-15T23:15:33.573 INFO:tasks.workunit.client.0.smithi002.stdout:Making all in man 2024-09-15T23:15:33.585 INFO:tasks.workunit.client.0.smithi002.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-15T23:15:33.585 INFO:tasks.workunit.client.0.smithi002.stdout:make[2]: Nothing to be done for 'all'. 2024-09-15T23:15:33.585 INFO:tasks.workunit.client.0.smithi002.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-15T23:15:33.593 INFO:tasks.workunit.client.0.smithi002.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-15T23:15:33.596 INFO:tasks.workunit.client.0.smithi002.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-15T23:15:33.597 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-15T23:15:33.597 INFO:tasks.workunit.client.0.smithi002.stderr:+ cd src 2024-09-15T23:15:33.599 INFO:tasks.workunit.client.0.smithi002.stderr:+ mkdir blogtest_in 2024-09-15T23:15:33.602 INFO:tasks.workunit.client.0.smithi002.stdout:running blogbench 2024-09-15T23:15:33.602 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo 'running blogbench' 2024-09-15T23:15:33.602 INFO:tasks.workunit.client.0.smithi002.stderr:+ ./blogbench -d blogtest_in 2024-09-15T23:15:33.602 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-15T23:15:33.602 INFO:tasks.workunit.client.0.smithi002.stdout:Frequency = 10 secs 2024-09-15T23:15:33.602 INFO:tasks.workunit.client.0.smithi002.stdout:Scratch dir = [blogtest_in] 2024-09-15T23:15:35.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:35 smithi145 ceph-mon[34901]: pgmap v40: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 359 KiB/s wr, 62 op/s 2024-09-15T23:15:35.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:35 smithi112 ceph-mon[34367]: pgmap v40: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 359 KiB/s wr, 62 op/s 2024-09-15T23:15:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:35 smithi002 ceph-mon[31019]: pgmap v40: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 359 KiB/s wr, 62 op/s 2024-09-15T23:15:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:Spawning 3 writers... 2024-09-15T23:15:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:Spawning 1 rewriters... 2024-09-15T23:15:36.047 INFO:tasks.workunit.client.0.smithi002.stdout:Spawning 5 commenters... 2024-09-15T23:15:36.048 INFO:tasks.workunit.client.0.smithi002.stdout:Spawning 100 readers... 2024-09-15T23:15:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:Benchmarking for 30 iterations. 2024-09-15T23:15:36.050 INFO:tasks.workunit.client.0.smithi002.stdout:The test will run during 5 minutes. 2024-09-15T23:15:36.050 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-15T23:15:36.050 INFO:tasks.workunit.client.0.smithi002.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-09-15T23:15:37.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:37 smithi145 ceph-mon[34901]: pgmap v41: 97 pgs: 97 active+clean; 6.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 621 KiB/s wr, 144 op/s 2024-09-15T23:15:37.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:37 smithi112 ceph-mon[34367]: pgmap v41: 97 pgs: 97 active+clean; 6.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 621 KiB/s wr, 144 op/s 2024-09-15T23:15:37.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:37 smithi002 ceph-mon[31019]: pgmap v41: 97 pgs: 97 active+clean; 6.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 621 KiB/s wr, 144 op/s 2024-09-15T23:15:39.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:39 smithi145 ceph-mon[34901]: pgmap v42: 97 pgs: 97 active+clean; 6.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 540 KiB/s wr, 125 op/s 2024-09-15T23:15:39.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:39 smithi112 ceph-mon[34367]: pgmap v42: 97 pgs: 97 active+clean; 6.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 540 KiB/s wr, 125 op/s 2024-09-15T23:15:39.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:39 smithi002 ceph-mon[31019]: pgmap v42: 97 pgs: 97 active+clean; 6.3 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 540 KiB/s wr, 125 op/s 2024-09-15T23:15:41.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:41 smithi145 ceph-mon[34901]: pgmap v43: 97 pgs: 97 active+clean; 11 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 939 KiB/s wr, 152 op/s 2024-09-15T23:15:41.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:41 smithi112 ceph-mon[34367]: pgmap v43: 97 pgs: 97 active+clean; 11 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 939 KiB/s wr, 152 op/s 2024-09-15T23:15:41.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:41 smithi002 ceph-mon[31019]: pgmap v43: 97 pgs: 97 active+clean; 11 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 939 KiB/s wr, 152 op/s 2024-09-15T23:15:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:43 smithi145 ceph-mon[34901]: pgmap v44: 97 pgs: 97 active+clean; 17 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-09-15T23:15:43.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:43 smithi112 ceph-mon[34367]: pgmap v44: 97 pgs: 97 active+clean; 17 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-09-15T23:15:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:43 smithi002 ceph-mon[31019]: pgmap v44: 97 pgs: 97 active+clean; 17 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-09-15T23:15:45.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:45 smithi145 ceph-mon[34901]: pgmap v45: 97 pgs: 97 active+clean; 17 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-09-15T23:15:45.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:45 smithi112 ceph-mon[34367]: pgmap v45: 97 pgs: 97 active+clean; 17 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-09-15T23:15:45.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:45 smithi002 ceph-mon[31019]: pgmap v45: 97 pgs: 97 active+clean; 17 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-09-15T23:15:46.051 INFO:tasks.workunit.client.0.smithi002.stdout: 5 14464 323 9893 222 1543 405 2024-09-15T23:15:47.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:47 smithi145 ceph-mon[34901]: pgmap v46: 97 pgs: 97 active+clean; 26 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 2.0 MiB/s wr, 179 op/s 2024-09-15T23:15:47.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:47 smithi112 ceph-mon[34367]: pgmap v46: 97 pgs: 97 active+clean; 26 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 2.0 MiB/s wr, 179 op/s 2024-09-15T23:15:47.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:47 smithi002 ceph-mon[31019]: pgmap v46: 97 pgs: 97 active+clean; 26 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 2.0 MiB/s wr, 179 op/s 2024-09-15T23:15:49.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:49 smithi145 ceph-mon[34901]: pgmap v47: 97 pgs: 97 active+clean; 26 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 1.8 MiB/s wr, 101 op/s 2024-09-15T23:15:49.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:49 smithi112 ceph-mon[34367]: pgmap v47: 97 pgs: 97 active+clean; 26 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 1.8 MiB/s wr, 101 op/s 2024-09-15T23:15:49.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:49 smithi002 ceph-mon[31019]: pgmap v47: 97 pgs: 97 active+clean; 26 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 1.8 MiB/s wr, 101 op/s 2024-09-15T23:15:51.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:51 smithi145 ceph-mon[34901]: pgmap v48: 97 pgs: 97 active+clean; 35 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.6 MiB/s wr, 160 op/s 2024-09-15T23:15:51.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:51 smithi112 ceph-mon[34367]: pgmap v48: 97 pgs: 97 active+clean; 35 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.6 MiB/s wr, 160 op/s 2024-09-15T23:15:51.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:51 smithi002 ceph-mon[31019]: pgmap v48: 97 pgs: 97 active+clean; 35 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.6 MiB/s wr, 160 op/s 2024-09-15T23:15:53.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:53 smithi145 ceph-mon[34901]: pgmap v49: 97 pgs: 97 active+clean; 35 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.3 MiB/s wr, 142 op/s 2024-09-15T23:15:53.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:53 smithi112 ceph-mon[34367]: pgmap v49: 97 pgs: 97 active+clean; 35 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.3 MiB/s wr, 142 op/s 2024-09-15T23:15:53.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:53 smithi002 ceph-mon[31019]: pgmap v49: 97 pgs: 97 active+clean; 35 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.3 MiB/s wr, 142 op/s 2024-09-15T23:15:55.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:55 smithi145 ceph-mon[34901]: pgmap v50: 97 pgs: 97 active+clean; 35 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.8 MiB/s wr, 122 op/s 2024-09-15T23:15:55.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:55 smithi112 ceph-mon[34367]: pgmap v50: 97 pgs: 97 active+clean; 35 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.8 MiB/s wr, 122 op/s 2024-09-15T23:15:55.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:55 smithi002 ceph-mon[31019]: pgmap v50: 97 pgs: 97 active+clean; 35 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.8 MiB/s wr, 122 op/s 2024-09-15T23:15:56.051 INFO:tasks.workunit.client.0.smithi002.stdout: 8 13849 286 7640 196 3942 680 2024-09-15T23:15:57.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:57 smithi145 ceph-mon[34901]: pgmap v51: 97 pgs: 97 active+clean; 48 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 3.0 MiB/s wr, 203 op/s 2024-09-15T23:15:57.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:57 smithi145 ceph-mon[34901]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-09-15T23:15:57.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:57 smithi112 ceph-mon[34367]: pgmap v51: 97 pgs: 97 active+clean; 48 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 3.0 MiB/s wr, 203 op/s 2024-09-15T23:15:57.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:57 smithi112 ceph-mon[34367]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-09-15T23:15:57.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:57 smithi002 ceph-mon[31019]: pgmap v51: 97 pgs: 97 active+clean; 48 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 3.0 MiB/s wr, 203 op/s 2024-09-15T23:15:57.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:57 smithi002 ceph-mon[31019]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-09-15T23:15:59.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:15:59 smithi145 ceph-mon[34901]: pgmap v52: 97 pgs: 97 active+clean; 48 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 2.2 MiB/s wr, 149 op/s 2024-09-15T23:15:59.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:15:59 smithi112 ceph-mon[34367]: pgmap v52: 97 pgs: 97 active+clean; 48 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 2.2 MiB/s wr, 149 op/s 2024-09-15T23:15:59.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:15:59 smithi002 ceph-mon[31019]: pgmap v52: 97 pgs: 97 active+clean; 48 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 2.2 MiB/s wr, 149 op/s 2024-09-15T23:16:01.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:01 smithi145 ceph-mon[34901]: pgmap v53: 97 pgs: 97 active+clean; 56 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 2.9 MiB/s wr, 202 op/s 2024-09-15T23:16:01.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:01 smithi112 ceph-mon[34367]: pgmap v53: 97 pgs: 97 active+clean; 56 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 2.9 MiB/s wr, 202 op/s 2024-09-15T23:16:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:01 smithi002 ceph-mon[31019]: pgmap v53: 97 pgs: 97 active+clean; 56 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 2.9 MiB/s wr, 202 op/s 2024-09-15T23:16:03.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:03 smithi145 ceph-mon[34901]: pgmap v54: 97 pgs: 97 active+clean; 56 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 2.1 MiB/s wr, 142 op/s 2024-09-15T23:16:03.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:03 smithi112 ceph-mon[34367]: pgmap v54: 97 pgs: 97 active+clean; 56 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 2.1 MiB/s wr, 142 op/s 2024-09-15T23:16:03.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:03 smithi002 ceph-mon[31019]: pgmap v54: 97 pgs: 97 active+clean; 56 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 2.1 MiB/s wr, 142 op/s 2024-09-15T23:16:05.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:05 smithi112 ceph-mon[34367]: pgmap v55: 97 pgs: 97 active+clean; 56 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 2.0 MiB/s wr, 134 op/s 2024-09-15T23:16:05.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:05 smithi002 ceph-mon[31019]: pgmap v55: 97 pgs: 97 active+clean; 56 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 2.0 MiB/s wr, 134 op/s 2024-09-15T23:16:05.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:05 smithi145 ceph-mon[34901]: pgmap v55: 97 pgs: 97 active+clean; 56 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 2.0 MiB/s wr, 134 op/s 2024-09-15T23:16:06.050 INFO:tasks.workunit.client.0.smithi002.stdout: 11 13490 203 8782 108 5495 299 2024-09-15T23:16:07.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:07 smithi112 ceph-mon[34367]: pgmap v56: 97 pgs: 97 active+clean; 62 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 2.6 MiB/s wr, 189 op/s 2024-09-15T23:16:07.557 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:07 smithi002 ceph-mon[31019]: pgmap v56: 97 pgs: 97 active+clean; 62 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 2.6 MiB/s wr, 189 op/s 2024-09-15T23:16:07.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:07 smithi145 ceph-mon[34901]: pgmap v56: 97 pgs: 97 active+clean; 62 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 2.6 MiB/s wr, 189 op/s 2024-09-15T23:16:09.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:09 smithi112 ceph-mon[34367]: pgmap v57: 97 pgs: 97 active+clean; 62 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.3 MiB/s wr, 107 op/s 2024-09-15T23:16:09.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:09 smithi002 ceph-mon[31019]: pgmap v57: 97 pgs: 97 active+clean; 62 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.3 MiB/s wr, 107 op/s 2024-09-15T23:16:09.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:09 smithi145 ceph-mon[34901]: pgmap v57: 97 pgs: 97 active+clean; 62 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.3 MiB/s wr, 107 op/s 2024-09-15T23:16:11.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:11 smithi112 ceph-mon[34367]: pgmap v58: 97 pgs: 97 active+clean; 69 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.9 MiB/s wr, 144 op/s 2024-09-15T23:16:11.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:11 smithi002 ceph-mon[31019]: pgmap v58: 97 pgs: 97 active+clean; 69 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.9 MiB/s wr, 144 op/s 2024-09-15T23:16:11.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:11 smithi145 ceph-mon[34901]: pgmap v58: 97 pgs: 97 active+clean; 69 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.9 MiB/s wr, 144 op/s 2024-09-15T23:16:13.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:13 smithi112 ceph-mon[34367]: pgmap v59: 97 pgs: 97 active+clean; 69 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.2 MiB/s wr, 92 op/s 2024-09-15T23:16:13.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:13 smithi002 ceph-mon[31019]: pgmap v59: 97 pgs: 97 active+clean; 69 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.2 MiB/s wr, 92 op/s 2024-09-15T23:16:13.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:13 smithi145 ceph-mon[34901]: pgmap v59: 97 pgs: 97 active+clean; 69 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.2 MiB/s wr, 92 op/s 2024-09-15T23:16:15.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:15 smithi112 ceph-mon[34367]: pgmap v60: 97 pgs: 97 active+clean; 69 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.2 MiB/s wr, 92 op/s 2024-09-15T23:16:15.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:15 smithi002 ceph-mon[31019]: pgmap v60: 97 pgs: 97 active+clean; 69 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.2 MiB/s wr, 92 op/s 2024-09-15T23:16:15.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:15 smithi145 ceph-mon[34901]: pgmap v60: 97 pgs: 97 active+clean; 69 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.2 MiB/s wr, 92 op/s 2024-09-15T23:16:16.051 INFO:tasks.workunit.client.0.smithi002.stdout: 13 13844 96 9053 109 5689 240 2024-09-15T23:16:17.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:17 smithi112 ceph-mon[34367]: pgmap v61: 97 pgs: 97 active+clean; 74 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 1.7 MiB/s wr, 127 op/s 2024-09-15T23:16:17.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:17 smithi002 ceph-mon[31019]: pgmap v61: 97 pgs: 97 active+clean; 74 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 1.7 MiB/s wr, 127 op/s 2024-09-15T23:16:17.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:17 smithi145 ceph-mon[34901]: pgmap v61: 97 pgs: 97 active+clean; 74 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 1.7 MiB/s wr, 127 op/s 2024-09-15T23:16:19.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:19 smithi112 ceph-mon[34367]: pgmap v62: 97 pgs: 97 active+clean; 74 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 1.1 MiB/s wr, 71 op/s 2024-09-15T23:16:19.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:19 smithi002 ceph-mon[31019]: pgmap v62: 97 pgs: 97 active+clean; 74 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 1.1 MiB/s wr, 71 op/s 2024-09-15T23:16:19.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:19 smithi145 ceph-mon[34901]: pgmap v62: 97 pgs: 97 active+clean; 74 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 1.1 MiB/s wr, 71 op/s 2024-09-15T23:16:21.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:21 smithi112 ceph-mon[34367]: pgmap v63: 97 pgs: 97 active+clean; 79 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 1.6 MiB/s wr, 105 op/s 2024-09-15T23:16:21.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:21 smithi002 ceph-mon[31019]: pgmap v63: 97 pgs: 97 active+clean; 79 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 1.6 MiB/s wr, 105 op/s 2024-09-15T23:16:21.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:21 smithi145 ceph-mon[34901]: pgmap v63: 97 pgs: 97 active+clean; 79 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 1.6 MiB/s wr, 105 op/s 2024-09-15T23:16:23.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:23 smithi112 ceph-mon[34367]: pgmap v64: 97 pgs: 97 active+clean; 79 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 988 KiB/s wr, 67 op/s 2024-09-15T23:16:23.509 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:23 smithi145 ceph-mon[34901]: pgmap v64: 97 pgs: 97 active+clean; 79 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 988 KiB/s wr, 67 op/s 2024-09-15T23:16:23.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:23 smithi002 ceph-mon[31019]: pgmap v64: 97 pgs: 97 active+clean; 79 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 988 KiB/s wr, 67 op/s 2024-09-15T23:16:25.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:25 smithi112 ceph-mon[34367]: pgmap v65: 97 pgs: 97 active+clean; 79 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 988 KiB/s wr, 67 op/s 2024-09-15T23:16:25.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:25 smithi002 ceph-mon[31019]: pgmap v65: 97 pgs: 97 active+clean; 79 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 988 KiB/s wr, 67 op/s 2024-09-15T23:16:25.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:25 smithi145 ceph-mon[34901]: pgmap v65: 97 pgs: 97 active+clean; 79 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 988 KiB/s wr, 67 op/s 2024-09-15T23:16:26.051 INFO:tasks.workunit.client.0.smithi002.stdout: 13 13243 107 9378 91 6380 216 2024-09-15T23:16:27.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:27 smithi112 ceph-mon[34367]: pgmap v66: 97 pgs: 97 active+clean; 84 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-15T23:16:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:27 smithi002 ceph-mon[31019]: pgmap v66: 97 pgs: 97 active+clean; 84 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-15T23:16:27.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:27 smithi145 ceph-mon[34901]: pgmap v66: 97 pgs: 97 active+clean; 84 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-15T23:16:29.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:29 smithi112 ceph-mon[34367]: pgmap v67: 97 pgs: 97 active+clean; 84 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-15T23:16:29.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:29 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:16:29.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:29 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:29 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:29 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:29 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:29 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:29 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:29 smithi002 ceph-mon[31019]: pgmap v67: 97 pgs: 97 active+clean; 84 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-15T23:16:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:29 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:16:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:29 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:29 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:29 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:29 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:29 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:29 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:29 smithi145 ceph-mon[34901]: pgmap v67: 97 pgs: 97 active+clean; 84 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 1.0 MiB/s wr, 70 op/s 2024-09-15T23:16:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:29 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:16:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:29 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:29 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:29 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:29 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:29 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:29.708 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:29 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:30.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:30 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:16:30.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:30 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:16:30.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:30 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:30.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:30 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:16:30.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:30 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:16:30.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:30 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:30.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:30 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:16:30.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:30 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:16:30.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:30 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:16:31.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:31 smithi145 ceph-mon[34901]: pgmap v68: 97 pgs: 97 active+clean; 89 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 1.5 MiB/s wr, 103 op/s 2024-09-15T23:16:31.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:31 smithi112 ceph-mon[34367]: pgmap v68: 97 pgs: 97 active+clean; 89 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 1.5 MiB/s wr, 103 op/s 2024-09-15T23:16:31.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:31 smithi002 ceph-mon[31019]: pgmap v68: 97 pgs: 97 active+clean; 89 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 1.5 MiB/s wr, 103 op/s 2024-09-15T23:16:33.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:33 smithi145 ceph-mon[34901]: pgmap v69: 97 pgs: 97 active+clean; 89 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 997 KiB/s wr, 70 op/s 2024-09-15T23:16:33.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:33 smithi112 ceph-mon[34367]: pgmap v69: 97 pgs: 97 active+clean; 89 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 997 KiB/s wr, 70 op/s 2024-09-15T23:16:33.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:33 smithi002 ceph-mon[31019]: pgmap v69: 97 pgs: 97 active+clean; 89 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 997 KiB/s wr, 70 op/s 2024-09-15T23:16:35.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:35 smithi145 ceph-mon[34901]: pgmap v70: 97 pgs: 97 active+clean; 89 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 997 KiB/s wr, 70 op/s 2024-09-15T23:16:35.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:35 smithi112 ceph-mon[34367]: pgmap v70: 97 pgs: 97 active+clean; 89 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 997 KiB/s wr, 70 op/s 2024-09-15T23:16:35.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:35 smithi002 ceph-mon[31019]: pgmap v70: 97 pgs: 97 active+clean; 89 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 997 KiB/s wr, 70 op/s 2024-09-15T23:16:36.051 INFO:tasks.workunit.client.0.smithi002.stdout: 15 13290 105 10198 75 5716 192 2024-09-15T23:16:37.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:37 smithi145 ceph-mon[34901]: pgmap v71: 97 pgs: 97 active+clean; 93 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 1.4 MiB/s wr, 100 op/s 2024-09-15T23:16:37.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:37 smithi112 ceph-mon[34367]: pgmap v71: 97 pgs: 97 active+clean; 93 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 1.4 MiB/s wr, 100 op/s 2024-09-15T23:16:37.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:37 smithi002 ceph-mon[31019]: pgmap v71: 97 pgs: 97 active+clean; 93 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 1.4 MiB/s wr, 100 op/s 2024-09-15T23:16:39.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:39 smithi145 ceph-mon[34901]: pgmap v72: 97 pgs: 97 active+clean; 93 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 851 KiB/s wr, 62 op/s 2024-09-15T23:16:39.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:39 smithi112 ceph-mon[34367]: pgmap v72: 97 pgs: 97 active+clean; 93 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 851 KiB/s wr, 62 op/s 2024-09-15T23:16:39.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:39 smithi002 ceph-mon[31019]: pgmap v72: 97 pgs: 97 active+clean; 93 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 851 KiB/s wr, 62 op/s 2024-09-15T23:16:41.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:41 smithi145 ceph-mon[34901]: pgmap v73: 97 pgs: 97 active+clean; 97 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 1.2 MiB/s wr, 90 op/s 2024-09-15T23:16:41.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:41 smithi112 ceph-mon[34367]: pgmap v73: 97 pgs: 97 active+clean; 97 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 1.2 MiB/s wr, 90 op/s 2024-09-15T23:16:41.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:41 smithi002 ceph-mon[31019]: pgmap v73: 97 pgs: 97 active+clean; 97 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 1.2 MiB/s wr, 90 op/s 2024-09-15T23:16:43.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:43 smithi145 ceph-mon[34901]: pgmap v74: 97 pgs: 97 active+clean; 97 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 744 KiB/s wr, 58 op/s 2024-09-15T23:16:43.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:43 smithi112 ceph-mon[34367]: pgmap v74: 97 pgs: 97 active+clean; 97 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 744 KiB/s wr, 58 op/s 2024-09-15T23:16:43.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:43 smithi002 ceph-mon[31019]: pgmap v74: 97 pgs: 97 active+clean; 97 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 744 KiB/s wr, 58 op/s 2024-09-15T23:16:45.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:45 smithi145 ceph-mon[34901]: pgmap v75: 97 pgs: 97 active+clean; 97 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 744 KiB/s wr, 58 op/s 2024-09-15T23:16:45.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:45 smithi112 ceph-mon[34367]: pgmap v75: 97 pgs: 97 active+clean; 97 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 744 KiB/s wr, 58 op/s 2024-09-15T23:16:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:45 smithi002 ceph-mon[31019]: pgmap v75: 97 pgs: 97 active+clean; 97 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 744 KiB/s wr, 58 op/s 2024-09-15T23:16:46.051 INFO:tasks.workunit.client.0.smithi002.stdout: 15 13544 96 9805 70 6006 248 2024-09-15T23:16:47.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:47 smithi145 ceph-mon[34901]: pgmap v76: 97 pgs: 97 active+clean; 102 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 1.2 MiB/s wr, 89 op/s 2024-09-15T23:16:47.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:47 smithi112 ceph-mon[34367]: pgmap v76: 97 pgs: 97 active+clean; 102 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 1.2 MiB/s wr, 89 op/s 2024-09-15T23:16:47.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:47 smithi002 ceph-mon[31019]: pgmap v76: 97 pgs: 97 active+clean; 102 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 1.2 MiB/s wr, 89 op/s 2024-09-15T23:16:49.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:49 smithi145 ceph-mon[34901]: pgmap v77: 97 pgs: 97 active+clean; 102 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 869 KiB/s wr, 59 op/s 2024-09-15T23:16:49.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:49 smithi112 ceph-mon[34367]: pgmap v77: 97 pgs: 97 active+clean; 102 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 869 KiB/s wr, 59 op/s 2024-09-15T23:16:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:49 smithi002 ceph-mon[31019]: pgmap v77: 97 pgs: 97 active+clean; 102 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 869 KiB/s wr, 59 op/s 2024-09-15T23:16:51.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:51 smithi145 ceph-mon[34901]: pgmap v78: 97 pgs: 97 active+clean; 108 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.3 MiB/s wr, 95 op/s 2024-09-15T23:16:51.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:51 smithi112 ceph-mon[34367]: pgmap v78: 97 pgs: 97 active+clean; 108 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.3 MiB/s wr, 95 op/s 2024-09-15T23:16:51.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:51 smithi002 ceph-mon[31019]: pgmap v78: 97 pgs: 97 active+clean; 108 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.3 MiB/s wr, 95 op/s 2024-09-15T23:16:53.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:53 smithi145 ceph-mon[34901]: pgmap v79: 97 pgs: 97 active+clean; 108 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1017 KiB/s wr, 67 op/s 2024-09-15T23:16:53.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:53 smithi112 ceph-mon[34367]: pgmap v79: 97 pgs: 97 active+clean; 108 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1017 KiB/s wr, 67 op/s 2024-09-15T23:16:53.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:53 smithi002 ceph-mon[31019]: pgmap v79: 97 pgs: 97 active+clean; 108 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1017 KiB/s wr, 67 op/s 2024-09-15T23:16:55.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:55 smithi145 ceph-mon[34901]: pgmap v80: 97 pgs: 97 active+clean; 108 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1017 KiB/s wr, 67 op/s 2024-09-15T23:16:55.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:55 smithi112 ceph-mon[34367]: pgmap v80: 97 pgs: 97 active+clean; 108 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1017 KiB/s wr, 67 op/s 2024-09-15T23:16:55.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:55 smithi002 ceph-mon[31019]: pgmap v80: 97 pgs: 97 active+clean; 108 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1017 KiB/s wr, 67 op/s 2024-09-15T23:16:56.051 INFO:tasks.workunit.client.0.smithi002.stdout: 17 13034 90 9551 48 7083 182 2024-09-15T23:16:57.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:57 smithi145 ceph-mon[34901]: pgmap v81: 97 pgs: 97 active+clean; 112 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 1.4 MiB/s wr, 99 op/s 2024-09-15T23:16:57.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:57 smithi112 ceph-mon[34367]: pgmap v81: 97 pgs: 97 active+clean; 112 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 1.4 MiB/s wr, 99 op/s 2024-09-15T23:16:57.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:57 smithi002 ceph-mon[31019]: pgmap v81: 97 pgs: 97 active+clean; 112 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 1.4 MiB/s wr, 99 op/s 2024-09-15T23:16:59.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:16:59 smithi145 ceph-mon[34901]: pgmap v82: 97 pgs: 97 active+clean; 112 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 904 KiB/s wr, 68 op/s 2024-09-15T23:16:59.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:16:59 smithi112 ceph-mon[34367]: pgmap v82: 97 pgs: 97 active+clean; 112 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 904 KiB/s wr, 68 op/s 2024-09-15T23:16:59.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:16:59 smithi002 ceph-mon[31019]: pgmap v82: 97 pgs: 97 active+clean; 112 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 904 KiB/s wr, 68 op/s 2024-09-15T23:17:01.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:01 smithi145 ceph-mon[34901]: pgmap v83: 97 pgs: 97 active+clean; 115 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.2 MiB/s wr, 94 op/s 2024-09-15T23:17:01.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:01 smithi112 ceph-mon[34367]: pgmap v83: 97 pgs: 97 active+clean; 115 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.2 MiB/s wr, 94 op/s 2024-09-15T23:17:01.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:01 smithi002 ceph-mon[31019]: pgmap v83: 97 pgs: 97 active+clean; 115 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.2 MiB/s wr, 94 op/s 2024-09-15T23:17:03.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:03 smithi145 ceph-mon[34901]: pgmap v84: 97 pgs: 97 active+clean; 115 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 686 KiB/s wr, 57 op/s 2024-09-15T23:17:03.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:03 smithi112 ceph-mon[34367]: pgmap v84: 97 pgs: 97 active+clean; 115 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 686 KiB/s wr, 57 op/s 2024-09-15T23:17:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:03 smithi002 ceph-mon[31019]: pgmap v84: 97 pgs: 97 active+clean; 115 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 686 KiB/s wr, 57 op/s 2024-09-15T23:17:05.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:05 smithi145 ceph-mon[34901]: pgmap v85: 97 pgs: 97 active+clean; 115 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 686 KiB/s wr, 57 op/s 2024-09-15T23:17:05.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:05 smithi112 ceph-mon[34367]: pgmap v85: 97 pgs: 97 active+clean; 115 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 686 KiB/s wr, 57 op/s 2024-09-15T23:17:05.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:05 smithi002 ceph-mon[31019]: pgmap v85: 97 pgs: 97 active+clean; 115 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 686 KiB/s wr, 57 op/s 2024-09-15T23:17:06.051 INFO:tasks.workunit.client.0.smithi002.stdout: 19 13711 87 9589 47 5628 150 2024-09-15T23:17:07.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:07 smithi145 ceph-mon[34901]: pgmap v86: 97 pgs: 97 active+clean; 120 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 1.2 MiB/s wr, 101 op/s 2024-09-15T23:17:07.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:07 smithi112 ceph-mon[34367]: pgmap v86: 97 pgs: 97 active+clean; 120 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 1.2 MiB/s wr, 101 op/s 2024-09-15T23:17:07.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:07 smithi002 ceph-mon[31019]: pgmap v86: 97 pgs: 97 active+clean; 120 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 1.2 MiB/s wr, 101 op/s 2024-09-15T23:17:09.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:09 smithi145 ceph-mon[34901]: pgmap v87: 97 pgs: 97 active+clean; 120 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 786 KiB/s wr, 69 op/s 2024-09-15T23:17:09.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:09 smithi112 ceph-mon[34367]: pgmap v87: 97 pgs: 97 active+clean; 120 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 786 KiB/s wr, 69 op/s 2024-09-15T23:17:09.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:09 smithi002 ceph-mon[31019]: pgmap v87: 97 pgs: 97 active+clean; 120 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 786 KiB/s wr, 69 op/s 2024-09-15T23:17:11.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:11 smithi145 ceph-mon[34901]: pgmap v88: 97 pgs: 97 active+clean; 125 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 1.2 MiB/s wr, 96 op/s 2024-09-15T23:17:11.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:11 smithi112 ceph-mon[34367]: pgmap v88: 97 pgs: 97 active+clean; 125 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 1.2 MiB/s wr, 96 op/s 2024-09-15T23:17:11.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:11 smithi002 ceph-mon[31019]: pgmap v88: 97 pgs: 97 active+clean; 125 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 1.2 MiB/s wr, 96 op/s 2024-09-15T23:17:13.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:13 smithi145 ceph-mon[34901]: pgmap v89: 97 pgs: 97 active+clean; 125 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 981 KiB/s wr, 70 op/s 2024-09-15T23:17:13.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:13 smithi112 ceph-mon[34367]: pgmap v89: 97 pgs: 97 active+clean; 125 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 981 KiB/s wr, 70 op/s 2024-09-15T23:17:13.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:13 smithi002 ceph-mon[31019]: pgmap v89: 97 pgs: 97 active+clean; 125 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 981 KiB/s wr, 70 op/s 2024-09-15T23:17:14.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:14 smithi145 ceph-mon[34901]: pgmap v90: 97 pgs: 97 active+clean; 125 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 981 KiB/s wr, 70 op/s 2024-09-15T23:17:14.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:14 smithi112 ceph-mon[34367]: pgmap v90: 97 pgs: 97 active+clean; 125 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 981 KiB/s wr, 70 op/s 2024-09-15T23:17:14.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:14 smithi002 ceph-mon[31019]: pgmap v90: 97 pgs: 97 active+clean; 125 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 981 KiB/s wr, 70 op/s 2024-09-15T23:17:16.051 INFO:tasks.workunit.client.0.smithi002.stdout: 20 13460 52 8979 84 5640 139 2024-09-15T23:17:16.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:16 smithi145 ceph-mon[34901]: pgmap v91: 97 pgs: 97 active+clean; 132 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 1.5 MiB/s wr, 95 op/s 2024-09-15T23:17:16.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:16 smithi112 ceph-mon[34367]: pgmap v91: 97 pgs: 97 active+clean; 132 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 1.5 MiB/s wr, 95 op/s 2024-09-15T23:17:17.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:16 smithi002 ceph-mon[31019]: pgmap v91: 97 pgs: 97 active+clean; 132 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 1.5 MiB/s wr, 95 op/s 2024-09-15T23:17:18.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:18 smithi145 ceph-mon[34901]: pgmap v92: 97 pgs: 97 active+clean; 132 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.0 MiB/s wr, 52 op/s 2024-09-15T23:17:18.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:18 smithi112 ceph-mon[34367]: pgmap v92: 97 pgs: 97 active+clean; 132 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.0 MiB/s wr, 52 op/s 2024-09-15T23:17:19.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:18 smithi002 ceph-mon[31019]: pgmap v92: 97 pgs: 97 active+clean; 132 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.0 MiB/s wr, 52 op/s 2024-09-15T23:17:20.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:20 smithi145 ceph-mon[34901]: pgmap v93: 97 pgs: 97 active+clean; 137 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 1.5 MiB/s wr, 76 op/s 2024-09-15T23:17:20.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:20 smithi112 ceph-mon[34367]: pgmap v93: 97 pgs: 97 active+clean; 137 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 1.5 MiB/s wr, 76 op/s 2024-09-15T23:17:21.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:20 smithi002 ceph-mon[31019]: pgmap v93: 97 pgs: 97 active+clean; 137 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 1.5 MiB/s wr, 76 op/s 2024-09-15T23:17:22.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:22 smithi145 ceph-mon[34901]: pgmap v94: 97 pgs: 97 active+clean; 137 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1011 KiB/s wr, 49 op/s 2024-09-15T23:17:22.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:22 smithi112 ceph-mon[34367]: pgmap v94: 97 pgs: 97 active+clean; 137 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1011 KiB/s wr, 49 op/s 2024-09-15T23:17:23.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:22 smithi002 ceph-mon[31019]: pgmap v94: 97 pgs: 97 active+clean; 137 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1011 KiB/s wr, 49 op/s 2024-09-15T23:17:24.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:24 smithi145 ceph-mon[34901]: pgmap v95: 97 pgs: 97 active+clean; 137 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1011 KiB/s wr, 49 op/s 2024-09-15T23:17:24.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:24 smithi112 ceph-mon[34367]: pgmap v95: 97 pgs: 97 active+clean; 137 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1011 KiB/s wr, 49 op/s 2024-09-15T23:17:25.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:24 smithi002 ceph-mon[31019]: pgmap v95: 97 pgs: 97 active+clean; 137 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1011 KiB/s wr, 49 op/s 2024-09-15T23:17:26.051 INFO:tasks.workunit.client.0.smithi002.stdout: 21 12348 29 8566 98 7308 155 2024-09-15T23:17:26.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:26 smithi145 ceph-mon[34901]: pgmap v96: 97 pgs: 97 active+clean; 142 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 1.5 MiB/s wr, 76 op/s 2024-09-15T23:17:26.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:26 smithi112 ceph-mon[34367]: pgmap v96: 97 pgs: 97 active+clean; 142 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 1.5 MiB/s wr, 76 op/s 2024-09-15T23:17:27.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:26 smithi002 ceph-mon[31019]: pgmap v96: 97 pgs: 97 active+clean; 142 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 1.5 MiB/s wr, 76 op/s 2024-09-15T23:17:28.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:28 smithi145 ceph-mon[34901]: pgmap v97: 97 pgs: 97 active+clean; 142 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 962 KiB/s wr, 50 op/s 2024-09-15T23:17:28.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:28 smithi112 ceph-mon[34367]: pgmap v97: 97 pgs: 97 active+clean; 142 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 962 KiB/s wr, 50 op/s 2024-09-15T23:17:29.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:28 smithi002 ceph-mon[31019]: pgmap v97: 97 pgs: 97 active+clean; 142 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 962 KiB/s wr, 50 op/s 2024-09-15T23:17:29.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:29 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:17:29.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:29 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:17:30.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:29 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:17:30.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:30 smithi145 ceph-mon[34901]: pgmap v98: 97 pgs: 97 active+clean; 149 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 1.5 MiB/s wr, 78 op/s 2024-09-15T23:17:30.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:30 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:17:30.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:30 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:17:30.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:30 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:17:30.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:30 smithi112 ceph-mon[34367]: pgmap v98: 97 pgs: 97 active+clean; 149 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 1.5 MiB/s wr, 78 op/s 2024-09-15T23:17:30.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:30 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:17:30.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:30 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:17:30.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:30 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:17:31.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:30 smithi002 ceph-mon[31019]: pgmap v98: 97 pgs: 97 active+clean; 149 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 1.5 MiB/s wr, 78 op/s 2024-09-15T23:17:31.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:30 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:17:31.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:30 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:17:31.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:30 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:17:32.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:32 smithi145 ceph-mon[34901]: pgmap v99: 97 pgs: 97 active+clean; 149 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.1 MiB/s wr, 54 op/s 2024-09-15T23:17:32.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:32 smithi112 ceph-mon[34367]: pgmap v99: 97 pgs: 97 active+clean; 149 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.1 MiB/s wr, 54 op/s 2024-09-15T23:17:33.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:32 smithi002 ceph-mon[31019]: pgmap v99: 97 pgs: 97 active+clean; 149 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.1 MiB/s wr, 54 op/s 2024-09-15T23:17:34.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:34 smithi145 ceph-mon[34901]: pgmap v100: 97 pgs: 97 active+clean; 149 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.1 MiB/s wr, 54 op/s 2024-09-15T23:17:34.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:34 smithi112 ceph-mon[34367]: pgmap v100: 97 pgs: 97 active+clean; 149 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.1 MiB/s wr, 54 op/s 2024-09-15T23:17:35.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:34 smithi002 ceph-mon[31019]: pgmap v100: 97 pgs: 97 active+clean; 149 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.1 MiB/s wr, 54 op/s 2024-09-15T23:17:36.051 INFO:tasks.workunit.client.0.smithi002.stdout: 24 13177 49 8844 95 6106 186 2024-09-15T23:17:36.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:36 smithi145 ceph-mon[34901]: pgmap v101: 97 pgs: 97 active+clean; 155 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1.6 MiB/s wr, 81 op/s 2024-09-15T23:17:36.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:36 smithi112 ceph-mon[34367]: pgmap v101: 97 pgs: 97 active+clean; 155 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1.6 MiB/s wr, 81 op/s 2024-09-15T23:17:37.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:36 smithi002 ceph-mon[31019]: pgmap v101: 97 pgs: 97 active+clean; 155 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1.6 MiB/s wr, 81 op/s 2024-09-15T23:17:38.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:38 smithi145 ceph-mon[34901]: pgmap v102: 97 pgs: 97 active+clean; 155 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 1.1 MiB/s wr, 54 op/s 2024-09-15T23:17:38.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:38 smithi112 ceph-mon[34367]: pgmap v102: 97 pgs: 97 active+clean; 155 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 1.1 MiB/s wr, 54 op/s 2024-09-15T23:17:39.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:38 smithi002 ceph-mon[31019]: pgmap v102: 97 pgs: 97 active+clean; 155 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 1.1 MiB/s wr, 54 op/s 2024-09-15T23:17:40.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:40 smithi145 ceph-mon[34901]: pgmap v103: 97 pgs: 97 active+clean; 159 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.5 MiB/s wr, 85 op/s 2024-09-15T23:17:40.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:40 smithi112 ceph-mon[34367]: pgmap v103: 97 pgs: 97 active+clean; 159 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.5 MiB/s wr, 85 op/s 2024-09-15T23:17:41.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:40 smithi002 ceph-mon[31019]: pgmap v103: 97 pgs: 97 active+clean; 159 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.5 MiB/s wr, 85 op/s 2024-09-15T23:17:42.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:42 smithi145 ceph-mon[34901]: pgmap v104: 97 pgs: 97 active+clean; 159 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 972 KiB/s wr, 57 op/s 2024-09-15T23:17:42.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:42 smithi112 ceph-mon[34367]: pgmap v104: 97 pgs: 97 active+clean; 159 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 972 KiB/s wr, 57 op/s 2024-09-15T23:17:43.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:42 smithi002 ceph-mon[31019]: pgmap v104: 97 pgs: 97 active+clean; 159 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 972 KiB/s wr, 57 op/s 2024-09-15T23:17:44.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:44 smithi145 ceph-mon[34901]: pgmap v105: 97 pgs: 97 active+clean; 159 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 972 KiB/s wr, 57 op/s 2024-09-15T23:17:44.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:44 smithi112 ceph-mon[34367]: pgmap v105: 97 pgs: 97 active+clean; 159 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 972 KiB/s wr, 57 op/s 2024-09-15T23:17:45.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:44 smithi002 ceph-mon[31019]: pgmap v105: 97 pgs: 97 active+clean; 159 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 972 KiB/s wr, 57 op/s 2024-09-15T23:17:46.051 INFO:tasks.workunit.client.0.smithi002.stdout: 25 12650 99 9364 10 6605 134 2024-09-15T23:17:46.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:46 smithi145 ceph-mon[34901]: pgmap v106: 97 pgs: 97 active+clean; 165 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.5 MiB/s wr, 74 op/s 2024-09-15T23:17:46.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:46 smithi112 ceph-mon[34367]: pgmap v106: 97 pgs: 97 active+clean; 165 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.5 MiB/s wr, 74 op/s 2024-09-15T23:17:47.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:46 smithi002 ceph-mon[31019]: pgmap v106: 97 pgs: 97 active+clean; 165 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.5 MiB/s wr, 74 op/s 2024-09-15T23:17:48.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:48 smithi145 ceph-mon[34901]: pgmap v107: 97 pgs: 97 active+clean; 165 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 939 KiB/s wr, 47 op/s 2024-09-15T23:17:48.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:48 smithi112 ceph-mon[34367]: pgmap v107: 97 pgs: 97 active+clean; 165 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 939 KiB/s wr, 47 op/s 2024-09-15T23:17:49.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:48 smithi002 ceph-mon[31019]: pgmap v107: 97 pgs: 97 active+clean; 165 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 939 KiB/s wr, 47 op/s 2024-09-15T23:17:50.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:50 smithi145 ceph-mon[34901]: pgmap v108: 97 pgs: 97 active+clean; 170 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 64 op/s 2024-09-15T23:17:50.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:50 smithi112 ceph-mon[34367]: pgmap v108: 97 pgs: 97 active+clean; 170 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 64 op/s 2024-09-15T23:17:51.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:50 smithi002 ceph-mon[31019]: pgmap v108: 97 pgs: 97 active+clean; 170 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 64 op/s 2024-09-15T23:17:52.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:52 smithi145 ceph-mon[34901]: pgmap v109: 97 pgs: 97 active+clean; 170 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 942 KiB/s wr, 34 op/s 2024-09-15T23:17:52.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:52 smithi112 ceph-mon[34367]: pgmap v109: 97 pgs: 97 active+clean; 170 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 942 KiB/s wr, 34 op/s 2024-09-15T23:17:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:52 smithi002 ceph-mon[31019]: pgmap v109: 97 pgs: 97 active+clean; 170 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 942 KiB/s wr, 34 op/s 2024-09-15T23:17:54.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:54 smithi145 ceph-mon[34901]: pgmap v110: 97 pgs: 97 active+clean; 170 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 942 KiB/s wr, 34 op/s 2024-09-15T23:17:54.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:54 smithi112 ceph-mon[34367]: pgmap v110: 97 pgs: 97 active+clean; 170 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 942 KiB/s wr, 34 op/s 2024-09-15T23:17:55.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:54 smithi002 ceph-mon[31019]: pgmap v110: 97 pgs: 97 active+clean; 170 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 942 KiB/s wr, 34 op/s 2024-09-15T23:17:56.051 INFO:tasks.workunit.client.0.smithi002.stdout: 25 12396 61 9810 27 7084 94 2024-09-15T23:17:56.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:56 smithi145 ceph-mon[34901]: pgmap v111: 97 pgs: 97 active+clean; 173 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 1.2 MiB/s wr, 51 op/s 2024-09-15T23:17:56.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:56 smithi112 ceph-mon[34367]: pgmap v111: 97 pgs: 97 active+clean; 173 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 1.2 MiB/s wr, 51 op/s 2024-09-15T23:17:57.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:56 smithi002 ceph-mon[31019]: pgmap v111: 97 pgs: 97 active+clean; 173 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 1.2 MiB/s wr, 51 op/s 2024-09-15T23:17:58.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:17:58 smithi145 ceph-mon[34901]: pgmap v112: 97 pgs: 97 active+clean; 173 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 717 KiB/s wr, 34 op/s 2024-09-15T23:17:58.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:17:58 smithi112 ceph-mon[34367]: pgmap v112: 97 pgs: 97 active+clean; 173 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 717 KiB/s wr, 34 op/s 2024-09-15T23:17:59.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:17:58 smithi002 ceph-mon[31019]: pgmap v112: 97 pgs: 97 active+clean; 173 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 717 KiB/s wr, 34 op/s 2024-09-15T23:18:00.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:00 smithi145 ceph-mon[34901]: pgmap v113: 97 pgs: 97 active+clean; 179 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.2 MiB/s wr, 51 op/s 2024-09-15T23:18:00.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:00 smithi112 ceph-mon[34367]: pgmap v113: 97 pgs: 97 active+clean; 179 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.2 MiB/s wr, 51 op/s 2024-09-15T23:18:01.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:00 smithi002 ceph-mon[31019]: pgmap v113: 97 pgs: 97 active+clean; 179 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.2 MiB/s wr, 51 op/s 2024-09-15T23:18:02.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:02 smithi145 ceph-mon[34901]: pgmap v114: 97 pgs: 97 active+clean; 179 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 812 KiB/s wr, 33 op/s 2024-09-15T23:18:02.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:02 smithi112 ceph-mon[34367]: pgmap v114: 97 pgs: 97 active+clean; 179 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 812 KiB/s wr, 33 op/s 2024-09-15T23:18:03.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:02 smithi002 ceph-mon[31019]: pgmap v114: 97 pgs: 97 active+clean; 179 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 812 KiB/s wr, 33 op/s 2024-09-15T23:18:04.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:04 smithi145 ceph-mon[34901]: pgmap v115: 97 pgs: 97 active+clean; 179 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 812 KiB/s wr, 33 op/s 2024-09-15T23:18:04.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:04 smithi112 ceph-mon[34367]: pgmap v115: 97 pgs: 97 active+clean; 179 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 812 KiB/s wr, 33 op/s 2024-09-15T23:18:05.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:04 smithi002 ceph-mon[31019]: pgmap v115: 97 pgs: 97 active+clean; 179 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 812 KiB/s wr, 33 op/s 2024-09-15T23:18:06.052 INFO:tasks.workunit.client.0.smithi002.stdout: 25 12847 50 8505 54 6286 104 2024-09-15T23:18:06.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:06 smithi145 ceph-mon[34901]: pgmap v116: 97 pgs: 97 active+clean; 186 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 72 op/s 2024-09-15T23:18:06.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:06 smithi112 ceph-mon[34367]: pgmap v116: 97 pgs: 97 active+clean; 186 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 72 op/s 2024-09-15T23:18:07.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:06 smithi002 ceph-mon[31019]: pgmap v116: 97 pgs: 97 active+clean; 186 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 72 op/s 2024-09-15T23:18:08.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:08 smithi145 ceph-mon[34901]: pgmap v117: 97 pgs: 97 active+clean; 186 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-15T23:18:08.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:08 smithi112 ceph-mon[34367]: pgmap v117: 97 pgs: 97 active+clean; 186 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-15T23:18:09.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:08 smithi002 ceph-mon[31019]: pgmap v117: 97 pgs: 97 active+clean; 186 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-09-15T23:18:10.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:10 smithi145 ceph-mon[34901]: pgmap v118: 97 pgs: 97 active+clean; 194 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 78 op/s 2024-09-15T23:18:10.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:10 smithi112 ceph-mon[34367]: pgmap v118: 97 pgs: 97 active+clean; 194 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 78 op/s 2024-09-15T23:18:11.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:10 smithi002 ceph-mon[31019]: pgmap v118: 97 pgs: 97 active+clean; 194 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 78 op/s 2024-09-15T23:18:12.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:12 smithi145 ceph-mon[34901]: pgmap v119: 97 pgs: 97 active+clean; 194 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 1.3 MiB/s wr, 62 op/s 2024-09-15T23:18:12.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:12 smithi112 ceph-mon[34367]: pgmap v119: 97 pgs: 97 active+clean; 194 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 1.3 MiB/s wr, 62 op/s 2024-09-15T23:18:13.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:12 smithi002 ceph-mon[31019]: pgmap v119: 97 pgs: 97 active+clean; 194 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 1.3 MiB/s wr, 62 op/s 2024-09-15T23:18:14.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:14 smithi145 ceph-mon[34901]: pgmap v120: 97 pgs: 97 active+clean; 194 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 1.3 MiB/s wr, 62 op/s 2024-09-15T23:18:14.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:14 smithi112 ceph-mon[34367]: pgmap v120: 97 pgs: 97 active+clean; 194 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 1.3 MiB/s wr, 62 op/s 2024-09-15T23:18:15.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:14 smithi002 ceph-mon[31019]: pgmap v120: 97 pgs: 97 active+clean; 194 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 1.3 MiB/s wr, 62 op/s 2024-09-15T23:18:16.052 INFO:tasks.workunit.client.0.smithi002.stdout: 26 12505 34 9001 74 6413 126 2024-09-15T23:18:16.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:16 smithi145 ceph-mon[34901]: pgmap v121: 97 pgs: 97 active+clean; 202 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 90 op/s 2024-09-15T23:18:16.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:16 smithi112 ceph-mon[34367]: pgmap v121: 97 pgs: 97 active+clean; 202 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 90 op/s 2024-09-15T23:18:17.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:16 smithi002 ceph-mon[31019]: pgmap v121: 97 pgs: 97 active+clean; 202 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 90 op/s 2024-09-15T23:18:18.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:18 smithi145 ceph-mon[34901]: pgmap v122: 97 pgs: 97 active+clean; 202 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1.4 MiB/s wr, 51 op/s 2024-09-15T23:18:18.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:18 smithi112 ceph-mon[34367]: pgmap v122: 97 pgs: 97 active+clean; 202 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1.4 MiB/s wr, 51 op/s 2024-09-15T23:18:19.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:18 smithi002 ceph-mon[31019]: pgmap v122: 97 pgs: 97 active+clean; 202 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1.4 MiB/s wr, 51 op/s 2024-09-15T23:18:20.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:20 smithi145 ceph-mon[34901]: pgmap v123: 97 pgs: 97 active+clean; 210 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 84 op/s 2024-09-15T23:18:20.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:20 smithi112 ceph-mon[34367]: pgmap v123: 97 pgs: 97 active+clean; 210 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 84 op/s 2024-09-15T23:18:21.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:20 smithi002 ceph-mon[31019]: pgmap v123: 97 pgs: 97 active+clean; 210 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 84 op/s 2024-09-15T23:18:22.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:22 smithi145 ceph-mon[34901]: pgmap v124: 97 pgs: 97 active+clean; 210 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 60 op/s 2024-09-15T23:18:22.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:22 smithi112 ceph-mon[34367]: pgmap v124: 97 pgs: 97 active+clean; 210 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 60 op/s 2024-09-15T23:18:23.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:22 smithi002 ceph-mon[31019]: pgmap v124: 97 pgs: 97 active+clean; 210 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 60 op/s 2024-09-15T23:18:24.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:24 smithi145 ceph-mon[34901]: pgmap v125: 97 pgs: 97 active+clean; 210 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 60 op/s 2024-09-15T23:18:24.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:24 smithi112 ceph-mon[34367]: pgmap v125: 97 pgs: 97 active+clean; 210 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 60 op/s 2024-09-15T23:18:25.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:24 smithi002 ceph-mon[31019]: pgmap v125: 97 pgs: 97 active+clean; 210 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 60 op/s 2024-09-15T23:18:26.052 INFO:tasks.workunit.client.0.smithi002.stdout: 28 13071 62 8827 48 5756 134 2024-09-15T23:18:26.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:26 smithi145 ceph-mon[34901]: pgmap v126: 97 pgs: 97 active+clean; 218 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 86 op/s 2024-09-15T23:18:26.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:26 smithi112 ceph-mon[34367]: pgmap v126: 97 pgs: 97 active+clean; 218 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 86 op/s 2024-09-15T23:18:27.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:26 smithi002 ceph-mon[31019]: pgmap v126: 97 pgs: 97 active+clean; 218 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 86 op/s 2024-09-15T23:18:28.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:28 smithi112 ceph-mon[34367]: pgmap v127: 97 pgs: 97 active+clean; 218 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 58 op/s 2024-09-15T23:18:29.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:28 smithi002 ceph-mon[31019]: pgmap v127: 97 pgs: 97 active+clean; 218 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 58 op/s 2024-09-15T23:18:29.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:28 smithi145 ceph-mon[34901]: pgmap v127: 97 pgs: 97 active+clean; 218 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 58 op/s 2024-09-15T23:18:30.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:30 smithi112 ceph-mon[34367]: pgmap v128: 97 pgs: 97 active+clean; 226 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 85 op/s 2024-09-15T23:18:30.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:30 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:18:31.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:30 smithi002 ceph-mon[31019]: pgmap v128: 97 pgs: 97 active+clean; 226 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 85 op/s 2024-09-15T23:18:31.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:30 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:18:31.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:30 smithi145 ceph-mon[34901]: pgmap v128: 97 pgs: 97 active+clean; 226 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 85 op/s 2024-09-15T23:18:31.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:30 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:18:31.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:31 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:18:31.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:31 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:18:31.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:31 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:18:32.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:31 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:18:32.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:31 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:18:32.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:31 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:18:32.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:31 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:18:32.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:31 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:18:32.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:31 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:18:33.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:32 smithi145 ceph-mon[34901]: pgmap v129: 97 pgs: 97 active+clean; 226 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 53 op/s 2024-09-15T23:18:33.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:32 smithi112 ceph-mon[34367]: pgmap v129: 97 pgs: 97 active+clean; 226 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 53 op/s 2024-09-15T23:18:33.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:32 smithi002 ceph-mon[31019]: pgmap v129: 97 pgs: 97 active+clean; 226 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 53 op/s 2024-09-15T23:18:35.208 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:34 smithi145 ceph-mon[34901]: pgmap v130: 97 pgs: 97 active+clean; 226 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 53 op/s 2024-09-15T23:18:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:34 smithi112 ceph-mon[34367]: pgmap v130: 97 pgs: 97 active+clean; 226 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 53 op/s 2024-09-15T23:18:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:34 smithi002 ceph-mon[31019]: pgmap v130: 97 pgs: 97 active+clean; 226 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 53 op/s 2024-09-15T23:18:36.052 INFO:tasks.workunit.client.0.smithi002.stdout: 29 12480 89 8450 51 5616 166 2024-09-15T23:18:37.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:36 smithi145 ceph-mon[34901]: pgmap v131: 97 pgs: 97 active+clean; 235 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 81 op/s 2024-09-15T23:18:37.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:36 smithi112 ceph-mon[34367]: pgmap v131: 97 pgs: 97 active+clean; 235 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 81 op/s 2024-09-15T23:18:37.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:36 smithi002 ceph-mon[31019]: pgmap v131: 97 pgs: 97 active+clean; 235 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 81 op/s 2024-09-15T23:18:39.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:38 smithi145 ceph-mon[34901]: pgmap v132: 97 pgs: 97 active+clean; 235 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 55 op/s 2024-09-15T23:18:39.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:38 smithi112 ceph-mon[34367]: pgmap v132: 97 pgs: 97 active+clean; 235 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 55 op/s 2024-09-15T23:18:39.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:38 smithi002 ceph-mon[31019]: pgmap v132: 97 pgs: 97 active+clean; 235 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 55 op/s 2024-09-15T23:18:41.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:40 smithi145 ceph-mon[34901]: pgmap v133: 97 pgs: 97 active+clean; 244 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 78 op/s 2024-09-15T23:18:41.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:40 smithi112 ceph-mon[34367]: pgmap v133: 97 pgs: 97 active+clean; 244 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 78 op/s 2024-09-15T23:18:41.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:40 smithi002 ceph-mon[31019]: pgmap v133: 97 pgs: 97 active+clean; 244 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 78 op/s 2024-09-15T23:18:43.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:42 smithi002 ceph-mon[31019]: pgmap v134: 97 pgs: 97 active+clean; 244 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 51 op/s 2024-09-15T23:18:43.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:42 smithi145 ceph-mon[34901]: pgmap v134: 97 pgs: 97 active+clean; 244 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 51 op/s 2024-09-15T23:18:43.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:42 smithi112 ceph-mon[34367]: pgmap v134: 97 pgs: 97 active+clean; 244 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 51 op/s 2024-09-15T23:18:45.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:44 smithi145 ceph-mon[34901]: pgmap v135: 97 pgs: 97 active+clean; 244 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 51 op/s 2024-09-15T23:18:45.248 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:44 smithi112 ceph-mon[34367]: pgmap v135: 97 pgs: 97 active+clean; 244 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 51 op/s 2024-09-15T23:18:45.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:44 smithi002 ceph-mon[31019]: pgmap v135: 97 pgs: 97 active+clean; 244 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 51 op/s 2024-09-15T23:18:46.052 INFO:tasks.workunit.client.0.smithi002.stdout: 29 12243 56 8198 63 6677 145 2024-09-15T23:18:47.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:46 smithi145 ceph-mon[34901]: pgmap v136: 97 pgs: 97 active+clean; 251 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 77 op/s 2024-09-15T23:18:47.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:46 smithi112 ceph-mon[34367]: pgmap v136: 97 pgs: 97 active+clean; 251 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 77 op/s 2024-09-15T23:18:47.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:46 smithi002 ceph-mon[31019]: pgmap v136: 97 pgs: 97 active+clean; 251 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 77 op/s 2024-09-15T23:18:49.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:48 smithi145 ceph-mon[34901]: pgmap v137: 97 pgs: 97 active+clean; 251 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 49 op/s 2024-09-15T23:18:49.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:48 smithi112 ceph-mon[34367]: pgmap v137: 97 pgs: 97 active+clean; 251 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 49 op/s 2024-09-15T23:18:49.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:48 smithi002 ceph-mon[31019]: pgmap v137: 97 pgs: 97 active+clean; 251 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 49 op/s 2024-09-15T23:18:51.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:50 smithi145 ceph-mon[34901]: pgmap v138: 97 pgs: 97 active+clean; 260 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 68 op/s 2024-09-15T23:18:51.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:50 smithi112 ceph-mon[34367]: pgmap v138: 97 pgs: 97 active+clean; 260 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 68 op/s 2024-09-15T23:18:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:50 smithi002 ceph-mon[31019]: pgmap v138: 97 pgs: 97 active+clean; 260 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 68 op/s 2024-09-15T23:18:53.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:52 smithi145 ceph-mon[34901]: pgmap v139: 97 pgs: 97 active+clean; 260 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 45 op/s 2024-09-15T23:18:53.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:52 smithi112 ceph-mon[34367]: pgmap v139: 97 pgs: 97 active+clean; 260 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 45 op/s 2024-09-15T23:18:53.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:52 smithi002 ceph-mon[31019]: pgmap v139: 97 pgs: 97 active+clean; 260 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 45 op/s 2024-09-15T23:18:55.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:54 smithi145 ceph-mon[34901]: pgmap v140: 97 pgs: 97 active+clean; 260 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 45 op/s 2024-09-15T23:18:55.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:54 smithi112 ceph-mon[34367]: pgmap v140: 97 pgs: 97 active+clean; 260 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 45 op/s 2024-09-15T23:18:55.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:54 smithi002 ceph-mon[31019]: pgmap v140: 97 pgs: 97 active+clean; 260 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 45 op/s 2024-09-15T23:18:56.052 INFO:tasks.workunit.client.0.smithi002.stdout: 30 12356 28 8170 72 6679 119 2024-09-15T23:18:57.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:56 smithi145 ceph-mon[34901]: pgmap v141: 97 pgs: 97 active+clean; 268 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 71 op/s 2024-09-15T23:18:57.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:56 smithi112 ceph-mon[34367]: pgmap v141: 97 pgs: 97 active+clean; 268 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 71 op/s 2024-09-15T23:18:57.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:56 smithi002 ceph-mon[31019]: pgmap v141: 97 pgs: 97 active+clean; 268 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 71 op/s 2024-09-15T23:18:59.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:18:58 smithi145 ceph-mon[34901]: pgmap v142: 97 pgs: 97 active+clean; 268 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 45 op/s 2024-09-15T23:18:59.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:18:58 smithi112 ceph-mon[34367]: pgmap v142: 97 pgs: 97 active+clean; 268 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 45 op/s 2024-09-15T23:18:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:18:58 smithi002 ceph-mon[31019]: pgmap v142: 97 pgs: 97 active+clean; 268 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 45 op/s 2024-09-15T23:19:01.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:00 smithi145 ceph-mon[34901]: pgmap v143: 97 pgs: 97 active+clean; 277 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 72 op/s 2024-09-15T23:19:01.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:00 smithi112 ceph-mon[34367]: pgmap v143: 97 pgs: 97 active+clean; 277 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 72 op/s 2024-09-15T23:19:01.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:00 smithi002 ceph-mon[31019]: pgmap v143: 97 pgs: 97 active+clean; 277 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 72 op/s 2024-09-15T23:19:03.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:02 smithi145 ceph-mon[34901]: pgmap v144: 97 pgs: 97 active+clean; 277 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 53 op/s 2024-09-15T23:19:03.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:02 smithi112 ceph-mon[34367]: pgmap v144: 97 pgs: 97 active+clean; 277 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 53 op/s 2024-09-15T23:19:03.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:02 smithi002 ceph-mon[31019]: pgmap v144: 97 pgs: 97 active+clean; 277 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 53 op/s 2024-09-15T23:19:05.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:04 smithi145 ceph-mon[34901]: pgmap v145: 97 pgs: 97 active+clean; 277 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 53 op/s 2024-09-15T23:19:05.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:04 smithi112 ceph-mon[34367]: pgmap v145: 97 pgs: 97 active+clean; 277 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 53 op/s 2024-09-15T23:19:05.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:04 smithi002 ceph-mon[31019]: pgmap v145: 97 pgs: 97 active+clean; 277 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 53 op/s 2024-09-15T23:19:06.052 INFO:tasks.workunit.client.0.smithi002.stdout: 31 12438 68 8794 53 5390 168 2024-09-15T23:19:07.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:06 smithi145 ceph-mon[34901]: pgmap v146: 97 pgs: 97 active+clean; 286 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 112 op/s 2024-09-15T23:19:07.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:06 smithi112 ceph-mon[34367]: pgmap v146: 97 pgs: 97 active+clean; 286 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 112 op/s 2024-09-15T23:19:07.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:06 smithi002 ceph-mon[31019]: pgmap v146: 97 pgs: 97 active+clean; 286 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 112 op/s 2024-09-15T23:19:09.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:08 smithi145 ceph-mon[34901]: pgmap v147: 97 pgs: 97 active+clean; 286 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 86 op/s 2024-09-15T23:19:09.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:08 smithi112 ceph-mon[34367]: pgmap v147: 97 pgs: 97 active+clean; 286 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 86 op/s 2024-09-15T23:19:09.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:08 smithi002 ceph-mon[31019]: pgmap v147: 97 pgs: 97 active+clean; 286 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 86 op/s 2024-09-15T23:19:11.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:10 smithi145 ceph-mon[34901]: pgmap v148: 97 pgs: 97 active+clean; 294 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 247 op/s 2024-09-15T23:19:11.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:10 smithi112 ceph-mon[34367]: pgmap v148: 97 pgs: 97 active+clean; 294 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 247 op/s 2024-09-15T23:19:11.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:10 smithi002 ceph-mon[31019]: pgmap v148: 97 pgs: 97 active+clean; 294 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 247 op/s 2024-09-15T23:19:13.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:12 smithi145 ceph-mon[34901]: pgmap v149: 97 pgs: 97 active+clean; 294 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 220 op/s 2024-09-15T23:19:13.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:12 smithi112 ceph-mon[34367]: pgmap v149: 97 pgs: 97 active+clean; 294 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 220 op/s 2024-09-15T23:19:13.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:12 smithi002 ceph-mon[31019]: pgmap v149: 97 pgs: 97 active+clean; 294 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 220 op/s 2024-09-15T23:19:15.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:14 smithi145 ceph-mon[34901]: pgmap v150: 97 pgs: 97 active+clean; 294 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 220 op/s 2024-09-15T23:19:15.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:14 smithi112 ceph-mon[34367]: pgmap v150: 97 pgs: 97 active+clean; 294 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 220 op/s 2024-09-15T23:19:15.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:14 smithi002 ceph-mon[31019]: pgmap v150: 97 pgs: 97 active+clean; 294 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 220 op/s 2024-09-15T23:19:16.052 INFO:tasks.workunit.client.0.smithi002.stdout: 32 11918 27 8023 85 6518 147 2024-09-15T23:19:17.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:16 smithi145 ceph-mon[34901]: pgmap v151: 97 pgs: 97 active+clean; 304 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 367 op/s 2024-09-15T23:19:17.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:16 smithi112 ceph-mon[34367]: pgmap v151: 97 pgs: 97 active+clean; 304 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 367 op/s 2024-09-15T23:19:17.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:16 smithi002 ceph-mon[31019]: pgmap v151: 97 pgs: 97 active+clean; 304 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 367 op/s 2024-09-15T23:19:19.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:18 smithi145 ceph-mon[34901]: pgmap v152: 97 pgs: 97 active+clean; 304 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 307 op/s 2024-09-15T23:19:19.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:18 smithi112 ceph-mon[34367]: pgmap v152: 97 pgs: 97 active+clean; 304 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 307 op/s 2024-09-15T23:19:19.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:18 smithi002 ceph-mon[31019]: pgmap v152: 97 pgs: 97 active+clean; 304 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 307 op/s 2024-09-15T23:19:21.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:20 smithi145 ceph-mon[34901]: pgmap v153: 97 pgs: 97 active+clean; 288 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 460 op/s 2024-09-15T23:19:21.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:20 smithi112 ceph-mon[34367]: pgmap v153: 97 pgs: 97 active+clean; 288 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 460 op/s 2024-09-15T23:19:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:20 smithi002 ceph-mon[31019]: pgmap v153: 97 pgs: 97 active+clean; 288 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 460 op/s 2024-09-15T23:19:23.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:22 smithi145 ceph-mon[34901]: pgmap v154: 97 pgs: 97 active+clean; 288 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 299 op/s 2024-09-15T23:19:23.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:22 smithi112 ceph-mon[34367]: pgmap v154: 97 pgs: 97 active+clean; 288 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 299 op/s 2024-09-15T23:19:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:22 smithi002 ceph-mon[31019]: pgmap v154: 97 pgs: 97 active+clean; 288 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 299 op/s 2024-09-15T23:19:25.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:24 smithi145 ceph-mon[34901]: pgmap v155: 97 pgs: 97 active+clean; 288 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 299 op/s 2024-09-15T23:19:25.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:24 smithi112 ceph-mon[34367]: pgmap v155: 97 pgs: 97 active+clean; 288 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 299 op/s 2024-09-15T23:19:25.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:24 smithi002 ceph-mon[31019]: pgmap v155: 97 pgs: 97 active+clean; 288 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 299 op/s 2024-09-15T23:19:26.052 INFO:tasks.workunit.client.0.smithi002.stdout: 33 11595 29 8421 74 7097 123 2024-09-15T23:19:27.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:26 smithi145 ceph-mon[34901]: pgmap v156: 97 pgs: 97 active+clean; 297 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 404 op/s 2024-09-15T23:19:27.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:26 smithi112 ceph-mon[34367]: pgmap v156: 97 pgs: 97 active+clean; 297 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 404 op/s 2024-09-15T23:19:27.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:26 smithi002 ceph-mon[31019]: pgmap v156: 97 pgs: 97 active+clean; 297 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 404 op/s 2024-09-15T23:19:29.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:28 smithi145 ceph-mon[34901]: pgmap v157: 97 pgs: 97 active+clean; 297 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 257 op/s 2024-09-15T23:19:29.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:28 smithi112 ceph-mon[34367]: pgmap v157: 97 pgs: 97 active+clean; 297 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 257 op/s 2024-09-15T23:19:29.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:28 smithi002 ceph-mon[31019]: pgmap v157: 97 pgs: 97 active+clean; 297 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 257 op/s 2024-09-15T23:19:31.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:30 smithi145 ceph-mon[34901]: pgmap v158: 97 pgs: 97 active+clean; 274 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 333 op/s 2024-09-15T23:19:31.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:30 smithi112 ceph-mon[34367]: pgmap v158: 97 pgs: 97 active+clean; 274 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 333 op/s 2024-09-15T23:19:31.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:30 smithi002 ceph-mon[31019]: pgmap v158: 97 pgs: 97 active+clean; 274 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 333 op/s 2024-09-15T23:19:32.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:31 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:19:32.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:31 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:19:32.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:31 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:19:32.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:31 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:19:32.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:31 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:19:32.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:31 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:19:32.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:31 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:19:32.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:31 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:19:32.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:31 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:19:32.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:31 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:19:32.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:31 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:19:32.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:31 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:19:33.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:32 smithi145 ceph-mon[34901]: pgmap v159: 97 pgs: 97 active+clean; 274 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-09-15T23:19:33.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:32 smithi112 ceph-mon[34367]: pgmap v159: 97 pgs: 97 active+clean; 274 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-09-15T23:19:33.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:32 smithi002 ceph-mon[31019]: pgmap v159: 97 pgs: 97 active+clean; 274 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-09-15T23:19:35.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:34 smithi145 ceph-mon[34901]: pgmap v160: 97 pgs: 97 active+clean; 274 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-09-15T23:19:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:34 smithi112 ceph-mon[34367]: pgmap v160: 97 pgs: 97 active+clean; 274 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-09-15T23:19:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:34 smithi002 ceph-mon[31019]: pgmap v160: 97 pgs: 97 active+clean; 274 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-09-15T23:19:36.052 INFO:tasks.workunit.client.0.smithi002.stdout: 34 11993 93 8693 52 6039 127 2024-09-15T23:19:37.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:36 smithi145 ceph-mon[34901]: pgmap v161: 97 pgs: 97 active+clean; 284 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 268 op/s 2024-09-15T23:19:37.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:36 smithi112 ceph-mon[34367]: pgmap v161: 97 pgs: 97 active+clean; 284 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 268 op/s 2024-09-15T23:19:37.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:36 smithi002 ceph-mon[31019]: pgmap v161: 97 pgs: 97 active+clean; 284 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 268 op/s 2024-09-15T23:19:39.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:38 smithi145 ceph-mon[34901]: pgmap v162: 97 pgs: 97 active+clean; 284 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 163 op/s 2024-09-15T23:19:39.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:38 smithi112 ceph-mon[34367]: pgmap v162: 97 pgs: 97 active+clean; 284 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 163 op/s 2024-09-15T23:19:39.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:38 smithi002 ceph-mon[31019]: pgmap v162: 97 pgs: 97 active+clean; 284 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 163 op/s 2024-09-15T23:19:41.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:40 smithi145 ceph-mon[34901]: pgmap v163: 97 pgs: 97 active+clean; 291 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 227 op/s 2024-09-15T23:19:41.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:40 smithi112 ceph-mon[34367]: pgmap v163: 97 pgs: 97 active+clean; 291 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 227 op/s 2024-09-15T23:19:41.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:40 smithi002 ceph-mon[31019]: pgmap v163: 97 pgs: 97 active+clean; 291 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 227 op/s 2024-09-15T23:19:43.209 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:42 smithi145 ceph-mon[34901]: pgmap v164: 97 pgs: 97 active+clean; 291 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-09-15T23:19:43.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:42 smithi112 ceph-mon[34367]: pgmap v164: 97 pgs: 97 active+clean; 291 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-09-15T23:19:43.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:42 smithi002 ceph-mon[31019]: pgmap v164: 97 pgs: 97 active+clean; 291 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-09-15T23:19:45.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:44 smithi145 ceph-mon[34901]: pgmap v165: 97 pgs: 97 active+clean; 291 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-09-15T23:19:45.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:44 smithi112 ceph-mon[34367]: pgmap v165: 97 pgs: 97 active+clean; 291 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-09-15T23:19:45.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:44 smithi002 ceph-mon[31019]: pgmap v165: 97 pgs: 97 active+clean; 291 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-09-15T23:19:46.052 INFO:tasks.workunit.client.0.smithi002.stdout: 35 12166 73 9116 17 6453 77 2024-09-15T23:19:47.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:46 smithi145 ceph-mon[34901]: pgmap v166: 97 pgs: 97 active+clean; 280 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 194 op/s 2024-09-15T23:19:47.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:46 smithi112 ceph-mon[34367]: pgmap v166: 97 pgs: 97 active+clean; 280 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 194 op/s 2024-09-15T23:19:47.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:46 smithi002 ceph-mon[31019]: pgmap v166: 97 pgs: 97 active+clean; 280 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 194 op/s 2024-09-15T23:19:49.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:48 smithi145 ceph-mon[34901]: pgmap v167: 97 pgs: 97 active+clean; 280 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 106 op/s 2024-09-15T23:19:49.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:48 smithi112 ceph-mon[34367]: pgmap v167: 97 pgs: 97 active+clean; 280 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 106 op/s 2024-09-15T23:19:49.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:48 smithi002 ceph-mon[31019]: pgmap v167: 97 pgs: 97 active+clean; 280 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 106 op/s 2024-09-15T23:19:51.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:50 smithi145 ceph-mon[34901]: pgmap v168: 97 pgs: 97 active+clean; 266 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 149 op/s 2024-09-15T23:19:51.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:50 smithi112 ceph-mon[34367]: pgmap v168: 97 pgs: 97 active+clean; 266 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 149 op/s 2024-09-15T23:19:51.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:50 smithi002 ceph-mon[31019]: pgmap v168: 97 pgs: 97 active+clean; 266 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 149 op/s 2024-09-15T23:19:53.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:52 smithi145 ceph-mon[34901]: pgmap v169: 97 pgs: 97 active+clean; 266 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 85 op/s 2024-09-15T23:19:53.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:52 smithi112 ceph-mon[34367]: pgmap v169: 97 pgs: 97 active+clean; 266 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 85 op/s 2024-09-15T23:19:53.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:52 smithi002 ceph-mon[31019]: pgmap v169: 97 pgs: 97 active+clean; 266 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 85 op/s 2024-09-15T23:19:55.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:54 smithi145 ceph-mon[34901]: pgmap v170: 97 pgs: 97 active+clean; 266 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 85 op/s 2024-09-15T23:19:55.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:54 smithi112 ceph-mon[34367]: pgmap v170: 97 pgs: 97 active+clean; 266 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 85 op/s 2024-09-15T23:19:55.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:54 smithi002 ceph-mon[31019]: pgmap v170: 97 pgs: 97 active+clean; 266 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 85 op/s 2024-09-15T23:19:56.054 INFO:tasks.workunit.client.0.smithi002.stdout: 35 12270 74 9702 9 6287 89 2024-09-15T23:19:57.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:56 smithi145 ceph-mon[34901]: pgmap v171: 97 pgs: 97 active+clean; 274 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 129 op/s 2024-09-15T23:19:57.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:56 smithi112 ceph-mon[34367]: pgmap v171: 97 pgs: 97 active+clean; 274 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 129 op/s 2024-09-15T23:19:57.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:56 smithi002 ceph-mon[31019]: pgmap v171: 97 pgs: 97 active+clean; 274 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 129 op/s 2024-09-15T23:19:59.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:19:58 smithi145 ceph-mon[34901]: pgmap v172: 97 pgs: 97 active+clean; 274 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 87 op/s 2024-09-15T23:19:59.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:19:58 smithi112 ceph-mon[34367]: pgmap v172: 97 pgs: 97 active+clean; 274 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 87 op/s 2024-09-15T23:19:59.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:19:58 smithi002 ceph-mon[31019]: pgmap v172: 97 pgs: 97 active+clean; 274 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 87 op/s 2024-09-15T23:20:01.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:00 smithi145 ceph-mon[34901]: pgmap v173: 97 pgs: 97 active+clean; 283 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 131 op/s 2024-09-15T23:20:01.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:00 smithi145 ceph-mon[34901]: overall HEALTH_OK 2024-09-15T23:20:01.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:00 smithi112 ceph-mon[34367]: pgmap v173: 97 pgs: 97 active+clean; 283 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 131 op/s 2024-09-15T23:20:01.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:00 smithi112 ceph-mon[34367]: overall HEALTH_OK 2024-09-15T23:20:01.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:00 smithi002 ceph-mon[31019]: pgmap v173: 97 pgs: 97 active+clean; 283 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 131 op/s 2024-09-15T23:20:01.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:00 smithi002 ceph-mon[31019]: overall HEALTH_OK 2024-09-15T23:20:03.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:02 smithi145 ceph-mon[34901]: pgmap v174: 97 pgs: 97 active+clean; 283 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 88 op/s 2024-09-15T23:20:03.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:02 smithi112 ceph-mon[34367]: pgmap v174: 97 pgs: 97 active+clean; 283 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 88 op/s 2024-09-15T23:20:03.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:02 smithi002 ceph-mon[31019]: pgmap v174: 97 pgs: 97 active+clean; 283 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 88 op/s 2024-09-15T23:20:05.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:04 smithi145 ceph-mon[34901]: pgmap v175: 97 pgs: 97 active+clean; 283 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 88 op/s 2024-09-15T23:20:05.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:04 smithi112 ceph-mon[34367]: pgmap v175: 97 pgs: 97 active+clean; 283 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 88 op/s 2024-09-15T23:20:05.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:04 smithi002 ceph-mon[31019]: pgmap v175: 97 pgs: 97 active+clean; 283 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 88 op/s 2024-09-15T23:20:06.052 INFO:tasks.workunit.client.0.smithi002.stdout: 36 11679 49 8799 58 6153 120 2024-09-15T23:20:07.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:06 smithi145 ceph-mon[34901]: pgmap v176: 97 pgs: 97 active+clean; 277 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 157 op/s 2024-09-15T23:20:07.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:06 smithi112 ceph-mon[34367]: pgmap v176: 97 pgs: 97 active+clean; 277 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 157 op/s 2024-09-15T23:20:07.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:06 smithi002 ceph-mon[31019]: pgmap v176: 97 pgs: 97 active+clean; 277 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 157 op/s 2024-09-15T23:20:09.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:08 smithi145 ceph-mon[34901]: pgmap v177: 97 pgs: 97 active+clean; 277 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 113 op/s 2024-09-15T23:20:09.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:08 smithi112 ceph-mon[34367]: pgmap v177: 97 pgs: 97 active+clean; 277 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 113 op/s 2024-09-15T23:20:09.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:08 smithi002 ceph-mon[31019]: pgmap v177: 97 pgs: 97 active+clean; 277 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 113 op/s 2024-09-15T23:20:11.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:10 smithi145 ceph-mon[34901]: pgmap v178: 97 pgs: 97 active+clean; 285 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 162 op/s 2024-09-15T23:20:11.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:10 smithi112 ceph-mon[34367]: pgmap v178: 97 pgs: 97 active+clean; 285 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 162 op/s 2024-09-15T23:20:11.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:10 smithi002 ceph-mon[31019]: pgmap v178: 97 pgs: 97 active+clean; 285 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 162 op/s 2024-09-15T23:20:13.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:12 smithi112 ceph-mon[34367]: pgmap v179: 97 pgs: 97 active+clean; 285 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 118 op/s 2024-09-15T23:20:13.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:12 smithi002 ceph-mon[31019]: pgmap v179: 97 pgs: 97 active+clean; 285 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 118 op/s 2024-09-15T23:20:13.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:12 smithi145 ceph-mon[34901]: pgmap v179: 97 pgs: 97 active+clean; 285 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 118 op/s 2024-09-15T23:20:15.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:14 smithi112 ceph-mon[34367]: pgmap v180: 97 pgs: 97 active+clean; 285 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 118 op/s 2024-09-15T23:20:15.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:14 smithi002 ceph-mon[31019]: pgmap v180: 97 pgs: 97 active+clean; 285 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 118 op/s 2024-09-15T23:20:15.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:14 smithi145 ceph-mon[34901]: pgmap v180: 97 pgs: 97 active+clean; 285 MiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 118 op/s 2024-09-15T23:20:16.052 INFO:tasks.workunit.client.0.smithi002.stdout: 36 12156 70 8552 46 5682 140 2024-09-15T23:20:17.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:16 smithi112 ceph-mon[34367]: pgmap v181: 97 pgs: 97 active+clean; 279 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 166 op/s 2024-09-15T23:20:17.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:16 smithi002 ceph-mon[31019]: pgmap v181: 97 pgs: 97 active+clean; 279 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 166 op/s 2024-09-15T23:20:17.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:16 smithi145 ceph-mon[34901]: pgmap v181: 97 pgs: 97 active+clean; 279 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 166 op/s 2024-09-15T23:20:19.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:18 smithi112 ceph-mon[34367]: pgmap v182: 97 pgs: 97 active+clean; 279 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 96 op/s 2024-09-15T23:20:19.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:18 smithi002 ceph-mon[31019]: pgmap v182: 97 pgs: 97 active+clean; 279 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 96 op/s 2024-09-15T23:20:19.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:18 smithi145 ceph-mon[34901]: pgmap v182: 97 pgs: 97 active+clean; 279 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 96 op/s 2024-09-15T23:20:21.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:20 smithi112 ceph-mon[34367]: pgmap v183: 97 pgs: 97 active+clean; 290 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 134 op/s 2024-09-15T23:20:21.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:20 smithi002 ceph-mon[31019]: pgmap v183: 97 pgs: 97 active+clean; 290 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 134 op/s 2024-09-15T23:20:21.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:20 smithi145 ceph-mon[34901]: pgmap v183: 97 pgs: 97 active+clean; 290 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 134 op/s 2024-09-15T23:20:23.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:22 smithi112 ceph-mon[34367]: pgmap v184: 97 pgs: 97 active+clean; 290 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 85 op/s 2024-09-15T23:20:23.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:22 smithi002 ceph-mon[31019]: pgmap v184: 97 pgs: 97 active+clean; 290 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 85 op/s 2024-09-15T23:20:23.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:22 smithi145 ceph-mon[34901]: pgmap v184: 97 pgs: 97 active+clean; 290 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 85 op/s 2024-09-15T23:20:25.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:24 smithi112 ceph-mon[34367]: pgmap v185: 97 pgs: 97 active+clean; 290 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 85 op/s 2024-09-15T23:20:25.259 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:24 smithi145 ceph-mon[34901]: pgmap v185: 97 pgs: 97 active+clean; 290 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 85 op/s 2024-09-15T23:20:25.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:24 smithi002 ceph-mon[31019]: pgmap v185: 97 pgs: 97 active+clean; 290 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 85 op/s 2024-09-15T23:20:26.052 INFO:tasks.workunit.client.0.smithi002.stdout: 36 12288 36 8523 47 6059 107 2024-09-15T23:20:27.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:26 smithi112 ceph-mon[34367]: pgmap v186: 97 pgs: 97 active+clean; 284 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 126 op/s 2024-09-15T23:20:27.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:26 smithi002 ceph-mon[31019]: pgmap v186: 97 pgs: 97 active+clean; 284 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 126 op/s 2024-09-15T23:20:27.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:26 smithi145 ceph-mon[34901]: pgmap v186: 97 pgs: 97 active+clean; 284 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 126 op/s 2024-09-15T23:20:29.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:28 smithi112 ceph-mon[34367]: pgmap v187: 97 pgs: 97 active+clean; 284 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 78 op/s 2024-09-15T23:20:29.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:28 smithi002 ceph-mon[31019]: pgmap v187: 97 pgs: 97 active+clean; 284 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 78 op/s 2024-09-15T23:20:29.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:28 smithi145 ceph-mon[34901]: pgmap v187: 97 pgs: 97 active+clean; 284 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 78 op/s 2024-09-15T23:20:31.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:30 smithi112 ceph-mon[34367]: pgmap v188: 97 pgs: 97 active+clean; 293 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 114 op/s 2024-09-15T23:20:31.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:30 smithi002 ceph-mon[31019]: pgmap v188: 97 pgs: 97 active+clean; 293 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 114 op/s 2024-09-15T23:20:31.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:30 smithi145 ceph-mon[34901]: pgmap v188: 97 pgs: 97 active+clean; 293 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 114 op/s 2024-09-15T23:20:32.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:31 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:20:32.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:31 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:20:32.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:31 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:20:33.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:32 smithi112 ceph-mon[34367]: pgmap v189: 97 pgs: 97 active+clean; 293 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 76 op/s 2024-09-15T23:20:33.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:32 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:20:33.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:32 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:20:33.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:32 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:20:33.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:32 smithi002 ceph-mon[31019]: pgmap v189: 97 pgs: 97 active+clean; 293 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 76 op/s 2024-09-15T23:20:33.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:32 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:20:33.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:32 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:20:33.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:32 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:20:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:32 smithi145 ceph-mon[34901]: pgmap v189: 97 pgs: 97 active+clean; 293 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 76 op/s 2024-09-15T23:20:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:32 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:20:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:32 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:20:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:32 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:20:35.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:34 smithi112 ceph-mon[34367]: pgmap v190: 97 pgs: 97 active+clean; 293 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 76 op/s 2024-09-15T23:20:35.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:34 smithi002 ceph-mon[31019]: pgmap v190: 97 pgs: 97 active+clean; 293 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 76 op/s 2024-09-15T23:20:35.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:34 smithi145 ceph-mon[34901]: pgmap v190: 97 pgs: 97 active+clean; 293 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 76 op/s 2024-09-15T23:20:36.052 INFO:tasks.workunit.client.0.smithi002.stdout: 37 12205 35 8629 72 5627 149 2024-09-15T23:20:37.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:36 smithi112 ceph-mon[34367]: pgmap v191: 97 pgs: 97 active+clean; 288 MiB data, 819 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 118 op/s 2024-09-15T23:20:37.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:36 smithi002 ceph-mon[31019]: pgmap v191: 97 pgs: 97 active+clean; 288 MiB data, 819 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 118 op/s 2024-09-15T23:20:37.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:36 smithi145 ceph-mon[34901]: pgmap v191: 97 pgs: 97 active+clean; 288 MiB data, 819 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 118 op/s 2024-09-15T23:20:38.903 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-15T23:20:38.903 INFO:tasks.workunit.client.0.smithi002.stdout:Final score for writes: 37 2024-09-15T23:20:38.904 INFO:tasks.workunit.client.0.smithi002.stdout:Final score for reads : 7731 2024-09-15T23:20:38.904 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-15T23:20:38.904 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-15T23:20:38.904 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-15T23:20:39.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:38 smithi112 ceph-mon[34367]: pgmap v192: 97 pgs: 97 active+clean; 288 MiB data, 819 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 77 op/s 2024-09-15T23:20:39.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:38 smithi002 ceph-mon[31019]: pgmap v192: 97 pgs: 97 active+clean; 288 MiB data, 819 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 77 op/s 2024-09-15T23:20:39.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:38 smithi145 ceph-mon[34901]: pgmap v192: 97 pgs: 97 active+clean; 288 MiB data, 819 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 77 op/s 2024-09-15T23:20:41.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:40 smithi002 ceph-mon[31019]: pgmap v193: 97 pgs: 97 active+clean; 300 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 126 op/s 2024-09-15T23:20:41.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:40 smithi145 ceph-mon[34901]: pgmap v193: 97 pgs: 97 active+clean; 300 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 126 op/s 2024-09-15T23:20:41.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:40 smithi112 ceph-mon[34367]: pgmap v193: 97 pgs: 97 active+clean; 300 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 126 op/s 2024-09-15T23:20:43.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:42 smithi002 ceph-mon[31019]: pgmap v194: 97 pgs: 97 active+clean; 300 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 90 op/s 2024-09-15T23:20:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:42 smithi145 ceph-mon[34901]: pgmap v194: 97 pgs: 97 active+clean; 300 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 90 op/s 2024-09-15T23:20:43.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:42 smithi112 ceph-mon[34367]: pgmap v194: 97 pgs: 97 active+clean; 300 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 90 op/s 2024-09-15T23:20:45.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:45 smithi002 ceph-mon[31019]: pgmap v195: 97 pgs: 97 active+clean; 300 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 90 op/s 2024-09-15T23:20:45.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:45 smithi145 ceph-mon[34901]: pgmap v195: 97 pgs: 97 active+clean; 300 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 90 op/s 2024-09-15T23:20:45.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:45 smithi112 ceph-mon[34367]: pgmap v195: 97 pgs: 97 active+clean; 300 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 90 op/s 2024-09-15T23:20:47.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:47 smithi002 ceph-mon[31019]: pgmap v196: 97 pgs: 97 active+clean; 303 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 207 op/s 2024-09-15T23:20:47.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:47 smithi145 ceph-mon[34901]: pgmap v196: 97 pgs: 97 active+clean; 303 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 207 op/s 2024-09-15T23:20:47.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:47 smithi112 ceph-mon[34367]: pgmap v196: 97 pgs: 97 active+clean; 303 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 207 op/s 2024-09-15T23:20:49.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:49 smithi002 ceph-mon[31019]: pgmap v197: 97 pgs: 97 active+clean; 303 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 165 op/s 2024-09-15T23:20:49.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:49 smithi145 ceph-mon[34901]: pgmap v197: 97 pgs: 97 active+clean; 303 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 165 op/s 2024-09-15T23:20:49.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:49 smithi112 ceph-mon[34367]: pgmap v197: 97 pgs: 97 active+clean; 303 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 165 op/s 2024-09-15T23:20:51.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:51 smithi145 ceph-mon[34901]: pgmap v198: 97 pgs: 97 active+clean; 315 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 337 op/s 2024-09-15T23:20:51.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:51 smithi112 ceph-mon[34367]: pgmap v198: 97 pgs: 97 active+clean; 315 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 337 op/s 2024-09-15T23:20:51.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:51 smithi002 ceph-mon[31019]: pgmap v198: 97 pgs: 97 active+clean; 315 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 337 op/s 2024-09-15T23:20:53.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:53 smithi145 ceph-mon[34901]: pgmap v199: 97 pgs: 97 active+clean; 315 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 288 op/s 2024-09-15T23:20:53.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:53 smithi112 ceph-mon[34367]: pgmap v199: 97 pgs: 97 active+clean; 315 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 288 op/s 2024-09-15T23:20:53.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:53 smithi002 ceph-mon[31019]: pgmap v199: 97 pgs: 97 active+clean; 315 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 288 op/s 2024-09-15T23:20:55.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:55 smithi145 ceph-mon[34901]: pgmap v200: 97 pgs: 97 active+clean; 315 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 288 op/s 2024-09-15T23:20:55.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:55 smithi112 ceph-mon[34367]: pgmap v200: 97 pgs: 97 active+clean; 315 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 288 op/s 2024-09-15T23:20:55.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:55 smithi002 ceph-mon[31019]: pgmap v200: 97 pgs: 97 active+clean; 315 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 288 op/s 2024-09-15T23:20:57.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:57 smithi145 ceph-mon[34901]: pgmap v201: 97 pgs: 97 active+clean; 326 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.5 MiB/s wr, 452 op/s 2024-09-15T23:20:57.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:57 smithi112 ceph-mon[34367]: pgmap v201: 97 pgs: 97 active+clean; 326 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.5 MiB/s wr, 452 op/s 2024-09-15T23:20:57.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:57 smithi002 ceph-mon[31019]: pgmap v201: 97 pgs: 97 active+clean; 326 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.5 MiB/s wr, 452 op/s 2024-09-15T23:20:57.894 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-09-15T23:20:57.895 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-15T23:20:58.206 DEBUG:teuthology.parallel:result is None 2024-09-15T23:20:58.206 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T23:20:58.238 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T23:20:58.239 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-15T23:20:58.253 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-15T23:20:58.253 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T23:20:58.254 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-15T23:20:58.254 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-15T23:20:58.307 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-15T23:20:59.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:20:59 smithi145 ceph-mon[34901]: pgmap v202: 97 pgs: 97 active+clean; 326 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 336 op/s 2024-09-15T23:20:59.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:20:59 smithi112 ceph-mon[34367]: pgmap v202: 97 pgs: 97 active+clean; 326 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 336 op/s 2024-09-15T23:20:59.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:20:59 smithi002 ceph-mon[31019]: pgmap v202: 97 pgs: 97 active+clean; 326 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 336 op/s 2024-09-15T23:21:01.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:01 smithi145 ceph-mon[34901]: pgmap v203: 97 pgs: 97 active+clean; 319 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 500 op/s 2024-09-15T23:21:01.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:01 smithi112 ceph-mon[34367]: pgmap v203: 97 pgs: 97 active+clean; 319 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 500 op/s 2024-09-15T23:21:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:01 smithi002 ceph-mon[31019]: pgmap v203: 97 pgs: 97 active+clean; 319 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 500 op/s 2024-09-15T23:21:03.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:03 smithi145 ceph-mon[34901]: pgmap v204: 97 pgs: 97 active+clean; 319 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 327 op/s 2024-09-15T23:21:03.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:03 smithi112 ceph-mon[34367]: pgmap v204: 97 pgs: 97 active+clean; 319 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 327 op/s 2024-09-15T23:21:03.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:03 smithi002 ceph-mon[31019]: pgmap v204: 97 pgs: 97 active+clean; 319 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 327 op/s 2024-09-15T23:21:05.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:05 smithi145 ceph-mon[34901]: pgmap v205: 97 pgs: 97 active+clean; 319 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 327 op/s 2024-09-15T23:21:05.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:05 smithi112 ceph-mon[34367]: pgmap v205: 97 pgs: 97 active+clean; 319 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 327 op/s 2024-09-15T23:21:05.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:05 smithi002 ceph-mon[31019]: pgmap v205: 97 pgs: 97 active+clean; 319 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 327 op/s 2024-09-15T23:21:07.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:07 smithi145 ceph-mon[34901]: pgmap v206: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 365 op/s 2024-09-15T23:21:07.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:07 smithi112 ceph-mon[34367]: pgmap v206: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 365 op/s 2024-09-15T23:21:07.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:07 smithi002 ceph-mon[31019]: pgmap v206: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 365 op/s 2024-09-15T23:21:08.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:08 smithi145 ceph-mon[34901]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T23:21:08.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:08 smithi112 ceph-mon[34367]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T23:21:08.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:08 smithi002 ceph-mon[31019]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T23:21:09.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:09 smithi145 ceph-mon[34901]: pgmap v208: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 241 op/s 2024-09-15T23:21:09.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:09 smithi112 ceph-mon[34367]: pgmap v208: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 241 op/s 2024-09-15T23:21:09.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:09 smithi002 ceph-mon[31019]: pgmap v208: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 241 op/s 2024-09-15T23:21:11.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:11 smithi145 ceph-mon[34901]: pgmap v209: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 167 KiB/s wr, 47 op/s 2024-09-15T23:21:11.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:11 smithi112 ceph-mon[34367]: pgmap v209: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 167 KiB/s wr, 47 op/s 2024-09-15T23:21:11.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:11 smithi002 ceph-mon[31019]: pgmap v209: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 167 KiB/s wr, 47 op/s 2024-09-15T23:21:13.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:13 smithi145 ceph-mon[34901]: pgmap v210: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 167 KiB/s wr, 47 op/s 2024-09-15T23:21:13.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:13 smithi112 ceph-mon[34367]: pgmap v210: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 167 KiB/s wr, 47 op/s 2024-09-15T23:21:13.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:13 smithi002 ceph-mon[31019]: pgmap v210: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 167 KiB/s wr, 47 op/s 2024-09-15T23:21:15.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:15 smithi145 ceph-mon[34901]: pgmap v211: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 167 KiB/s wr, 47 op/s 2024-09-15T23:21:15.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:15 smithi145 ceph-mon[34901]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T23:21:15.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:15 smithi112 ceph-mon[34367]: pgmap v211: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 167 KiB/s wr, 47 op/s 2024-09-15T23:21:15.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:15 smithi112 ceph-mon[34367]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T23:21:15.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:15 smithi002 ceph-mon[31019]: pgmap v211: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 167 KiB/s wr, 47 op/s 2024-09-15T23:21:15.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:15 smithi002 ceph-mon[31019]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T23:21:17.460 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:17 smithi145 ceph-mon[34901]: pgmap v213: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-09-15T23:21:17.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:17 smithi112 ceph-mon[34367]: pgmap v213: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-09-15T23:21:17.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:17 smithi002 ceph-mon[31019]: pgmap v213: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-09-15T23:21:19.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:19 smithi145 ceph-mon[34901]: pgmap v214: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.6 KiB/s wr, 4 op/s 2024-09-15T23:21:19.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:19 smithi112 ceph-mon[34367]: pgmap v214: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.6 KiB/s wr, 4 op/s 2024-09-15T23:21:19.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:19 smithi002 ceph-mon[31019]: pgmap v214: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.6 KiB/s wr, 4 op/s 2024-09-15T23:21:21.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:21 smithi145 ceph-mon[34901]: pgmap v215: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-15T23:21:21.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:21 smithi112 ceph-mon[34367]: pgmap v215: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-15T23:21:21.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:21 smithi002 ceph-mon[31019]: pgmap v215: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-15T23:21:23.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:23 smithi145 ceph-mon[34901]: pgmap v216: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-15T23:21:23.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:23 smithi112 ceph-mon[34367]: pgmap v216: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-15T23:21:23.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:23 smithi002 ceph-mon[31019]: pgmap v216: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-15T23:21:25.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:25 smithi145 ceph-mon[34901]: pgmap v217: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-15T23:21:25.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:25 smithi112 ceph-mon[34367]: pgmap v217: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-15T23:21:25.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:25 smithi002 ceph-mon[31019]: pgmap v217: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 2 op/s 2024-09-15T23:21:27.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:27 smithi145 ceph-mon[34901]: pgmap v218: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 974 B/s rd, 1 op/s 2024-09-15T23:21:27.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:27 smithi112 ceph-mon[34367]: pgmap v218: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 974 B/s rd, 1 op/s 2024-09-15T23:21:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:27 smithi002 ceph-mon[31019]: pgmap v218: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 974 B/s rd, 1 op/s 2024-09-15T23:21:29.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:29 smithi145 ceph-mon[34901]: pgmap v219: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:29.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:29 smithi112 ceph-mon[34367]: pgmap v219: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:29 smithi002 ceph-mon[31019]: pgmap v219: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:31.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:31 smithi145 ceph-mon[34901]: pgmap v220: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:31.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:31 smithi112 ceph-mon[34367]: pgmap v220: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:31.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:31 smithi002 ceph-mon[31019]: pgmap v220: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:33 smithi145 ceph-mon[34901]: pgmap v221: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:33 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:21:33.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:33 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:21:33.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:33 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:21:33.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:33 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:21:33.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:33 smithi112 ceph-mon[34367]: pgmap v221: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:33.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:33 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:21:33.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:33 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:21:33.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:33 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:21:33.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:33 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:21:33.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:33 smithi002 ceph-mon[31019]: pgmap v221: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:33.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:33 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:21:33.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:33 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:21:33.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:33 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:21:33.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:33 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:21:35.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:35 smithi145 ceph-mon[34901]: pgmap v222: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:35.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:35 smithi112 ceph-mon[34367]: pgmap v222: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:35.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:35 smithi002 ceph-mon[31019]: pgmap v222: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:37.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:37 smithi145 ceph-mon[34901]: pgmap v223: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:37.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:37 smithi112 ceph-mon[34367]: pgmap v223: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:37.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:37 smithi002 ceph-mon[31019]: pgmap v223: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:39.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:39 smithi145 ceph-mon[34901]: pgmap v224: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:39.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:39 smithi112 ceph-mon[34367]: pgmap v224: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:39.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:39 smithi002 ceph-mon[31019]: pgmap v224: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:41.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:41 smithi145 ceph-mon[34901]: pgmap v225: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:41.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:41 smithi112 ceph-mon[34367]: pgmap v225: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:41.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:41 smithi002 ceph-mon[31019]: pgmap v225: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:43.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:43 smithi145 ceph-mon[34901]: pgmap v226: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:43.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:43 smithi112 ceph-mon[34367]: pgmap v226: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:43.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:43 smithi002 ceph-mon[31019]: pgmap v226: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:45.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:45 smithi145 ceph-mon[34901]: pgmap v227: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:45.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:45 smithi112 ceph-mon[34367]: pgmap v227: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:45.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:45 smithi002 ceph-mon[31019]: pgmap v227: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:47.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:47 smithi145 ceph-mon[34901]: pgmap v228: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:47.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:47 smithi112 ceph-mon[34367]: pgmap v228: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:47.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:47 smithi002 ceph-mon[31019]: pgmap v228: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:49.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:49 smithi145 ceph-mon[34901]: pgmap v229: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:49.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:49 smithi112 ceph-mon[34367]: pgmap v229: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:49.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:49 smithi002 ceph-mon[31019]: pgmap v229: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:51.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:51 smithi145 ceph-mon[34901]: pgmap v230: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:51.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:51 smithi112 ceph-mon[34367]: pgmap v230: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:51.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:51 smithi002 ceph-mon[31019]: pgmap v230: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:53.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:53 smithi112 ceph-mon[34367]: pgmap v231: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:53.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:53 smithi002 ceph-mon[31019]: pgmap v231: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:53.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:53 smithi145 ceph-mon[34901]: pgmap v231: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:55.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:55 smithi112 ceph-mon[34367]: pgmap v232: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:55.509 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:55 smithi145 ceph-mon[34901]: pgmap v232: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:55.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:55 smithi002 ceph-mon[31019]: pgmap v232: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:57.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:57 smithi112 ceph-mon[34367]: pgmap v233: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:57.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:57 smithi002 ceph-mon[31019]: pgmap v233: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:57.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:57 smithi145 ceph-mon[34901]: pgmap v233: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:21:59.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:21:59 smithi112 ceph-mon[34367]: pgmap v234: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:59.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:21:59 smithi002 ceph-mon[31019]: pgmap v234: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:21:59.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:21:59 smithi145 ceph-mon[34901]: pgmap v234: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:01.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:01 smithi112 ceph-mon[34367]: pgmap v235: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:01.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:01 smithi002 ceph-mon[31019]: pgmap v235: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:01.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:01 smithi145 ceph-mon[34901]: pgmap v235: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:03.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:03 smithi112 ceph-mon[34367]: pgmap v236: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:03.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:03 smithi002 ceph-mon[31019]: pgmap v236: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:03.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:03 smithi145 ceph-mon[34901]: pgmap v236: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:05.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:05 smithi112 ceph-mon[34367]: pgmap v237: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:05.560 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:05 smithi002 ceph-mon[31019]: pgmap v237: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:05.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:05 smithi145 ceph-mon[34901]: pgmap v237: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:07.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:07 smithi112 ceph-mon[34367]: pgmap v238: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-15T23:22:07.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:07 smithi002 ceph-mon[31019]: pgmap v238: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-15T23:22:07.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:07 smithi145 ceph-mon[34901]: pgmap v238: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-15T23:22:08.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:08 smithi112 ceph-mon[34367]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T23:22:08.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:08 smithi002 ceph-mon[31019]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T23:22:08.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:08 smithi145 ceph-mon[34901]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T23:22:09.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:09 smithi112 ceph-mon[34367]: pgmap v240: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-15T23:22:09.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:09 smithi002 ceph-mon[31019]: pgmap v240: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-15T23:22:09.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:09 smithi145 ceph-mon[34901]: pgmap v240: 97 pgs: 97 active+clean; 320 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-15T23:22:11.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:11 smithi002 ceph-mon[31019]: pgmap v241: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:22:11.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:11 smithi145 ceph-mon[34901]: pgmap v241: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:22:11.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:11 smithi112 ceph-mon[34367]: pgmap v241: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:22:13.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:13 smithi002 ceph-mon[31019]: pgmap v242: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:22:13.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:13 smithi145 ceph-mon[34901]: pgmap v242: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:22:13.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:13 smithi112 ceph-mon[34367]: pgmap v242: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:22:15.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:15 smithi002 ceph-mon[31019]: pgmap v243: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:22:15.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:15 smithi002 ceph-mon[31019]: osdmap e90: 12 total, 12 up, 12 in 2024-09-15T23:22:15.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:15 smithi145 ceph-mon[34901]: pgmap v243: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:22:15.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:15 smithi145 ceph-mon[34901]: osdmap e90: 12 total, 12 up, 12 in 2024-09-15T23:22:15.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:15 smithi112 ceph-mon[34367]: pgmap v243: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:22:15.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:15 smithi112 ceph-mon[34367]: osdmap e90: 12 total, 12 up, 12 in 2024-09-15T23:22:17.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:17 smithi002 ceph-mon[31019]: pgmap v245: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 243 B/s wr, 2 op/s 2024-09-15T23:22:17.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:17 smithi145 ceph-mon[34901]: pgmap v245: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 243 B/s wr, 2 op/s 2024-09-15T23:22:17.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:17 smithi112 ceph-mon[34367]: pgmap v245: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 243 B/s wr, 2 op/s 2024-09-15T23:22:19.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:19 smithi002 ceph-mon[31019]: pgmap v246: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T23:22:19.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:19 smithi145 ceph-mon[34901]: pgmap v246: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T23:22:19.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:19 smithi112 ceph-mon[34367]: pgmap v246: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T23:22:21.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:21 smithi002 ceph-mon[31019]: pgmap v247: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:22:21.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:21 smithi145 ceph-mon[34901]: pgmap v247: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:22:21.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:21 smithi112 ceph-mon[34367]: pgmap v247: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:22:23.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:23 smithi002 ceph-mon[31019]: pgmap v248: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:22:23.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:23 smithi145 ceph-mon[34901]: pgmap v248: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:22:23.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:23 smithi112 ceph-mon[34367]: pgmap v248: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:22:25.548 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:25 smithi112 ceph-mon[34367]: pgmap v249: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:22:25.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:25 smithi002 ceph-mon[31019]: pgmap v249: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:22:25.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:25 smithi145 ceph-mon[34901]: pgmap v249: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:22:27.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:27 smithi002 ceph-mon[31019]: pgmap v250: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 974 B/s rd, 1 op/s 2024-09-15T23:22:27.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:27 smithi145 ceph-mon[34901]: pgmap v250: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 974 B/s rd, 1 op/s 2024-09-15T23:22:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:27 smithi112 ceph-mon[34367]: pgmap v250: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 974 B/s rd, 1 op/s 2024-09-15T23:22:29.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:29 smithi002 ceph-mon[31019]: pgmap v251: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:29 smithi145 ceph-mon[34901]: pgmap v251: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:29.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:29 smithi112 ceph-mon[34367]: pgmap v251: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:31.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:31 smithi002 ceph-mon[31019]: pgmap v252: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:31.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:31 smithi145 ceph-mon[34901]: pgmap v252: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:31.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:31 smithi112 ceph-mon[34367]: pgmap v252: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:33.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:33 smithi002 ceph-mon[31019]: pgmap v253: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:33.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:33 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:22:33.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:33 smithi145 ceph-mon[34901]: pgmap v253: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:33.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:33 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:22:33.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:33 smithi112 ceph-mon[34367]: pgmap v253: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:33.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:33 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:22:34.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:34 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:22:34.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:34 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:22:34.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:34 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:22:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:34 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:22:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:34 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:22:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:34 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:22:34.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:34 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:22:34.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:34 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:22:34.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:34 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:22:35.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:35 smithi145 ceph-mon[34901]: pgmap v254: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:35.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:35 smithi112 ceph-mon[34367]: pgmap v254: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:35.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:35 smithi002 ceph-mon[31019]: pgmap v254: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:37.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:37 smithi145 ceph-mon[34901]: pgmap v255: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:37.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:37 smithi112 ceph-mon[34367]: pgmap v255: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:37.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:37 smithi002 ceph-mon[31019]: pgmap v255: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:39.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:39 smithi145 ceph-mon[34901]: pgmap v256: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:39.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:39 smithi112 ceph-mon[34367]: pgmap v256: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:39.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:39 smithi002 ceph-mon[31019]: pgmap v256: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:41.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:41 smithi145 ceph-mon[34901]: pgmap v257: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:41.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:41 smithi112 ceph-mon[34367]: pgmap v257: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:41.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:41 smithi002 ceph-mon[31019]: pgmap v257: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:43.610 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:43 smithi002 ceph-mon[31019]: pgmap v258: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:43.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:43 smithi145 ceph-mon[34901]: pgmap v258: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:43.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:43 smithi112 ceph-mon[34367]: pgmap v258: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:45.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:45 smithi145 ceph-mon[34901]: pgmap v259: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:45.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:45 smithi112 ceph-mon[34367]: pgmap v259: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:45.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:45 smithi002 ceph-mon[31019]: pgmap v259: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:47.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:47 smithi145 ceph-mon[34901]: pgmap v260: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:47.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:47 smithi112 ceph-mon[34367]: pgmap v260: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:47.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:47 smithi002 ceph-mon[31019]: pgmap v260: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:49.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:49 smithi145 ceph-mon[34901]: pgmap v261: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:49.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:49 smithi112 ceph-mon[34367]: pgmap v261: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:49 smithi002 ceph-mon[31019]: pgmap v261: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:51.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:51 smithi145 ceph-mon[34901]: pgmap v262: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:51.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:51 smithi112 ceph-mon[34367]: pgmap v262: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:51.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:51 smithi002 ceph-mon[31019]: pgmap v262: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:53.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:53 smithi145 ceph-mon[34901]: pgmap v263: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:53.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:53 smithi112 ceph-mon[34367]: pgmap v263: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:53.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:53 smithi002 ceph-mon[31019]: pgmap v263: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:55.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:55 smithi145 ceph-mon[34901]: pgmap v264: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:55.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:55 smithi112 ceph-mon[34367]: pgmap v264: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:55.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:55 smithi002 ceph-mon[31019]: pgmap v264: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:57.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:57 smithi145 ceph-mon[34901]: pgmap v265: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:57.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:57 smithi112 ceph-mon[34367]: pgmap v265: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:57.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:57 smithi002 ceph-mon[31019]: pgmap v265: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:22:59.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:22:59 smithi145 ceph-mon[34901]: pgmap v266: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:59.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:22:59 smithi112 ceph-mon[34367]: pgmap v266: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:22:59.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:22:59 smithi002 ceph-mon[31019]: pgmap v266: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:01.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:01 smithi145 ceph-mon[34901]: pgmap v267: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:01.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:01 smithi112 ceph-mon[34367]: pgmap v267: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:01.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:01 smithi002 ceph-mon[31019]: pgmap v267: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:03.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:03 smithi145 ceph-mon[34901]: pgmap v268: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:03.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:03 smithi112 ceph-mon[34367]: pgmap v268: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:03.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:03 smithi002 ceph-mon[31019]: pgmap v268: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:05.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:05 smithi145 ceph-mon[34901]: pgmap v269: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:05.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:05 smithi112 ceph-mon[34367]: pgmap v269: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:05.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:05 smithi002 ceph-mon[31019]: pgmap v269: 97 pgs: 97 active+clean; 316 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:07.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:07 smithi145 ceph-mon[34901]: pgmap v270: 97 pgs: 97 active+clean; 316 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-15T23:23:07.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:07 smithi112 ceph-mon[34367]: pgmap v270: 97 pgs: 97 active+clean; 316 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-15T23:23:07.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:07 smithi002 ceph-mon[31019]: pgmap v270: 97 pgs: 97 active+clean; 316 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-15T23:23:08.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:08 smithi145 ceph-mon[34901]: osdmap e91: 12 total, 12 up, 12 in 2024-09-15T23:23:08.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:08 smithi112 ceph-mon[34367]: osdmap e91: 12 total, 12 up, 12 in 2024-09-15T23:23:08.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:08 smithi002 ceph-mon[31019]: osdmap e91: 12 total, 12 up, 12 in 2024-09-15T23:23:09.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:09 smithi145 ceph-mon[34901]: pgmap v272: 97 pgs: 97 active+clean; 316 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-15T23:23:09.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:09 smithi112 ceph-mon[34367]: pgmap v272: 97 pgs: 97 active+clean; 316 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-15T23:23:09.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:09 smithi002 ceph-mon[31019]: pgmap v272: 97 pgs: 97 active+clean; 316 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-15T23:23:11.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:11 smithi145 ceph-mon[34901]: pgmap v273: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:23:11.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:11 smithi112 ceph-mon[34367]: pgmap v273: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:23:11.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:11 smithi002 ceph-mon[31019]: pgmap v273: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:23:13.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:13 smithi145 ceph-mon[34901]: pgmap v274: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:23:13.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:13 smithi112 ceph-mon[34367]: pgmap v274: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:23:13.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:13 smithi002 ceph-mon[31019]: pgmap v274: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:23:15.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:15 smithi145 ceph-mon[34901]: pgmap v275: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:23:15.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:15 smithi145 ceph-mon[34901]: osdmap e92: 12 total, 12 up, 12 in 2024-09-15T23:23:15.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:15 smithi112 ceph-mon[34367]: pgmap v275: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:23:15.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:15 smithi112 ceph-mon[34367]: osdmap e92: 12 total, 12 up, 12 in 2024-09-15T23:23:15.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:15 smithi002 ceph-mon[31019]: pgmap v275: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2024-09-15T23:23:15.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:15 smithi002 ceph-mon[31019]: osdmap e92: 12 total, 12 up, 12 in 2024-09-15T23:23:17.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:17 smithi145 ceph-mon[34901]: pgmap v277: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 248 B/s wr, 2 op/s 2024-09-15T23:23:17.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:17 smithi112 ceph-mon[34367]: pgmap v277: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 248 B/s wr, 2 op/s 2024-09-15T23:23:17.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:17 smithi002 ceph-mon[31019]: pgmap v277: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 248 B/s wr, 2 op/s 2024-09-15T23:23:19.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:19 smithi145 ceph-mon[34901]: pgmap v278: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T23:23:19.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:19 smithi112 ceph-mon[34367]: pgmap v278: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T23:23:19.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:19 smithi002 ceph-mon[31019]: pgmap v278: 97 pgs: 97 active+clean; 313 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T23:23:21.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:21 smithi145 ceph-mon[34901]: pgmap v279: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:23:21.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:21 smithi112 ceph-mon[34367]: pgmap v279: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:23:21.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:21 smithi002 ceph-mon[31019]: pgmap v279: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:23:23.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:23 smithi145 ceph-mon[34901]: pgmap v280: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:23:23.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:23 smithi112 ceph-mon[34367]: pgmap v280: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:23:23.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:23 smithi002 ceph-mon[31019]: pgmap v280: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:23:25.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:25 smithi145 ceph-mon[34901]: pgmap v281: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:23:25.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:25 smithi112 ceph-mon[34367]: pgmap v281: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:23:25.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:25 smithi002 ceph-mon[31019]: pgmap v281: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:23:27.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:27 smithi145 ceph-mon[34901]: pgmap v282: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 974 B/s rd, 1 op/s 2024-09-15T23:23:27.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:27 smithi112 ceph-mon[34367]: pgmap v282: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 974 B/s rd, 1 op/s 2024-09-15T23:23:27.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:27 smithi002 ceph-mon[31019]: pgmap v282: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 974 B/s rd, 1 op/s 2024-09-15T23:23:29.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:29 smithi145 ceph-mon[34901]: pgmap v283: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:29.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:29 smithi112 ceph-mon[34367]: pgmap v283: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:29.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:29 smithi002 ceph-mon[31019]: pgmap v283: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:31.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:31 smithi145 ceph-mon[34901]: pgmap v284: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:31.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:31 smithi112 ceph-mon[34367]: pgmap v284: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:31.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:31 smithi002 ceph-mon[31019]: pgmap v284: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:33.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:33 smithi145 ceph-mon[34901]: pgmap v285: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:33.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:33 smithi112 ceph-mon[34367]: pgmap v285: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:33.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:33 smithi002 ceph-mon[31019]: pgmap v285: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:34 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:34 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:34 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:34.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:34 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:23:34.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:34 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:34.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:34 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:34.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:34 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:34.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:34 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:23:34.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:34 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:34.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:34 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:34.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:34 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:34.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:34 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:23:35.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:35 smithi145 ceph-mon[34901]: pgmap v286: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:35.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:35 smithi112 ceph-mon[34367]: pgmap v286: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:35.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:35 smithi002 ceph-mon[31019]: pgmap v286: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:37.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:37 smithi145 ceph-mon[34901]: pgmap v287: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:37.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:37 smithi112 ceph-mon[34367]: pgmap v287: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:37.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:37 smithi002 ceph-mon[31019]: pgmap v287: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:39.707 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:39 smithi145 ceph-mon[34901]: pgmap v288: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:39.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:39 smithi112 ceph-mon[34367]: pgmap v288: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:39.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:39 smithi002 ceph-mon[31019]: pgmap v288: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:41.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:41 smithi112 ceph-mon[34367]: pgmap v289: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:41.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:41 smithi002 ceph-mon[31019]: pgmap v289: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:41.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:41 smithi145 ceph-mon[34901]: pgmap v289: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:43.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:43 smithi112 ceph-mon[34367]: pgmap v290: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:43.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:43 smithi002 ceph-mon[31019]: pgmap v290: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:43.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:43 smithi145 ceph-mon[34901]: pgmap v290: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:44.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:44 smithi112 ceph-mon[34367]: pgmap v291: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:44.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:44 smithi002 ceph-mon[31019]: pgmap v291: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:44.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:44 smithi145 ceph-mon[34901]: pgmap v291: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:46.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:46 smithi112 ceph-mon[34367]: pgmap v292: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:47.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:46 smithi002 ceph-mon[31019]: pgmap v292: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:47.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:46 smithi145 ceph-mon[34901]: pgmap v292: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:48.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:48 smithi112 ceph-mon[34367]: pgmap v293: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T23:23:49.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:48 smithi002 ceph-mon[31019]: pgmap v293: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T23:23:49.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:48 smithi145 ceph-mon[34901]: pgmap v293: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T23:23:50.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:50 smithi112 ceph-mon[34367]: pgmap v294: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:51.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:50 smithi002 ceph-mon[31019]: pgmap v294: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:51.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:50 smithi145 ceph-mon[34901]: pgmap v294: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:52.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:52 smithi112 ceph-mon[34367]: pgmap v295: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T23:23:53.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:52 smithi002 ceph-mon[31019]: pgmap v295: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T23:23:53.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:52 smithi145 ceph-mon[34901]: pgmap v295: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T23:23:54.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:54 smithi112 ceph-mon[34367]: pgmap v296: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T23:23:55.009 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:54 smithi145 ceph-mon[34901]: pgmap v296: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T23:23:55.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:54 smithi002 ceph-mon[31019]: pgmap v296: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T23:23:56.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:56 smithi112 ceph-mon[34367]: pgmap v297: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:57.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:56 smithi002 ceph-mon[31019]: pgmap v297: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:57.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:56 smithi145 ceph-mon[34901]: pgmap v297: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:23:58.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:23:58 smithi112 ceph-mon[34367]: pgmap v298: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:59.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:23:58 smithi002 ceph-mon[31019]: pgmap v298: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:23:59.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:23:58 smithi145 ceph-mon[34901]: pgmap v298: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:00.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:00 smithi112 ceph-mon[34367]: pgmap v299: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:24:01.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:00 smithi002 ceph-mon[31019]: pgmap v299: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:24:01.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:00 smithi145 ceph-mon[34901]: pgmap v299: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:24:02.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:02 smithi112 ceph-mon[34367]: pgmap v300: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:03.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:02 smithi002 ceph-mon[31019]: pgmap v300: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:03.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:02 smithi145 ceph-mon[34901]: pgmap v300: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:04.997 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:04 smithi112 ceph-mon[34367]: pgmap v301: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:05.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:04 smithi002 ceph-mon[31019]: pgmap v301: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:05.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:04 smithi145 ceph-mon[34901]: pgmap v301: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:07.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:06 smithi002 ceph-mon[31019]: pgmap v302: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-15T23:24:07.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:06 smithi145 ceph-mon[34901]: pgmap v302: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-15T23:24:07.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:06 smithi112 ceph-mon[34367]: pgmap v302: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-15T23:24:08.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:07 smithi002 ceph-mon[31019]: osdmap e93: 12 total, 12 up, 12 in 2024-09-15T23:24:08.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:07 smithi145 ceph-mon[34901]: osdmap e93: 12 total, 12 up, 12 in 2024-09-15T23:24:08.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:07 smithi112 ceph-mon[34367]: osdmap e93: 12 total, 12 up, 12 in 2024-09-15T23:24:09.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:08 smithi002 ceph-mon[31019]: pgmap v304: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-15T23:24:09.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:08 smithi145 ceph-mon[34901]: pgmap v304: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-15T23:24:09.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:08 smithi112 ceph-mon[34367]: pgmap v304: 97 pgs: 97 active+clean; 313 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-15T23:24:11.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:11 smithi145 ceph-mon[34901]: pgmap v305: 97 pgs: 97 active+clean; 309 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-15T23:24:11.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:11 smithi145 ceph-mon[34901]: osdmap e94: 12 total, 12 up, 12 in 2024-09-15T23:24:11.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:11 smithi112 ceph-mon[34367]: pgmap v305: 97 pgs: 97 active+clean; 309 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-15T23:24:11.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:11 smithi112 ceph-mon[34367]: osdmap e94: 12 total, 12 up, 12 in 2024-09-15T23:24:11.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:11 smithi002 ceph-mon[31019]: pgmap v305: 97 pgs: 97 active+clean; 309 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-15T23:24:11.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:11 smithi002 ceph-mon[31019]: osdmap e94: 12 total, 12 up, 12 in 2024-09-15T23:24:13.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:13 smithi145 ceph-mon[34901]: pgmap v307: 97 pgs: 97 active+clean; 309 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 28 op/s 2024-09-15T23:24:13.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:13 smithi112 ceph-mon[34367]: pgmap v307: 97 pgs: 97 active+clean; 309 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 28 op/s 2024-09-15T23:24:13.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:13 smithi002 ceph-mon[31019]: pgmap v307: 97 pgs: 97 active+clean; 309 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 67 KiB/s wr, 28 op/s 2024-09-15T23:24:15.460 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:15 smithi145 ceph-mon[34901]: pgmap v308: 97 pgs: 97 active+clean; 309 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-15T23:24:15.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:15 smithi112 ceph-mon[34367]: pgmap v308: 97 pgs: 97 active+clean; 309 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-15T23:24:15.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:15 smithi002 ceph-mon[31019]: pgmap v308: 97 pgs: 97 active+clean; 309 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 127 B/s wr, 1 op/s 2024-09-15T23:24:17.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:17 smithi145 ceph-mon[34901]: pgmap v309: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-15T23:24:17.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:17 smithi112 ceph-mon[34367]: pgmap v309: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-15T23:24:17.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:17 smithi002 ceph-mon[31019]: pgmap v309: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-15T23:24:19.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:19 smithi145 ceph-mon[34901]: pgmap v310: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T23:24:19.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:19 smithi112 ceph-mon[34367]: pgmap v310: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T23:24:19.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:19 smithi002 ceph-mon[31019]: pgmap v310: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T23:24:21.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:21 smithi145 ceph-mon[34901]: pgmap v311: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:24:21.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:21 smithi112 ceph-mon[34367]: pgmap v311: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:24:21.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:21 smithi002 ceph-mon[31019]: pgmap v311: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T23:24:23.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:23 smithi145 ceph-mon[34901]: pgmap v312: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 978 B/s rd, 88 B/s wr, 1 op/s 2024-09-15T23:24:23.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:23 smithi112 ceph-mon[34367]: pgmap v312: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 978 B/s rd, 88 B/s wr, 1 op/s 2024-09-15T23:24:23.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:23 smithi002 ceph-mon[31019]: pgmap v312: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 978 B/s rd, 88 B/s wr, 1 op/s 2024-09-15T23:24:25.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:25 smithi145 ceph-mon[34901]: pgmap v313: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T23:24:25.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:25 smithi112 ceph-mon[34367]: pgmap v313: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T23:24:25.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:25 smithi002 ceph-mon[31019]: pgmap v313: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T23:24:26.390 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-15T23:24:26.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.506+0000 7f1bf05e4640 1 -- 172.21.15.2:0/1198504787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be8101250 msgr2=0x7f1be8107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:26.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.506+0000 7f1bf05e4640 1 --2- 172.21.15.2:0/1198504787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be8101250 0x7f1be8107990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009900 tx=0x7f1bd802a410 comp rx=0 tx=0).stop 2024-09-15T23:24:26.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.506+0000 7f1bf05e4640 1 -- 172.21.15.2:0/1198504787 shutdown_connections 2024-09-15T23:24:26.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.506+0000 7f1bf05e4640 1 --2- 172.21.15.2:0/1198504787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1be81080f0 0x7f1be810ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.506+0000 7f1bf05e4640 1 --2- 172.21.15.2:0/1198504787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be8101250 0x7f1be8107990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.506+0000 7f1bf05e4640 1 --2- 172.21.15.2:0/1198504787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1be81008a0 0x7f1be8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.506+0000 7f1bf05e4640 1 -- 172.21.15.2:0/1198504787 >> 172.21.15.2:0/1198504787 conn(0x7f1be8075ef0 msgr2=0x7f1be8076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:26.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.506+0000 7f1bf05e4640 1 -- 172.21.15.2:0/1198504787 shutdown_connections 2024-09-15T23:24:26.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.506+0000 7f1bf05e4640 1 -- 172.21.15.2:0/1198504787 wait complete. 2024-09-15T23:24:26.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bf05e4640 1 Processor -- start 2024-09-15T23:24:26.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bf05e4640 1 -- start start 2024-09-15T23:24:26.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bf05e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be81008a0 0x7f1be8101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:26.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bf05e4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1be81080f0 0x7f1be8101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:26.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bf05e4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1be8102290 0x7f1be81a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:26.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bf05e4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1be8111dd0 con 0x7f1be81008a0 2024-09-15T23:24:26.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bf05e4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1be8111c50 con 0x7f1be81080f0 2024-09-15T23:24:26.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bf05e4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1be8111f50 con 0x7f1be8102290 2024-09-15T23:24:26.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bee380640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be81008a0 0x7f1be8101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:26.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bee380640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be81008a0 0x7f1be8101810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46760/0 (socket says 172.21.15.2:46760) 2024-09-15T23:24:26.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bee380640 1 -- 172.21.15.2:0/3577449290 learned_addr learned my addr 172.21.15.2:0/3577449290 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:24:26.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bedb7f640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1be81080f0 0x7f1be8101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:26.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1beeb81640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1be8102290 0x7f1be81a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:26.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bee380640 1 -- 172.21.15.2:0/3577449290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1be8102290 msgr2=0x7f1be81a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:26.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bee380640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1be8102290 0x7f1be81a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bee380640 1 -- 172.21.15.2:0/3577449290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1be81080f0 msgr2=0x7f1be8101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:26.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bee380640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1be81080f0 0x7f1be8101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1bee380640 1 -- 172.21.15.2:0/3577449290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be81a6b10 con 0x7f1be81008a0 2024-09-15T23:24:26.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.507+0000 7f1beeb81640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1be8102290 0x7f1be81a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:26.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.508+0000 7f1bee380640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be81008a0 0x7f1be8101810 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1be400d950 tx=0x7f1be400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:26.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.508+0000 7f1bdf7fe640 1 -- 172.21.15.2:0/3577449290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4017030 con 0x7f1be81008a0 2024-09-15T23:24:26.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.508+0000 7f1bdf7fe640 1 -- 172.21.15.2:0/3577449290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1be4004020 con 0x7f1be81008a0 2024-09-15T23:24:26.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.508+0000 7f1bdf7fe640 1 -- 172.21.15.2:0/3577449290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be40047a0 con 0x7f1be81008a0 2024-09-15T23:24:26.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.508+0000 7f1bf05e4640 1 -- 172.21.15.2:0/3577449290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be81a6e00 con 0x7f1be81008a0 2024-09-15T23:24:26.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.508+0000 7f1bf05e4640 1 -- 172.21.15.2:0/3577449290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be81a7270 con 0x7f1be81008a0 2024-09-15T23:24:26.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.509+0000 7f1bf05e4640 1 -- 172.21.15.2:0/3577449290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be8100c80 con 0x7f1be81008a0 2024-09-15T23:24:26.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.511+0000 7f1bdf7fe640 1 -- 172.21.15.2:0/3577449290 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7f1be40041d0 con 0x7f1be81008a0 2024-09-15T23:24:26.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.512+0000 7f1bdf7fe640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f1bd40a3490 0x7f1bd40a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:26.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.512+0000 7f1bedb7f640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f1bd40a3490 0x7f1bd40a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:26.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.512+0000 7f1bdf7fe640 1 -- 172.21.15.2:0/3577449290 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8600+0+0 (secure 0 0 0) 0x7f1be40cfe90 con 0x7f1be81008a0 2024-09-15T23:24:26.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.512+0000 7f1bedb7f640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f1bd40a3490 0x7f1bd40a5950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8000c00 tx=0x7f1bd8032ba0 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:26.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.515+0000 7f1bdf7fe640 1 -- 172.21.15.2:0/3577449290 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1be409c820 con 0x7f1be81008a0 2024-09-15T23:24:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.715+0000 7f1bf05e4640 1 -- 172.21.15.2:0/3577449290 --> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f1be8101250 con 0x7f1bd40a3490 2024-09-15T23:24:26.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.723+0000 7f1bdf7fe640 1 -- 172.21.15.2:0/3577449290 <== mgr.15054 v2:172.21.15.2:6800/1306494062 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f1be8101250 con 0x7f1bd40a3490 2024-09-15T23:24:26.724 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-15T00:00:00", "created": "2024-09-15T23:14:24", "first": "2024-09-15T23:15:00", "last": "2024-09-15T23:24:00", "last_pruned": "2024-09-15T23:24:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-15T23:24:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.725+0000 7f1bf05e4640 1 -- 172.21.15.2:0/3577449290 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f1bd40a3490 msgr2=0x7f1bd40a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.725+0000 7f1bf05e4640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f1bd40a3490 0x7f1bd40a5950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8000c00 tx=0x7f1bd8032ba0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.725+0000 7f1bf05e4640 1 -- 172.21.15.2:0/3577449290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be81008a0 msgr2=0x7f1be8101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.725+0000 7f1bf05e4640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be81008a0 0x7f1be8101810 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1be400d950 tx=0x7f1be400de10 comp rx=0 tx=0).stop 2024-09-15T23:24:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.725+0000 7f1bf05e4640 1 -- 172.21.15.2:0/3577449290 shutdown_connections 2024-09-15T23:24:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.725+0000 7f1bf05e4640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f1bd40a3490 0x7f1bd40a5950 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.725+0000 7f1bf05e4640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1be8102290 0x7f1be81a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.725+0000 7f1bf05e4640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1be81080f0 0x7f1be8101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.725+0000 7f1bf05e4640 1 --2- 172.21.15.2:0/3577449290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be81008a0 0x7f1be8101810 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.725+0000 7f1bf05e4640 1 -- 172.21.15.2:0/3577449290 >> 172.21.15.2:0/3577449290 conn(0x7f1be8075ef0 msgr2=0x7f1be80ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.725+0000 7f1bf05e4640 1 -- 172.21.15.2:0/3577449290 shutdown_connections 2024-09-15T23:24:26.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.725+0000 7f1bf05e4640 1 -- 172.21.15.2:0/3577449290 wait complete. 2024-09-15T23:24:26.737 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-15T23:24:26.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.840+0000 7f312236f640 1 -- 172.21.15.2:0/2063725367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f311c101250 msgr2=0x7f311c107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:26.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.840+0000 7f312236f640 1 --2- 172.21.15.2:0/2063725367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f311c101250 0x7f311c107990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3110009900 tx=0x7f311002a410 comp rx=0 tx=0).stop 2024-09-15T23:24:26.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.840+0000 7f312236f640 1 -- 172.21.15.2:0/2063725367 shutdown_connections 2024-09-15T23:24:26.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.840+0000 7f312236f640 1 --2- 172.21.15.2:0/2063725367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c1080f0 0x7f311c10ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.840+0000 7f312236f640 1 --2- 172.21.15.2:0/2063725367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f311c101250 0x7f311c107990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.840+0000 7f312236f640 1 --2- 172.21.15.2:0/2063725367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c1008a0 0x7f311c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.840+0000 7f312236f640 1 -- 172.21.15.2:0/2063725367 >> 172.21.15.2:0/2063725367 conn(0x7f311c075ef0 msgr2=0x7f311c076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.840+0000 7f312236f640 1 -- 172.21.15.2:0/2063725367 shutdown_connections 2024-09-15T23:24:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.840+0000 7f312236f640 1 -- 172.21.15.2:0/2063725367 wait complete. 2024-09-15T23:24:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.841+0000 7f312236f640 1 Processor -- start 2024-09-15T23:24:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.841+0000 7f312236f640 1 -- start start 2024-09-15T23:24:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.841+0000 7f312236f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c1008a0 0x7f311c1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.841+0000 7f312236f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c1080f0 0x7f311c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.841+0000 7f312236f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f311c19cb70 0x7f311c19d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.841+0000 7f312236f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f311c111dd0 con 0x7f311c19cb70 2024-09-15T23:24:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.841+0000 7f312236f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f311c111c50 con 0x7f311c1080f0 2024-09-15T23:24:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.841+0000 7f312236f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f311c111f50 con 0x7f311c1008a0 2024-09-15T23:24:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f312090c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f311c19cb70 0x7f311c19d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f312090c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f311c19cb70 0x7f311c19d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46774/0 (socket says 172.21.15.2:46774) 2024-09-15T23:24:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f312090c640 1 -- 172.21.15.2:0/2739381003 learned_addr learned my addr 172.21.15.2:0/2739381003 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:24:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f311bfff640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c1008a0 0x7f311c1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f311b7fe640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c1080f0 0x7f311c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f312090c640 1 -- 172.21.15.2:0/2739381003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c1008a0 msgr2=0x7f311c1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f312090c640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c1008a0 0x7f311c1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f312090c640 1 -- 172.21.15.2:0/2739381003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c1080f0 msgr2=0x7f311c1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f312090c640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c1080f0 0x7f311c1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f312090c640 1 -- 172.21.15.2:0/2739381003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c19d660 con 0x7f311c19cb70 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f311b7fe640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c1080f0 0x7f311c1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f312090c640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f311c19cb70 0x7f311c19d020 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f311400eaa0 tx=0x7f311400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f31197fa640 1 -- 172.21.15.2:0/2739381003 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311400cdb0 con 0x7f311c19cb70 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f312236f640 1 -- 172.21.15.2:0/2739381003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311c19d950 con 0x7f311c19cb70 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f31197fa640 1 -- 172.21.15.2:0/2739381003 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3114005020 con 0x7f311c19cb70 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f31197fa640 1 -- 172.21.15.2:0/2739381003 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31140116d0 con 0x7f311c19cb70 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.842+0000 7f312236f640 1 -- 172.21.15.2:0/2739381003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311c1a5110 con 0x7f311c19cb70 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.843+0000 7f312236f640 1 -- 172.21.15.2:0/2739381003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f311c100c80 con 0x7f311c19cb70 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.844+0000 7f31197fa640 1 -- 172.21.15.2:0/2739381003 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7f31140051d0 con 0x7f311c19cb70 2024-09-15T23:24:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.845+0000 7f31197fa640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f31040a3460 0x7f31040a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.845+0000 7f31197fa640 1 -- 172.21.15.2:0/2739381003 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8600+0+0 (secure 0 0 0) 0x7f31140cfed0 con 0x7f311c19cb70 2024-09-15T23:24:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.845+0000 7f311bfff640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f31040a3460 0x7f31040a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.845+0000 7f311bfff640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f31040a3460 0x7f31040a5920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f310c009bd0 tx=0x7f310c005f90 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:26.849+0000 7f31197fa640 1 -- 172.21.15.2:0/2739381003 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3114016030 con 0x7f311c19cb70 2024-09-15T23:24:27.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.045+0000 7f312236f640 1 -- 172.21.15.2:0/2739381003 --> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f311c101250 con 0x7f31040a3460 2024-09-15T23:24:27.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.052+0000 7f31197fa640 1 -- 172.21.15.2:0/2739381003 <== mgr.15054 v2:172.21.15.2:6800/1306494062 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f311c101250 con 0x7f31040a3460 2024-09-15T23:24:27.054 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-09-15T23:24:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.054+0000 7f312236f640 1 -- 172.21.15.2:0/2739381003 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f31040a3460 msgr2=0x7f31040a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.054+0000 7f312236f640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f31040a3460 0x7f31040a5920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f310c009bd0 tx=0x7f310c005f90 comp rx=0 tx=0).stop 2024-09-15T23:24:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.054+0000 7f312236f640 1 -- 172.21.15.2:0/2739381003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f311c19cb70 msgr2=0x7f311c19d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.054+0000 7f312236f640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f311c19cb70 0x7f311c19d020 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f311400eaa0 tx=0x7f311400ef60 comp rx=0 tx=0).stop 2024-09-15T23:24:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.054+0000 7f312236f640 1 -- 172.21.15.2:0/2739381003 shutdown_connections 2024-09-15T23:24:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.054+0000 7f312236f640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f31040a3460 0x7f31040a5920 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.054+0000 7f312236f640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f311c19cb70 0x7f311c19d020 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.055+0000 7f312236f640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f311c1080f0 0x7f311c1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.055+0000 7f312236f640 1 --2- 172.21.15.2:0/2739381003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f311c1008a0 0x7f311c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.055+0000 7f312236f640 1 -- 172.21.15.2:0/2739381003 >> 172.21.15.2:0/2739381003 conn(0x7f311c075ef0 msgr2=0x7f311c105b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.055+0000 7f312236f640 1 -- 172.21.15.2:0/2739381003 shutdown_connections 2024-09-15T23:24:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.055+0000 7f312236f640 1 -- 172.21.15.2:0/2739381003 wait complete. 2024-09-15T23:24:27.067 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-15T23:24:27.077 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:24:27.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.179+0000 7f98d3531640 1 -- 172.21.15.2:0/2015749834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc103610 msgr2=0x7f98cc10baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.179+0000 7f98d3531640 1 --2- 172.21.15.2:0/2015749834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc103610 0x7f98cc10baf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f98c0009900 tx=0x7f98c002a480 comp rx=0 tx=0).stop 2024-09-15T23:24:27.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.179+0000 7f98d3531640 1 -- 172.21.15.2:0/2015749834 shutdown_connections 2024-09-15T23:24:27.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.179+0000 7f98d3531640 1 --2- 172.21.15.2:0/2015749834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98cc10c0c0 0x7f98cc10e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.179+0000 7f98d3531640 1 --2- 172.21.15.2:0/2015749834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc103610 0x7f98cc10baf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.179+0000 7f98d3531640 1 --2- 172.21.15.2:0/2015749834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc102cf0 0x7f98cc1030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.179+0000 7f98d3531640 1 -- 172.21.15.2:0/2015749834 >> 172.21.15.2:0/2015749834 conn(0x7f98cc0fc6a0 msgr2=0x7f98cc0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:27.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.180+0000 7f98d3531640 1 -- 172.21.15.2:0/2015749834 shutdown_connections 2024-09-15T23:24:27.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.180+0000 7f98d3531640 1 -- 172.21.15.2:0/2015749834 wait complete. 2024-09-15T23:24:27.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.180+0000 7f98d3531640 1 Processor -- start 2024-09-15T23:24:27.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.180+0000 7f98d3531640 1 -- start start 2024-09-15T23:24:27.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.180+0000 7f98d3531640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98cc102cf0 0x7f98cc1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:27.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.180+0000 7f98d3531640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc103610 0x7f98cc198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:27.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.180+0000 7f98d3531640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc10c0c0 0x7f98cc19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:27.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.180+0000 7f98d3531640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc111d70 con 0x7f98cc103610 2024-09-15T23:24:27.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.180+0000 7f98d3531640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc111bf0 con 0x7f98cc10c0c0 2024-09-15T23:24:27.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.180+0000 7f98d3531640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc111ef0 con 0x7f98cc102cf0 2024-09-15T23:24:27.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.181+0000 7f98d0acc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc103610 0x7f98cc198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:27.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.181+0000 7f98d0acc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc103610 0x7f98cc198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46790/0 (socket says 172.21.15.2:46790) 2024-09-15T23:24:27.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.181+0000 7f98d0acc640 1 -- 172.21.15.2:0/3258460213 learned_addr learned my addr 172.21.15.2:0/3258460213 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:24:27.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.181+0000 7f98d12cd640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98cc102cf0 0x7f98cc1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:27.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.181+0000 7f98d1ace640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc10c0c0 0x7f98cc19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:27.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.181+0000 7f98d0acc640 1 -- 172.21.15.2:0/3258460213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98cc102cf0 msgr2=0x7f98cc1982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.181+0000 7f98d0acc640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98cc102cf0 0x7f98cc1982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.181+0000 7f98d0acc640 1 -- 172.21.15.2:0/3258460213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc10c0c0 msgr2=0x7f98cc19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.181+0000 7f98d0acc640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc10c0c0 0x7f98cc19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.181+0000 7f98d0acc640 1 -- 172.21.15.2:0/3258460213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98cc19d2b0 con 0x7f98cc103610 2024-09-15T23:24:27.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.181+0000 7f98d0acc640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc103610 0x7f98cc198800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f98c0006010 tx=0x7f98c0004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:27.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.183+0000 7f98ca7fc640 1 -- 172.21.15.2:0/3258460213 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c003f030 con 0x7f98cc103610 2024-09-15T23:24:27.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.183+0000 7f98ca7fc640 1 -- 172.21.15.2:0/3258460213 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f98c0003800 con 0x7f98cc103610 2024-09-15T23:24:27.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.183+0000 7f98d3531640 1 -- 172.21.15.2:0/3258460213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98cc19d540 con 0x7f98cc103610 2024-09-15T23:24:27.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.183+0000 7f98ca7fc640 1 -- 172.21.15.2:0/3258460213 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c0035070 con 0x7f98cc103610 2024-09-15T23:24:27.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.183+0000 7f98d3531640 1 -- 172.21.15.2:0/3258460213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98cc1a4e30 con 0x7f98cc103610 2024-09-15T23:24:27.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.184+0000 7f98d3531640 1 -- 172.21.15.2:0/3258460213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98cc1030d0 con 0x7f98cc103610 2024-09-15T23:24:27.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.185+0000 7f98ca7fc640 1 -- 172.21.15.2:0/3258460213 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7f98c0031ab0 con 0x7f98cc103610 2024-09-15T23:24:27.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.186+0000 7f98ca7fc640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f98b40a33c0 0x7f98b40a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:27.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.186+0000 7f98d12cd640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f98b40a33c0 0x7f98b40a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:27.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.186+0000 7f98ca7fc640 1 -- 172.21.15.2:0/3258460213 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8600+0+0 (secure 0 0 0) 0x7f98c00f05c0 con 0x7f98cc103610 2024-09-15T23:24:27.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.186+0000 7f98d12cd640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f98b40a33c0 0x7f98b40a5880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98bc007ec0 tx=0x7f98bc0075b0 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:27.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.190+0000 7f98ca7fc640 1 -- 172.21.15.2:0/3258460213 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98c00bc900 con 0x7f98cc103610 2024-09-15T23:24:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.371+0000 7f98d3531640 1 -- 172.21.15.2:0/3258460213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98cc107110 con 0x7f98cc103610 2024-09-15T23:24:27.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.372+0000 7f98ca7fc640 1 -- 172.21.15.2:0/3258460213 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+23232 (secure 0 0 0) 0x7f98c00c0c00 con 0x7f98cc103610 2024-09-15T23:24:27.374 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:24:27.374 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":94,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","created":"2024-09-15T23:04:45.101432+0000","modified":"2024-09-15T23:24:10.154697+0000","last_up_change":"2024-09-15T23:11:49.566858+0000","last_in_change":"2024-09-15T23:11:25.723093+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:07:57.919291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:38.100522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:40.716254+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40ff4fd9-3904-4178-a9cb-51f4647be540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6803","nonce":280991401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6805","nonce":280991401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6809","nonce":280991401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6807","nonce":280991401}]},"public_addr":"172.21.15.2:6803/280991401","cluster_addr":"172.21.15.2:6805/280991401","heartbeat_back_addr":"172.21.15.2:6809/280991401","heartbeat_front_addr":"172.21.15.2:6807/280991401","state":["exists","up"]},{"osd":1,"uuid":"af5e265d-fe45-4d9c-a34c-6f0b103d75d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6801","nonce":2649210970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6803","nonce":2649210970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6807","nonce":2649210970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6805","nonce":2649210970}]},"public_addr":"172.21.15.112:6801/2649210970","cluster_addr":"172.21.15.112:6803/2649210970","heartbeat_back_addr":"172.21.15.112:6807/2649210970","heartbeat_front_addr":"172.21.15.112:6805/2649210970","state":["exists","up"]},{"osd":2,"uuid":"8df9e644-fc51-4626-a1a7-6ac4448a5b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6801","nonce":3485615437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6803","nonce":3485615437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6807","nonce":3485615437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6805","nonce":3485615437}]},"public_addr":"172.21.15.145:6801/3485615437","cluster_addr":"172.21.15.145:6803/3485615437","heartbeat_back_addr":"172.21.15.145:6807/3485615437","heartbeat_front_addr":"172.21.15.145:6805/3485615437","state":["exists","up"]},{"osd":3,"uuid":"dbab372a-8fdd-4b0c-bee3-16cd75b35ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6811","nonce":113061968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6813","nonce":113061968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6817","nonce":113061968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6815","nonce":113061968}]},"public_addr":"172.21.15.2:6811/113061968","cluster_addr":"172.21.15.2:6813/113061968","heartbeat_back_addr":"172.21.15.2:6817/113061968","heartbeat_front_addr":"172.21.15.2:6815/113061968","state":["exists","up"]},{"osd":4,"uuid":"73bab8af-3973-4beb-a034-d00bcf0c572f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6809","nonce":2519162767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6811","nonce":2519162767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6815","nonce":2519162767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6813","nonce":2519162767}]},"public_addr":"172.21.15.112:6809/2519162767","cluster_addr":"172.21.15.112:6811/2519162767","heartbeat_back_addr":"172.21.15.112:6815/2519162767","heartbeat_front_addr":"172.21.15.112:6813/2519162767","state":["exists","up"]},{"osd":5,"uuid":"2d163e61-5891-46c1-b1c2-39d50a3b6f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6809","nonce":712427242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6811","nonce":712427242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6815","nonce":712427242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6813","nonce":712427242}]},"public_addr":"172.21.15.145:6809/712427242","cluster_addr":"172.21.15.145:6811/712427242","heartbeat_back_addr":"172.21.15.145:6815/712427242","heartbeat_front_addr":"172.21.15.145:6813/712427242","state":["exists","up"]},{"osd":6,"uuid":"bca02c96-10de-4953-96e9-42fc9ddf7c1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6819","nonce":2930673197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6821","nonce":2930673197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6825","nonce":2930673197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6823","nonce":2930673197}]},"public_addr":"172.21.15.2:6819/2930673197","cluster_addr":"172.21.15.2:6821/2930673197","heartbeat_back_addr":"172.21.15.2:6825/2930673197","heartbeat_front_addr":"172.21.15.2:6823/2930673197","state":["exists","up"]},{"osd":7,"uuid":"4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6817","nonce":830628191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6819","nonce":830628191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6823","nonce":830628191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6821","nonce":830628191}]},"public_addr":"172.21.15.112:6817/830628191","cluster_addr":"172.21.15.112:6819/830628191","heartbeat_back_addr":"172.21.15.112:6823/830628191","heartbeat_front_addr":"172.21.15.112:6821/830628191","state":["exists","up"]},{"osd":8,"uuid":"2733f9dd-3872-4bec-9c22-bcdb64828ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6817","nonce":3634470540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6819","nonce":3634470540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6823","nonce":3634470540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6821","nonce":3634470540}]},"public_addr":"172.21.15.145:6817/3634470540","cluster_addr":"172.21.15.145:6819/3634470540","heartbeat_back_addr":"172.21.15.145:6823/3634470540","heartbeat_front_addr":"172.21.15.145:6821/3634470540","state":["exists","up"]},{"osd":9,"uuid":"bd1f4a4a-547c-43a9-859a-75b37b06905f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6827","nonce":1417377702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6829","nonce":1417377702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6833","nonce":1417377702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6831","nonce":1417377702}]},"public_addr":"172.21.15.2:6827/1417377702","cluster_addr":"172.21.15.2:6829/1417377702","heartbeat_back_addr":"172.21.15.2:6833/1417377702","heartbeat_front_addr":"172.21.15.2:6831/1417377702","state":["exists","up"]},{"osd":10,"uuid":"f8b895e8-39f5-4753-9343-03f96da12246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6825","nonce":105615908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6827","nonce":105615908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6831","nonce":105615908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6829","nonce":105615908}]},"public_addr":"172.21.15.112:6825/105615908","cluster_addr":"172.21.15.112:6827/105615908","heartbeat_back_addr":"172.21.15.112:6831/105615908","heartbeat_front_addr":"172.21.15.112:6829/105615908","state":["exists","up"]},{"osd":11,"uuid":"dc018bfc-bc13-4ef2-a712-5cd406a56cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6825","nonce":430484289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6827","nonce":430484289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6831","nonce":430484289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6829","nonce":430484289}]},"public_addr":"172.21.15.145:6825/430484289","cluster_addr":"172.21.15.145:6827/430484289","heartbeat_back_addr":"172.21.15.145:6831/430484289","heartbeat_front_addr":"172.21.15.145:6829/430484289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:03.938207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:29.814740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:54.853802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:20.802021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:47.028090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:13.226130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:39.003023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:04.465156+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:29.321331+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:55.992585+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:21.623406+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:48.269840+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/4076310741":"2024-09-16T23:14:23.506414+0000","172.21.15.2:6801/2564114882":"2024-09-16T23:14:23.506414+0000","172.21.15.2:6800/2564114882":"2024-09-16T23:14:23.506414+0000","172.21.15.2:6801/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/236781836":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6800/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/1891095221":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/3802152324":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/2404111366":"2024-09-16T23:05:17.756048+0000","172.21.15.2:6800/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/2473316249":"2024-09-16T23:14:23.506414+0000","172.21.15.2:0/896502743":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/2956732837":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/4081748544":"2024-09-16T23:14:23.506414+0000","172.21.15.2:0/3363964546":"2024-09-16T23:14:23.506414+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:24:27.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.375+0000 7f98d3531640 1 -- 172.21.15.2:0/3258460213 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f98b40a33c0 msgr2=0x7f98b40a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.375+0000 7f98d3531640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f98b40a33c0 0x7f98b40a5880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98bc007ec0 tx=0x7f98bc0075b0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.375+0000 7f98d3531640 1 -- 172.21.15.2:0/3258460213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc103610 msgr2=0x7f98cc198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.375+0000 7f98d3531640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc103610 0x7f98cc198800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f98c0006010 tx=0x7f98c0004360 comp rx=0 tx=0).stop 2024-09-15T23:24:27.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.375+0000 7f98d3531640 1 -- 172.21.15.2:0/3258460213 shutdown_connections 2024-09-15T23:24:27.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.375+0000 7f98d3531640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f98b40a33c0 0x7f98b40a5880 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.375+0000 7f98d3531640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f98cc10c0c0 0x7f98cc19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.375+0000 7f98d3531640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98cc103610 0x7f98cc198800 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.375+0000 7f98d3531640 1 --2- 172.21.15.2:0/3258460213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98cc102cf0 0x7f98cc1982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.375+0000 7f98d3531640 1 -- 172.21.15.2:0/3258460213 >> 172.21.15.2:0/3258460213 conn(0x7f98cc0fc6a0 msgr2=0x7f98cc0fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.375+0000 7f98d3531640 1 -- 172.21.15.2:0/3258460213 shutdown_connections 2024-09-15T23:24:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.375+0000 7f98d3531640 1 -- 172.21.15.2:0/3258460213 wait complete. 2024-09-15T23:24:27.385 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:27 smithi002 ceph-mon[31019]: pgmap v314: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T23:24:27.387 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:07:57.919291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T23:12:38.100522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T23:12:40.716254+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 93, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:24:27.387 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:24:27.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:27 smithi145 ceph-mon[34901]: pgmap v314: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T23:24:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.494+0000 7f1157042640 1 -- 172.21.15.2:0/4026017120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115010c0c0 msgr2=0x7f115010e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.494+0000 7f1157042640 1 --2- 172.21.15.2:0/4026017120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115010c0c0 0x7f115010e530 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1148009ca0 tx=0x7f114802a950 comp rx=0 tx=0).stop 2024-09-15T23:24:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.494+0000 7f1157042640 1 -- 172.21.15.2:0/4026017120 shutdown_connections 2024-09-15T23:24:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.494+0000 7f1157042640 1 --2- 172.21.15.2:0/4026017120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115010c0c0 0x7f115010e530 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.494+0000 7f1157042640 1 --2- 172.21.15.2:0/4026017120 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1150103610 0x7f115010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.494+0000 7f1157042640 1 --2- 172.21.15.2:0/4026017120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1150102cf0 0x7f11501030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.494+0000 7f1157042640 1 -- 172.21.15.2:0/4026017120 >> 172.21.15.2:0/4026017120 conn(0x7f11500779d0 msgr2=0x7f11500fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.494+0000 7f1157042640 1 -- 172.21.15.2:0/4026017120 shutdown_connections 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.494+0000 7f1157042640 1 -- 172.21.15.2:0/4026017120 wait complete. 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.494+0000 7f1157042640 1 Processor -- start 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.494+0000 7f1157042640 1 -- start start 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f1157042640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1150102cf0 0x7f11501982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f1157042640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150103610 0x7f1150198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f1157042640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f115010c0c0 0x7f115019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f1157042640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1150111d40 con 0x7f1150103610 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f1157042640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1150111bc0 con 0x7f1150102cf0 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f1157042640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1150111ec0 con 0x7f115010c0c0 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f114ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150103610 0x7f1150198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f114ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150103610 0x7f1150198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46796/0 (socket says 172.21.15.2:46796) 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f114ffff640 1 -- 172.21.15.2:0/2357719006 learned_addr learned my addr 172.21.15.2:0/2357719006 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f1154dde640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1150102cf0 0x7f11501982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f11555df640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f115010c0c0 0x7f115019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f114ffff640 1 -- 172.21.15.2:0/2357719006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f115010c0c0 msgr2=0x7f115019cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f114ffff640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f115010c0c0 0x7f115019cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f114ffff640 1 -- 172.21.15.2:0/2357719006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1150102cf0 msgr2=0x7f11501982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f114ffff640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1150102cf0 0x7f11501982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f114ffff640 1 -- 172.21.15.2:0/2357719006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115019d2c0 con 0x7f1150103610 2024-09-15T23:24:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f11555df640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f115010c0c0 0x7f115019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f114ffff640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150103610 0x7f1150198810 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f114400d950 tx=0x7f114400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f114dffb640 1 -- 172.21.15.2:0/2357719006 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144017030 con 0x7f1150103610 2024-09-15T23:24:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f114dffb640 1 -- 172.21.15.2:0/2357719006 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1144004020 con 0x7f1150103610 2024-09-15T23:24:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f1157042640 1 -- 172.21.15.2:0/2357719006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115019d5b0 con 0x7f1150103610 2024-09-15T23:24:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.495+0000 7f114dffb640 1 -- 172.21.15.2:0/2357719006 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11440047a0 con 0x7f1150103610 2024-09-15T23:24:27.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.496+0000 7f1157042640 1 -- 172.21.15.2:0/2357719006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11501a4e40 con 0x7f1150103610 2024-09-15T23:24:27.500 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:27 smithi112 ceph-mon[34367]: pgmap v314: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T23:24:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.497+0000 7f1157042640 1 -- 172.21.15.2:0/2357719006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11501030d0 con 0x7f1150103610 2024-09-15T23:24:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.498+0000 7f114dffb640 1 -- 172.21.15.2:0/2357719006 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7f11440041d0 con 0x7f1150103610 2024-09-15T23:24:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.498+0000 7f114dffb640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f11380a33c0 0x7f11380a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.499+0000 7f1154dde640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f11380a33c0 0x7f11380a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.499+0000 7f114dffb640 1 -- 172.21.15.2:0/2357719006 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8600+0+0 (secure 0 0 0) 0x7f11440cfdf0 con 0x7f1150103610 2024-09-15T23:24:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.499+0000 7f1154dde640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f11380a33c0 0x7f11380a5880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11400058c0 tx=0x7f114000a250 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:27.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.501+0000 7f114dffb640 1 -- 172.21.15.2:0/2357719006 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f114409c780 con 0x7f1150103610 2024-09-15T23:24:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.676+0000 7f1157042640 1 -- 172.21.15.2:0/2357719006 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f115002d7c0 con 0x7f1150103610 2024-09-15T23:24:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.676+0000 7f114dffb640 1 -- 172.21.15.2:0/2357719006 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7f114409c080 con 0x7f1150103610 2024-09-15T23:24:27.678 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-15T23:24:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.678+0000 7f1157042640 1 -- 172.21.15.2:0/2357719006 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f11380a33c0 msgr2=0x7f11380a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.678+0000 7f1157042640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f11380a33c0 0x7f11380a5880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11400058c0 tx=0x7f114000a250 comp rx=0 tx=0).stop 2024-09-15T23:24:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.678+0000 7f1157042640 1 -- 172.21.15.2:0/2357719006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150103610 msgr2=0x7f1150198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.678+0000 7f1157042640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150103610 0x7f1150198810 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f114400d950 tx=0x7f114400de10 comp rx=0 tx=0).stop 2024-09-15T23:24:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.678+0000 7f1157042640 1 -- 172.21.15.2:0/2357719006 shutdown_connections 2024-09-15T23:24:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.678+0000 7f1157042640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f11380a33c0 0x7f11380a5880 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.678+0000 7f1157042640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f115010c0c0 0x7f115019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.678+0000 7f1157042640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1150103610 0x7f1150198810 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.678+0000 7f1157042640 1 --2- 172.21.15.2:0/2357719006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1150102cf0 0x7f11501982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.678+0000 7f1157042640 1 -- 172.21.15.2:0/2357719006 >> 172.21.15.2:0/2357719006 conn(0x7f11500779d0 msgr2=0x7f11500fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.678+0000 7f1157042640 1 -- 172.21.15.2:0/2357719006 shutdown_connections 2024-09-15T23:24:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.679+0000 7f1157042640 1 -- 172.21.15.2:0/2357719006 wait complete. 2024-09-15T23:24:27.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T23:24:27.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.796+0000 7f064fdf6640 1 -- 172.21.15.2:0/3913370377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0648103610 msgr2=0x7f064810baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.796+0000 7f064fdf6640 1 --2- 172.21.15.2:0/3913370377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0648103610 0x7f064810baf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0638009900 tx=0x7f063802a480 comp rx=0 tx=0).stop 2024-09-15T23:24:27.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.796+0000 7f064fdf6640 1 -- 172.21.15.2:0/3913370377 shutdown_connections 2024-09-15T23:24:27.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.796+0000 7f064fdf6640 1 --2- 172.21.15.2:0/3913370377 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f064810c0c0 0x7f064810e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.796+0000 7f064fdf6640 1 --2- 172.21.15.2:0/3913370377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0648103610 0x7f064810baf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.796+0000 7f064fdf6640 1 --2- 172.21.15.2:0/3913370377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0648102cf0 0x7f06481030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.796+0000 7f064fdf6640 1 -- 172.21.15.2:0/3913370377 >> 172.21.15.2:0/3913370377 conn(0x7f06480779d0 msgr2=0x7f06480fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.796+0000 7f064fdf6640 1 -- 172.21.15.2:0/3913370377 shutdown_connections 2024-09-15T23:24:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.796+0000 7f064fdf6640 1 -- 172.21.15.2:0/3913370377 wait complete. 2024-09-15T23:24:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.796+0000 7f064fdf6640 1 Processor -- start 2024-09-15T23:24:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.796+0000 7f064fdf6640 1 -- start start 2024-09-15T23:24:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064fdf6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0648102cf0 0x7f0648198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064fdf6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0648103610 0x7f0648198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064fdf6640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f064810c0c0 0x7f064819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064fdf6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0648111d40 con 0x7f0648103610 2024-09-15T23:24:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064fdf6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0648111bc0 con 0x7f0648102cf0 2024-09-15T23:24:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064fdf6640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0648111ec0 con 0x7f064810c0c0 2024-09-15T23:24:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064d391640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0648103610 0x7f0648198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064d391640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0648103610 0x7f0648198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46820/0 (socket says 172.21.15.2:46820) 2024-09-15T23:24:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064d391640 1 -- 172.21.15.2:0/3251976974 learned_addr learned my addr 172.21.15.2:0/3251976974 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:24:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064db92640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0648102cf0 0x7f0648198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064e393640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f064810c0c0 0x7f064819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064d391640 1 -- 172.21.15.2:0/3251976974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f064810c0c0 msgr2=0x7f064819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064d391640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f064810c0c0 0x7f064819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064d391640 1 -- 172.21.15.2:0/3251976974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0648102cf0 msgr2=0x7f0648198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064d391640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0648102cf0 0x7f0648198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064d391640 1 -- 172.21.15.2:0/3251976974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064819d320 con 0x7f0648103610 2024-09-15T23:24:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064db92640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0648102cf0 0x7f0648198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f064d391640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0648103610 0x7f0648198870 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0638005940 tx=0x7f06380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.797+0000 7f063effd640 1 -- 172.21.15.2:0/3251976974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063803f030 con 0x7f0648103610 2024-09-15T23:24:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.798+0000 7f063effd640 1 -- 172.21.15.2:0/3251976974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0638003cb0 con 0x7f0648103610 2024-09-15T23:24:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.798+0000 7f064fdf6640 1 -- 172.21.15.2:0/3251976974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064819d5b0 con 0x7f0648103610 2024-09-15T23:24:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.798+0000 7f063effd640 1 -- 172.21.15.2:0/3251976974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638035070 con 0x7f0648103610 2024-09-15T23:24:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.798+0000 7f064fdf6640 1 -- 172.21.15.2:0/3251976974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06481a4ea0 con 0x7f0648103610 2024-09-15T23:24:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.798+0000 7f064fdf6640 1 -- 172.21.15.2:0/3251976974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0648069bc0 con 0x7f0648103610 2024-09-15T23:24:27.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.800+0000 7f063effd640 1 -- 172.21.15.2:0/3251976974 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7f0638042030 con 0x7f0648103610 2024-09-15T23:24:27.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.801+0000 7f063effd640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f06340a33c0 0x7f06340a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:27.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.801+0000 7f064db92640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f06340a33c0 0x7f06340a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:27.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.801+0000 7f063effd640 1 -- 172.21.15.2:0/3251976974 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8600+0+0 (secure 0 0 0) 0x7f06380f0840 con 0x7f0648103610 2024-09-15T23:24:27.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.801+0000 7f064db92640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f06340a33c0 0x7f06340a5880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f06440058c0 tx=0x7f0644005850 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:27.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.804+0000 7f063effd640 1 -- 172.21.15.2:0/3251976974 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06380bd1d0 con 0x7f0648103610 2024-09-15T23:24:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.982+0000 7f064fdf6640 1 -- 172.21.15.2:0/3251976974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0648107140 con 0x7f0648103610 2024-09-15T23:24:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.982+0000 7f063effd640 1 -- 172.21.15.2:0/3251976974 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) ==== 104+0+11 (secure 0 0 0) 0x7f06380bcad0 con 0x7f0648103610 2024-09-15T23:24:27.984 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-09-15T23:24:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.984+0000 7f064fdf6640 1 -- 172.21.15.2:0/3251976974 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f06340a33c0 msgr2=0x7f06340a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.984+0000 7f064fdf6640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f06340a33c0 0x7f06340a5880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f06440058c0 tx=0x7f0644005850 comp rx=0 tx=0).stop 2024-09-15T23:24:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.984+0000 7f064fdf6640 1 -- 172.21.15.2:0/3251976974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0648103610 msgr2=0x7f0648198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.984+0000 7f064fdf6640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0648103610 0x7f0648198870 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0638005940 tx=0x7f06380042f0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.984+0000 7f064fdf6640 1 -- 172.21.15.2:0/3251976974 shutdown_connections 2024-09-15T23:24:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.984+0000 7f064fdf6640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f06340a33c0 0x7f06340a5880 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.984+0000 7f064fdf6640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f064810c0c0 0x7f064819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.984+0000 7f064fdf6640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0648103610 0x7f0648198870 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.984+0000 7f064fdf6640 1 --2- 172.21.15.2:0/3251976974 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0648102cf0 0x7f0648198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.984+0000 7f064fdf6640 1 -- 172.21.15.2:0/3251976974 >> 172.21.15.2:0/3251976974 conn(0x7f06480779d0 msgr2=0x7f06480fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.984+0000 7f064fdf6640 1 -- 172.21.15.2:0/3251976974 shutdown_connections 2024-09-15T23:24:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:27.984+0000 7f064fdf6640 1 -- 172.21.15.2:0/3251976974 wait complete. 2024-09-15T23:24:27.996 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T23:24:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.101+0000 7febfd1fd640 1 -- 172.21.15.2:0/1240515398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8101a80 msgr2=0x7febf8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.101+0000 7febfd1fd640 1 --2- 172.21.15.2:0/1240515398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8101a80 0x7febf8101ee0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7febec009930 tx=0x7febec02a420 comp rx=0 tx=0).stop 2024-09-15T23:24:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.101+0000 7febfd1fd640 1 -- 172.21.15.2:0/1240515398 shutdown_connections 2024-09-15T23:24:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.101+0000 7febfd1fd640 1 --2- 172.21.15.2:0/1240515398 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febf8102420 0x7febf810e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.101+0000 7febfd1fd640 1 --2- 172.21.15.2:0/1240515398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8101a80 0x7febf8101ee0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.101+0000 7febfd1fd640 1 --2- 172.21.15.2:0/1240515398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febf8107a90 0x7febf8107e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.101+0000 7febfd1fd640 1 -- 172.21.15.2:0/1240515398 >> 172.21.15.2:0/1240515398 conn(0x7febf80fd7c0 msgr2=0x7febf80ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.101+0000 7febfd1fd640 1 -- 172.21.15.2:0/1240515398 shutdown_connections 2024-09-15T23:24:28.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.101+0000 7febfd1fd640 1 -- 172.21.15.2:0/1240515398 wait complete. 2024-09-15T23:24:28.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.102+0000 7febfd1fd640 1 Processor -- start 2024-09-15T23:24:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.102+0000 7febfd1fd640 1 -- start start 2024-09-15T23:24:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.102+0000 7febfd1fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8101a80 0x7febf80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.102+0000 7febfd1fd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febf8102420 0x7febf8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.102+0000 7febfd1fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febf8107a90 0x7febf8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febfd1fd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febf8111d80 con 0x7febf8101a80 2024-09-15T23:24:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febfd1fd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7febf8111c00 con 0x7febf8107a90 2024-09-15T23:24:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febfd1fd640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7febf8111f00 con 0x7febf8102420 2024-09-15T23:24:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febf6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8101a80 0x7febf80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febf6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8101a80 0x7febf80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46836/0 (socket says 172.21.15.2:46836) 2024-09-15T23:24:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febf6d9d640 1 -- 172.21.15.2:0/1416501789 learned_addr learned my addr 172.21.15.2:0/1416501789 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:24:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febf659c640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febf8102420 0x7febf8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febf759e640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febf8107a90 0x7febf8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:28.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febf6d9d640 1 -- 172.21.15.2:0/1416501789 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febf8102420 msgr2=0x7febf8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febf6d9d640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febf8102420 0x7febf8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febf6d9d640 1 -- 172.21.15.2:0/1416501789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febf8107a90 msgr2=0x7febf8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febf6d9d640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febf8107a90 0x7febf8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febf6d9d640 1 -- 172.21.15.2:0/1416501789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf81a6870 con 0x7febf8101a80 2024-09-15T23:24:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febf6d9d640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8101a80 0x7febf80744f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7febe800d950 tx=0x7febe800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febdffff640 1 -- 172.21.15.2:0/1416501789 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8017030 con 0x7febf8101a80 2024-09-15T23:24:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febdffff640 1 -- 172.21.15.2:0/1416501789 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7febe8004020 con 0x7febf8101a80 2024-09-15T23:24:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febfd1fd640 1 -- 172.21.15.2:0/1416501789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf81a6b60 con 0x7febf8101a80 2024-09-15T23:24:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febdffff640 1 -- 172.21.15.2:0/1416501789 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe80047a0 con 0x7febf8101a80 2024-09-15T23:24:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.103+0000 7febfd1fd640 1 -- 172.21.15.2:0/1416501789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf81a7080 con 0x7febf8101a80 2024-09-15T23:24:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.104+0000 7febfd1fd640 1 -- 172.21.15.2:0/1416501789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf8101ee0 con 0x7febf8101a80 2024-09-15T23:24:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.105+0000 7febdffff640 1 -- 172.21.15.2:0/1416501789 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7febe80041d0 con 0x7febf8101a80 2024-09-15T23:24:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.106+0000 7febdffff640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7febe00a33c0 0x7febe00a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.106+0000 7febf659c640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7febe00a33c0 0x7febe00a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.106+0000 7febdffff640 1 -- 172.21.15.2:0/1416501789 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8600+0+0 (secure 0 0 0) 0x7febe80cf6e0 con 0x7febf8101a80 2024-09-15T23:24:28.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.107+0000 7febf659c640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7febe00a33c0 0x7febe00a5880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7febec009900 tx=0x7febec000bc0 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:28.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.110+0000 7febdffff640 1 -- 172.21.15.2:0/1416501789 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7febe809c070 con 0x7febf8101a80 2024-09-15T23:24:28.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.286+0000 7febfd1fd640 1 -- 172.21.15.2:0/1416501789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7febf8109ff0 con 0x7febf8101a80 2024-09-15T23:24:28.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.287+0000 7febdffff640 1 -- 172.21.15.2:0/1416501789 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) ==== 100+0+11 (secure 0 0 0) 0x7febe80860f0 con 0x7febf8101a80 2024-09-15T23:24:28.288 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-09-15T23:24:28.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.289+0000 7febfd1fd640 1 -- 172.21.15.2:0/1416501789 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7febe00a33c0 msgr2=0x7febe00a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:28.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.289+0000 7febfd1fd640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7febe00a33c0 0x7febe00a5880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7febec009900 tx=0x7febec000bc0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.289+0000 7febfd1fd640 1 -- 172.21.15.2:0/1416501789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8101a80 msgr2=0x7febf80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:28.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.289+0000 7febfd1fd640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8101a80 0x7febf80744f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7febe800d950 tx=0x7febe800de10 comp rx=0 tx=0).stop 2024-09-15T23:24:28.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.289+0000 7febfd1fd640 1 -- 172.21.15.2:0/1416501789 shutdown_connections 2024-09-15T23:24:28.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.289+0000 7febfd1fd640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7febe00a33c0 0x7febe00a5880 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.289+0000 7febfd1fd640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7febf8107a90 0x7febf8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.289+0000 7febfd1fd640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febf8102420 0x7febf8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.289+0000 7febfd1fd640 1 --2- 172.21.15.2:0/1416501789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febf8101a80 0x7febf80744f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.289+0000 7febfd1fd640 1 -- 172.21.15.2:0/1416501789 >> 172.21.15.2:0/1416501789 conn(0x7febf80fd7c0 msgr2=0x7febf80fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:28.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.289+0000 7febfd1fd640 1 -- 172.21.15.2:0/1416501789 shutdown_connections 2024-09-15T23:24:28.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.289+0000 7febfd1fd640 1 -- 172.21.15.2:0/1416501789 wait complete. 2024-09-15T23:24:28.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:28 smithi002 ceph-mon[31019]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:28.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:28 smithi002 ceph-mon[31019]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:28.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:28 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3258460213' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:24:28.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:28 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/2357719006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:24:28.301 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:28 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3251976974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T23:24:28.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-15T23:24:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.404+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/2799561853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b04103610 msgr2=0x7f1b0410baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.404+0000 7f1b0c0b7640 1 --2- 172.21.15.2:0/2799561853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b04103610 0x7f1b0410baf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009900 tx=0x7f1af402a480 comp rx=0 tx=0).stop 2024-09-15T23:24:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.404+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/2799561853 shutdown_connections 2024-09-15T23:24:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.404+0000 7f1b0c0b7640 1 --2- 172.21.15.2:0/2799561853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b0410c0c0 0x7f1b0410e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.404+0000 7f1b0c0b7640 1 --2- 172.21.15.2:0/2799561853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b04103610 0x7f1b0410baf0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.404+0000 7f1b0c0b7640 1 --2- 172.21.15.2:0/2799561853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b04102cf0 0x7f1b041030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.404+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/2799561853 >> 172.21.15.2:0/2799561853 conn(0x7f1b04077a10 msgr2=0x7f1b040fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.404+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/2799561853 shutdown_connections 2024-09-15T23:24:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.404+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/2799561853 wait complete. 2024-09-15T23:24:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.404+0000 7f1b0c0b7640 1 Processor -- start 2024-09-15T23:24:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.404+0000 7f1b0c0b7640 1 -- start start 2024-09-15T23:24:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b0c0b7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b04102cf0 0x7f1b04100940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b0c0b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b04103610 0x7f1b04100e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b0c0b7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b0410c0c0 0x7f1b041013c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b0c0b7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b04111d40 con 0x7f1b04103610 2024-09-15T23:24:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b0c0b7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1b04111bc0 con 0x7f1b04102cf0 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b0c0b7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1b04111ec0 con 0x7f1b0410c0c0 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b09652640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b04103610 0x7f1b04100e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b09652640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b04103610 0x7f1b04100e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46852/0 (socket says 172.21.15.2:46852) 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b09652640 1 -- 172.21.15.2:0/3975645271 learned_addr learned my addr 172.21.15.2:0/3975645271 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b09e53640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b04102cf0 0x7f1b04100940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b0a654640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b0410c0c0 0x7f1b041013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b09652640 1 -- 172.21.15.2:0/3975645271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b0410c0c0 msgr2=0x7f1b041013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b09652640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b0410c0c0 0x7f1b041013c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b09652640 1 -- 172.21.15.2:0/3975645271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b04102cf0 msgr2=0x7f1b04100940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b09652640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b04102cf0 0x7f1b04100940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b09652640 1 -- 172.21.15.2:0/3975645271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b041a6830 con 0x7f1b04103610 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b09652640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b04103610 0x7f1b04100e80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1af4005940 tx=0x7f1af40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1afaffd640 1 -- 172.21.15.2:0/3975645271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af403f030 con 0x7f1b04103610 2024-09-15T23:24:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1afaffd640 1 -- 172.21.15.2:0/3975645271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1af4003cb0 con 0x7f1b04103610 2024-09-15T23:24:28.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/3975645271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b041a6ac0 con 0x7f1b04103610 2024-09-15T23:24:28.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1afaffd640 1 -- 172.21.15.2:0/3975645271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4035070 con 0x7f1b04103610 2024-09-15T23:24:28.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.405+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/3975645271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b041a7000 con 0x7f1b04103610 2024-09-15T23:24:28.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.406+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/3975645271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b041030d0 con 0x7f1b04103610 2024-09-15T23:24:28.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.408+0000 7f1afaffd640 1 -- 172.21.15.2:0/3975645271 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7f1af4042030 con 0x7f1b04103610 2024-09-15T23:24:28.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.408+0000 7f1afaffd640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f1af00a3440 0x7f1af00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:28.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.408+0000 7f1afaffd640 1 -- 172.21.15.2:0/3975645271 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8600+0+0 (secure 0 0 0) 0x7f1af40f0740 con 0x7f1b04103610 2024-09-15T23:24:28.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.408+0000 7f1b09e53640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f1af00a3440 0x7f1af00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:28.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.409+0000 7f1b09e53640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f1af00a3440 0x7f1af00a5900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000bbe0 tx=0x7f1b0000b390 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.411+0000 7f1afaffd640 1 -- 172.21.15.2:0/3975645271 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1af40bd0d0 con 0x7f1b04103610 2024-09-15T23:24:28.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:28 smithi145 ceph-mon[34901]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:28.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:28 smithi145 ceph-mon[34901]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:28.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:28 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3258460213' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:24:28.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:28 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/2357719006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:24:28.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:28 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3251976974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T23:24:28.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:28 smithi112 ceph-mon[34367]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:28.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:28 smithi112 ceph-mon[34367]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:28.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:28 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3258460213' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:24:28.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:28 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/2357719006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:24:28.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:28 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3251976974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T23:24:28.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.639+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/3975645271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f1b04101e70 con 0x7f1b04103610 2024-09-15T23:24:28.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.647+0000 7f1afaffd640 1 -- 172.21.15.2:0/3975645271 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+742861 (secure 0 0 0) 0x7f1b04101e70 con 0x7f1b04103610 2024-09-15T23:24:28.660 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:24:28.660 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-15T23:24:28.660 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 26, 2024-09-15T23:24:28.660 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.660 INFO:teuthology.orchestra.run.smithi002.stdout: "active_gid": 15054, 2024-09-15T23:24:28.660 INFO:teuthology.orchestra.run.smithi002.stdout: "active_name": "x", 2024-09-15T23:24:28.660 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addrs": { 2024-09-15T23:24:28.660 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-15T23:24:28.660 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.660 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-15T23:24:28.660 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2024-09-15T23:24:28.661 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1306494062 2024-09-15T23:24:28.661 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.661 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.661 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-15T23:24:28.661 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2024-09-15T23:24:28.661 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1306494062 2024-09-15T23:24:28.661 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.661 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-15T23:24:28.661 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.661 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addr": "172.21.15.2:6801/1306494062", 2024-09-15T23:24:28.661 INFO:teuthology.orchestra.run.smithi002.stdout: "active_change": "2024-09-15T23:14:23.506622+0000", 2024-09-15T23:24:28.662 INFO:teuthology.orchestra.run.smithi002.stdout: "active_mgr_features": 4540701547738038271, 2024-09-15T23:24:28.662 INFO:teuthology.orchestra.run.smithi002.stdout: "available": true, 2024-09-15T23:24:28.662 INFO:teuthology.orchestra.run.smithi002.stdout: "standbys": [ 2024-09-15T23:24:28.662 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.662 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 24709, 2024-09-15T23:24:28.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "z", 2024-09-15T23:24:28.662 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-09-15T23:24:28.662 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-15T23:24:28.662 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-15T23:24:28.662 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.662 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.663 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.663 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:28.663 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:28.663 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.663 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.663 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.663 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:28.663 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.663 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T23:24:28.663 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.663 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.664 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.664 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.664 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.664 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.664 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.664 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.664 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.664 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.664 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.665 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.665 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.665 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.665 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.665 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.665 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.665 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.665 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.665 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.665 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.665 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.666 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.666 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.666 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.666 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.666 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.666 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.666 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.666 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.666 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.667 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.667 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.667 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.667 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.667 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.667 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.667 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.667 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.667 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.667 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.667 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.667 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.668 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.668 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.668 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.668 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.668 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.668 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.668 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.668 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.668 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.668 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.668 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.668 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.668 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.669 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.669 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.669 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.669 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.669 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.669 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.669 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.669 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.669 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.669 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.669 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.669 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.670 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.670 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-15T23:24:28.670 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-15T23:24:28.670 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.670 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.670 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.670 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.670 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.670 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.670 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.670 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-09-15T23:24:28.670 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.670 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.671 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.672 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.672 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-15T23:24:28.672 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-15T23:24:28.672 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.672 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.672 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.672 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.672 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.672 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.672 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.672 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.673 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-15T23:24:28.674 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.674 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.674 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.674 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-15T23:24:28.674 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-15T23:24:28.674 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.674 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.674 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.674 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-15T23:24:28.674 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.675 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.675 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.675 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-15T23:24:28.675 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.675 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.675 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.675 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-15T23:24:28.675 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-15T23:24:28.675 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.675 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.675 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.676 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.676 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.676 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.676 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.676 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-15T23:24:28.676 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.676 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.676 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.676 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-15T23:24:28.676 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-15T23:24:28.677 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.677 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.677 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.677 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.677 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.677 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.677 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.677 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T23:24:28.677 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.677 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.677 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.678 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-15T23:24:28.678 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-15T23:24:28.678 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.678 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.678 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.678 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.678 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.678 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.678 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.678 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-15T23:24:28.678 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.678 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.678 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.679 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.679 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.679 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.679 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.679 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-15T23:24:28.679 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.679 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.679 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.679 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-15T23:24:28.679 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-15T23:24:28.679 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.679 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.679 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.680 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.680 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.680 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.680 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.680 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T23:24:28.680 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.680 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.680 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.680 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.680 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-15T23:24:28.680 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-15T23:24:28.680 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.680 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.681 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.681 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-15T23:24:28.681 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.681 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.681 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.681 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T23:24:28.681 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:24:28.681 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.681 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.681 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.681 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-15T23:24:28.681 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-15T23:24:28.681 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:28.682 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.682 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.682 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:28.682 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-15T23:24:28.682 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-15T23:24:28.682 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.682 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T23:24:28.682 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:24:28.682 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.682 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.682 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.682 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-15T23:24:28.682 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-15T23:24:28.683 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:28.683 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.683 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.683 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-15T23:24:28.683 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-15T23:24:28.683 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-15T23:24:28.683 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.683 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T23:24:28.683 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.683 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.683 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.683 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-15T23:24:28.684 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-15T23:24:28.684 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.684 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.684 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.684 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T23:24:28.684 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.684 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.684 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.684 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T23:24:28.684 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T23:24:28.684 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.684 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.685 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.685 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-15T23:24:28.685 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-15T23:24:28.685 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:28.685 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.685 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.685 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-15T23:24:28.685 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-15T23:24:28.685 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-15T23:24:28.685 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.685 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-15T23:24:28.685 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T23:24:28.686 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.686 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.686 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.686 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-15T23:24:28.686 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-15T23:24:28.686 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.686 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.686 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.686 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-15T23:24:28.686 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.686 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.686 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.686 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T23:24:28.687 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:24:28.687 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.687 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.687 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.687 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-15T23:24:28.687 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-15T23:24:28.687 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:28.687 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.687 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.687 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:28.687 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-15T23:24:28.687 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-15T23:24:28.687 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.688 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T23:24:28.688 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:24:28.688 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.688 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.688 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.688 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.688 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.688 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.688 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.688 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.688 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.688 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.688 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.689 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.689 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.689 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.689 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.689 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.689 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.689 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.689 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.689 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.690 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.690 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.690 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.690 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.690 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.691 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.691 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.691 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.691 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.691 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.691 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.691 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.691 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.691 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.691 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.691 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.691 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.692 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.692 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.692 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.692 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.692 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.692 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.692 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.692 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.692 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.692 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.692 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.693 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.693 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.693 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.693 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.693 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.693 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.693 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.693 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.693 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.693 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.693 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.693 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.693 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.694 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.694 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.694 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.694 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.694 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.694 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.694 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.694 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.694 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.694 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.694 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.694 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.695 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-15T23:24:28.695 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-15T23:24:28.695 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:28.695 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.695 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.695 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:28.695 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.695 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.695 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.695 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T23:24:28.695 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.695 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.695 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.696 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.696 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-15T23:24:28.696 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-15T23:24:28.696 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.696 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.696 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.696 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-15T23:24:28.696 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.696 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.696 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.696 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-15T23:24:28.696 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-15T23:24:28.697 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-15T23:24:28.697 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-15T23:24:28.697 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-15T23:24:28.697 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.697 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-15T23:24:28.697 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.697 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.697 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.697 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.697 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-15T23:24:28.697 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-15T23:24:28.697 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.697 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.698 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.699 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.699 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:28.699 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.699 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.699 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.699 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T23:24:28.699 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.699 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.699 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.699 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.699 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-15T23:24:28.699 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-15T23:24:28.700 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.700 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.700 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.700 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:28.700 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-15T23:24:28.700 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.700 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.700 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T23:24:28.700 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T23:24:28.700 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.700 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.700 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.701 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-15T23:24:28.701 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-15T23:24:28.701 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:28.701 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.701 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.701 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:28.701 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.701 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.701 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.701 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T23:24:28.701 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.701 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.701 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.702 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.702 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.702 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.702 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-15T23:24:28.702 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.702 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.702 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.702 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-15T23:24:28.702 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-15T23:24:28.702 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:28.702 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.702 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.703 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-15T23:24:28.703 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.703 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.703 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.703 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T23:24:28.703 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.703 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.703 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.703 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-15T23:24:28.703 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-15T23:24:28.703 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.704 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.704 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.704 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-15T23:24:28.704 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.704 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.704 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.704 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T23:24:28.704 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.704 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.704 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.704 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-15T23:24:28.705 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-15T23:24:28.705 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.705 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.705 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.705 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-15T23:24:28.705 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.705 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.705 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.705 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T23:24:28.705 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.705 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.706 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.706 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.706 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-15T23:24:28.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-15T23:24:28.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.706 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.706 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.706 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.706 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.706 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.706 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.706 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T23:24:28.707 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T23:24:28.707 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.707 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.707 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.707 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-15T23:24:28.707 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-15T23:24:28.707 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.707 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.707 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.707 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:28.707 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.708 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.708 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.708 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T23:24:28.708 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.708 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.708 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.708 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.708 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-15T23:24:28.708 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T23:24:28.708 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:28.708 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.709 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.709 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-15T23:24:28.709 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.709 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.709 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.709 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T23:24:28.709 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.709 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.709 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.709 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.709 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-15T23:24:28.709 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-15T23:24:28.710 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.710 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.710 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.710 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.710 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.710 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.710 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.710 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-15T23:24:28.710 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-15T23:24:28.710 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-15T23:24:28.710 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.710 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T23:24:28.711 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.711 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.711 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.711 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.711 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-15T23:24:28.711 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-15T23:24:28.711 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.711 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.711 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.711 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.711 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.711 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.712 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.712 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T23:24:28.712 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.712 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.712 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.712 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-15T23:24:28.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-15T23:24:28.712 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.712 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.712 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.712 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.712 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.713 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.713 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.713 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T23:24:28.713 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.713 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.713 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.713 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.713 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-15T23:24:28.713 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-15T23:24:28.713 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.713 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.713 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.713 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.714 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.714 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.714 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.714 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T23:24:28.714 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.714 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.714 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.714 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.714 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-15T23:24:28.714 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-15T23:24:28.714 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.714 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.715 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.715 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T23:24:28.715 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.715 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.715 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.715 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-15T23:24:28.715 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.715 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.715 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.715 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.715 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-15T23:24:28.715 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-15T23:24:28.716 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.716 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.716 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.716 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T23:24:28.716 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.716 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.716 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.716 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-15T23:24:28.716 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.716 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.716 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.716 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-15T23:24:28.717 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-15T23:24:28.717 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.717 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.717 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.717 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T23:24:28.717 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.717 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.717 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.717 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-15T23:24:28.717 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.717 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.717 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.718 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.719 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-15T23:24:28.719 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-15T23:24:28.719 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.719 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.719 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.719 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T23:24:28.719 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.719 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.719 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.720 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-15T23:24:28.720 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.720 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.720 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.720 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.720 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-15T23:24:28.720 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-15T23:24:28.720 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.720 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.720 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.720 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T23:24:28.720 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.720 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.721 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.722 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.722 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-15T23:24:28.722 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.722 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.722 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.722 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.722 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-15T23:24:28.722 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-15T23:24:28.722 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.722 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.722 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.722 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T23:24:28.722 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.723 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.723 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.723 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-15T23:24:28.723 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.723 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.723 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.723 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.723 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-15T23:24:28.723 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-15T23:24:28.723 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.723 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.723 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.723 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T23:24:28.724 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.724 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.724 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.724 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-15T23:24:28.724 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.724 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.724 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.724 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.724 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-15T23:24:28.724 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-15T23:24:28.724 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.724 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.725 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.725 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T23:24:28.725 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.725 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.725 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.725 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-15T23:24:28.725 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.725 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.725 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.725 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.725 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-15T23:24:28.725 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-15T23:24:28.726 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.726 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.726 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.726 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T23:24:28.726 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.726 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.726 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.726 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-15T23:24:28.726 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.726 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.727 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.727 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.727 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-15T23:24:28.727 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-15T23:24:28.727 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.727 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.727 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.727 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T23:24:28.727 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.727 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.727 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.728 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-15T23:24:28.728 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.728 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.728 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.728 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-15T23:24:28.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-15T23:24:28.728 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.728 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.728 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.728 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T23:24:28.728 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-15T23:24:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-15T23:24:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-15T23:24:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.729 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T23:24:28.730 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.730 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.730 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.730 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-15T23:24:28.730 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.730 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.730 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.730 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-15T23:24:28.730 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-15T23:24:28.730 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.730 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.730 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.731 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T23:24:28.731 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.731 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.731 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.731 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-15T23:24:28.731 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.731 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.731 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.731 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.731 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-15T23:24:28.731 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-15T23:24:28.731 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.732 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.732 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.732 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T23:24:28.732 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.732 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.732 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.732 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-15T23:24:28.732 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.732 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.732 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.732 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-15T23:24:28.734 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-15T23:24:28.734 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.734 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.734 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.734 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.734 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.735 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.735 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.735 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T23:24:28.735 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.735 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.735 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.735 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-15T23:24:28.735 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-15T23:24:28.735 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.735 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.735 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.736 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:28.736 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.736 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.736 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.736 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T23:24:28.736 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.736 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.736 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.736 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.736 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-15T23:24:28.736 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T23:24:28.737 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.737 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.737 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.737 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-15T23:24:28.737 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.737 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.737 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.737 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T23:24:28.737 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.737 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.737 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.739 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.739 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-15T23:24:28.739 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-15T23:24:28.739 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.739 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.739 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.739 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-15T23:24:28.739 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.739 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.739 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.739 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-15T23:24:28.739 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.739 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.740 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.740 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-15T23:24:28.740 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-15T23:24:28.740 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.740 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.740 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.740 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.740 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.740 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.740 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.740 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T23:24:28.740 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-15T23:24:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-15T23:24:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.741 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-15T23:24:28.742 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.742 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.742 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.742 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-15T23:24:28.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-15T23:24:28.742 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.742 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.742 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.742 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T23:24:28.742 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.742 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.742 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.744 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-15T23:24:28.744 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.744 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.744 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.744 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-15T23:24:28.744 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-15T23:24:28.744 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.744 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.744 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.744 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.744 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.745 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.745 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.745 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T23:24:28.745 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.745 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.745 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.745 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.745 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-15T23:24:28.745 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-15T23:24:28.745 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.745 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.745 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.745 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.746 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.746 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.746 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.746 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T23:24:28.746 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.746 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.746 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.746 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.746 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.746 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.746 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.747 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.748 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.748 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.748 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.748 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-15T23:24:28.748 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-15T23:24:28.748 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.748 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.748 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.748 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.748 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.749 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.749 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.749 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T23:24:28.749 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.749 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.749 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.749 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.749 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.749 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.749 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.749 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.749 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T23:24:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.751 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.751 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.751 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.751 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.751 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.751 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.751 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.751 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.751 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.751 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.751 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.751 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.752 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.752 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.752 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.752 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.752 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.752 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.752 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.752 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.752 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.752 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.752 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.753 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.753 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.753 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.753 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.753 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.753 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.753 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T23:24:28.753 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T23:24:28.753 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.753 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.753 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.753 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.754 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.754 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.754 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.754 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T23:24:28.754 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.754 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.754 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.754 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T23:24:28.754 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T23:24:28.754 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.754 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-15T23:24:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T23:24:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-15T23:24:28.755 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-15T23:24:28.756 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.756 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.756 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.756 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:28.756 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.756 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.756 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.756 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-15T23:24:28.756 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.756 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.756 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.757 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-15T23:24:28.757 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-15T23:24:28.757 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.757 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.757 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.757 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:28.757 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.757 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.757 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T23:24:28.757 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.757 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.757 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.758 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.758 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-15T23:24:28.758 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-15T23:24:28.758 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.758 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.758 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.758 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.758 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.758 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.758 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.759 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-15T23:24:28.759 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.759 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.759 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.759 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-15T23:24:28.759 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-15T23:24:28.759 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.759 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.759 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.759 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-15T23:24:28.759 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.760 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.760 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.760 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-15T23:24:28.760 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-15T23:24:28.760 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.760 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T23:24:28.760 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.760 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.760 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.760 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.760 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-15T23:24:28.760 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-15T23:24:28.761 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.761 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.761 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.761 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-15T23:24:28.761 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.761 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.761 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.761 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T23:24:28.761 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.761 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.761 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.762 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.763 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-15T23:24:28.763 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-15T23:24:28.763 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.763 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.763 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.763 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.763 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.763 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.763 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.763 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T23:24:28.763 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.763 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.764 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.764 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.764 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-15T23:24:28.764 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-15T23:24:28.764 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.764 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.764 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.764 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.764 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.764 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.764 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.764 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T23:24:28.765 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.765 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.765 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.765 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.765 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-15T23:24:28.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-15T23:24:28.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.765 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.765 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.765 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.766 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T23:24:28.766 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.766 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.766 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.766 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-15T23:24:28.766 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-15T23:24:28.766 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.766 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.766 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.766 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.766 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.767 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.767 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T23:24:28.767 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.767 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.767 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.767 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.767 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-15T23:24:28.767 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-15T23:24:28.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.767 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.768 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.768 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.768 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.768 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T23:24:28.768 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.768 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.768 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.768 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.768 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-15T23:24:28.768 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-15T23:24:28.768 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.768 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.769 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.770 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.770 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.770 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.770 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.770 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.770 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T23:24:28.770 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.770 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.770 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.770 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.770 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-15T23:24:28.770 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-15T23:24:28.771 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.771 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.771 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.771 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.771 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.771 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.771 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.771 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T23:24:28.771 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.771 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.771 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.771 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.772 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-15T23:24:28.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-15T23:24:28.772 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.772 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.772 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.772 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.772 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.772 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.772 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.772 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T23:24:28.772 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.772 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.772 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.773 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.773 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-15T23:24:28.773 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-15T23:24:28.773 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.773 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.773 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.773 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.773 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.773 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.773 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.773 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T23:24:28.774 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.774 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.774 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.774 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.774 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-15T23:24:28.774 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-15T23:24:28.774 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.775 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.775 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.776 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.776 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.776 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.776 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.776 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T23:24:28.776 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.776 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.776 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.776 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-15T23:24:28.776 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-15T23:24:28.776 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.777 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.777 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.777 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.777 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.777 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.777 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.777 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T23:24:28.777 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.777 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.777 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.777 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.777 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.778 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.778 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.778 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-15T23:24:28.778 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.778 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.778 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.778 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.778 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.778 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.778 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.778 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.779 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.780 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.780 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.780 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.780 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.780 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.780 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.780 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.780 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.780 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.780 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.780 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.780 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.780 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.781 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.781 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.781 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.781 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.781 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.781 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.781 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.781 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.781 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.781 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.781 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.782 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.782 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.782 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.782 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.782 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.782 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.782 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.782 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.782 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.782 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.782 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.782 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.782 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.783 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.783 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.783 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.783 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.783 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.783 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.783 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.783 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.783 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.783 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.783 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.783 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.783 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.784 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-15T23:24:28.784 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-15T23:24:28.784 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.784 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.784 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.784 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-15T23:24:28.784 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.784 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.785 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.785 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T23:24:28.785 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.785 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.785 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.785 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.785 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-15T23:24:28.785 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-15T23:24:28.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.785 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.785 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-15T23:24:28.786 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.786 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.786 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.786 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T23:24:28.786 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.786 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.786 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.786 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.786 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.786 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-15T23:24:28.786 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.787 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.787 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.787 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T23:24:28.787 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T23:24:28.787 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.787 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.787 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.787 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:28.787 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.787 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.787 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.787 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.787 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.788 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.789 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.790 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.791 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.792 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.792 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.792 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.792 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T23:24:28.792 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T23:24:28.792 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.792 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.792 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.792 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.792 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.792 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.792 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.792 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.793 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.793 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.793 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.793 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.793 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T23:24:28.793 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T23:24:28.793 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.793 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.793 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.793 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.793 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.793 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.793 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.794 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.795 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.795 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.795 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.795 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.795 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.795 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T23:24:28.795 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T23:24:28.795 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.795 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.795 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.795 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.795 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.795 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.796 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.796 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.796 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.796 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.796 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.796 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.796 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T23:24:28.796 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T23:24:28.796 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.796 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.796 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.796 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T23:24:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T23:24:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T23:24:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T23:24:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.802 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.802 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-15T23:24:28.802 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.802 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.802 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.802 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.802 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.802 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.802 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.802 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.802 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T23:24:28.802 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T23:24:28.802 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-15T23:24:28.803 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T23:24:28.804 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T23:24:28.805 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T23:24:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T23:24:28.807 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.807 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.807 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.807 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.807 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.807 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.807 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.807 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.807 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.807 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.807 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.807 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T23:24:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T23:24:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.810 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.813 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.814 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T23:24:28.814 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T23:24:28.814 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.814 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.814 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.814 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.814 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.814 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.814 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.814 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.814 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.814 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.814 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.816 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.816 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T23:24:28.816 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T23:24:28.816 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.816 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.816 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.816 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.816 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.816 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.816 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.816 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.816 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.816 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.817 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.818 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.819 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.820 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.820 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T23:24:28.820 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T23:24:28.820 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.820 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.820 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.820 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T23:24:28.820 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.820 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.820 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.820 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.820 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.821 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.821 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.821 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T23:24:28.821 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T23:24:28.821 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.821 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.821 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.821 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:28.821 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.821 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.821 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.821 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.822 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.823 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.824 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.825 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.826 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.827 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.827 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.827 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.827 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.827 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T23:24:28.827 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T23:24:28.827 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.827 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.827 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.827 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.827 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.827 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.827 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.828 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.828 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.828 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.828 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.828 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T23:24:28.828 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T23:24:28.828 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.828 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.828 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.828 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:28.828 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.829 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.829 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.829 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.829 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.829 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.829 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.829 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.829 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T23:24:28.829 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T23:24:28.829 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.829 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.829 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.829 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.830 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.831 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.832 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.832 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.832 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.832 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.832 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.832 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.832 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.832 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.832 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-15T23:24:28.832 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-15T23:24:28.832 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.832 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.832 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.833 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.833 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.833 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.833 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.833 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.833 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.833 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.834 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.834 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.834 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-15T23:24:28.834 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-15T23:24:28.834 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.834 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.834 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.834 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.834 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.834 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.834 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.835 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-15T23:24:28.835 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.835 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.835 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.835 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.835 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-15T23:24:28.835 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-15T23:24:28.835 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.835 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.835 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.835 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-15T23:24:28.835 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.835 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.836 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.836 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.836 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.836 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.836 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.836 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-15T23:24:28.836 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-15T23:24:28.836 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.836 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.836 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.836 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.836 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.837 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.837 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.837 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.837 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.837 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.837 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.837 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.837 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.837 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.837 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.837 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.838 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.839 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.840 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.840 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.840 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.840 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.840 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.840 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.840 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.840 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.840 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.840 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.840 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.840 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.840 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.841 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.842 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.842 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.842 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.842 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.842 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.842 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.842 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.842 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.842 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.842 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.842 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-15T23:24:28.842 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-15T23:24:28.843 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.843 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.843 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.843 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.843 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.843 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.843 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.843 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-15T23:24:28.843 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.843 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.843 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.843 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.844 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-15T23:24:28.845 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-15T23:24:28.845 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.845 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.845 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.845 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-15T23:24:28.845 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.845 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.845 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.845 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.845 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.845 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.846 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.847 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.848 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.848 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-15T23:24:28.848 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-15T23:24:28.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.848 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.848 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.848 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-15T23:24:28.848 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.848 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.848 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.848 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.848 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.849 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.849 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.849 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-15T23:24:28.849 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-15T23:24:28.849 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.849 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.849 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.849 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-15T23:24:28.849 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.849 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.849 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.849 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-15T23:24:28.850 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.851 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.852 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.852 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.852 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.852 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.852 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.852 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.852 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.852 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.852 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.852 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.852 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-15T23:24:28.852 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.852 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.853 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.854 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.855 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.855 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.855 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.855 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.855 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.855 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.855 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.855 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.855 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.855 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.855 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.856 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.856 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.856 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.856 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.856 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.856 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.856 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.856 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.856 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.856 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.856 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.856 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.857 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.857 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.857 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.857 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.857 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.857 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.857 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.857 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.857 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.857 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.857 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.857 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.857 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.858 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-15T23:24:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-15T23:24:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-15T23:24:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.859 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.860 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.861 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.862 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.862 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-15T23:24:28.862 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.862 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.862 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.862 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.862 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-15T23:24:28.862 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-15T23:24:28.862 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.862 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.862 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.862 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-15T23:24:28.862 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.863 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.863 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.863 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T23:24:28.863 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.863 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.863 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.863 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.863 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-15T23:24:28.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-15T23:24:28.863 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.863 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.863 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.863 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.864 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.864 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.864 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.864 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T23:24:28.864 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.864 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.864 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.864 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:28.864 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:28.864 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.864 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.864 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.865 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:28.865 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.865 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.865 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.865 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T23:24:28.865 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.865 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.865 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.865 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.865 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-15T23:24:28.865 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-15T23:24:28.865 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.865 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.866 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-15T23:24:28.867 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.867 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.867 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.867 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.867 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.867 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.867 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.867 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.867 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.867 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.867 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.867 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.867 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.868 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.868 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.868 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.868 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.868 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.868 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.868 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.868 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.868 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.868 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.868 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.868 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.868 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.869 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.870 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.870 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.870 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.870 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.870 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.870 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.870 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.870 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.870 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.870 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.870 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.870 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.870 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.871 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-15T23:24:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-15T23:24:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-15T23:24:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-15T23:24:28.873 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:28.874 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.875 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.875 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.875 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.875 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.875 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.875 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.875 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.875 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.875 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.875 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.875 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-15T23:24:28.875 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-15T23:24:28.875 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-15T23:24:28.876 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.876 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-15T23:24:28.876 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-15T23:24:28.876 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.876 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.876 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.876 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-15T23:24:28.876 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.876 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.876 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.876 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T23:24:28.876 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.876 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.877 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.877 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.877 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-15T23:24:28.877 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-15T23:24:28.877 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.877 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.877 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.877 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-15T23:24:28.877 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.877 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.877 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.877 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.878 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-15T23:24:28.879 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.879 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.879 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.879 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:28.879 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:28.879 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.879 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.879 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.879 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-15T23:24:28.879 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-15T23:24:28.879 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.879 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.880 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.881 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.881 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.881 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.881 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.881 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.881 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.881 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.881 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.881 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.881 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.881 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.881 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.881 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.882 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.883 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.883 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.883 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.883 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.883 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.883 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.883 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.883 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.883 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.883 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.883 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.883 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.884 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.885 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.885 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.885 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.885 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.885 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.885 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.885 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.885 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.885 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.885 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-15T23:24:28.885 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-15T23:24:28.885 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.885 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.886 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.887 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.887 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-15T23:24:28.887 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.887 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.887 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-15T23:24:28.887 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.887 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.887 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.887 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.887 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-15T23:24:28.887 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-15T23:24:28.887 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-15T23:24:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:24:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-15T23:24:28.888 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-15T23:24:28.889 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.889 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.889 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.889 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:28.889 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-15T23:24:28.889 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-15T23:24:28.889 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.889 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T23:24:28.889 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.889 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.889 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.889 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.889 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.890 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-15T23:24:28.891 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-15T23:24:28.891 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.891 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.891 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.891 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-15T23:24:28.891 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.891 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.891 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.891 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:24:28.891 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.891 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.891 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.892 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.892 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.892 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.892 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-15T23:24:28.892 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.892 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.892 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.892 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.892 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.892 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.892 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.893 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.893 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.893 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.893 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.893 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.893 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.893 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.893 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.893 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.893 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.893 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.893 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.893 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.894 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.894 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.894 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.894 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.894 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.894 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.894 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.894 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.894 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.894 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.894 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.894 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.894 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.895 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.896 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.896 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.896 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.896 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.896 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.896 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.896 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.896 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.896 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.896 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.896 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.896 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.896 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.897 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.897 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.897 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.897 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.897 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.897 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.897 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.897 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.897 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.897 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.897 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.897 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.897 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.898 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.899 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.899 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.899 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.899 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.899 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.899 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.899 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.899 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.899 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.899 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.899 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.899 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.899 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.900 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.900 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.900 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.900 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.900 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.900 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.900 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.900 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.900 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.900 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.900 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.900 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.901 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.902 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.903 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.903 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.903 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.903 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.903 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.903 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.903 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.903 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.903 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.903 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.903 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.903 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.903 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T23:24:28.904 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.905 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.905 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.905 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.905 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-15T23:24:28.905 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-15T23:24:28.905 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.905 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.905 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.905 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:28.905 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-15T23:24:28.905 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.905 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.905 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T23:24:28.906 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.906 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.906 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.906 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.906 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.906 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.906 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.906 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.906 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.906 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.906 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.906 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.907 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.908 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.909 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.909 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.909 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.909 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.909 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.909 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.909 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.909 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.909 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.909 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.909 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.909 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.910 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.911 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.912 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-15T23:24:28.912 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-15T23:24:28.912 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.912 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.912 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.912 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-15T23:24:28.912 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.912 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.912 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.912 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-15T23:24:28.912 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T23:24:28.912 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.912 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.913 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.914 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.914 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.914 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.914 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.914 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.914 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.914 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.914 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.914 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.914 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.914 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.914 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.914 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.915 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.915 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.915 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.915 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.915 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.915 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.915 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.915 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.915 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.915 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.915 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.915 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.915 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.916 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.916 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.916 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.916 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.916 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.916 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.916 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.916 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.916 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.916 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.916 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.916 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.916 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.917 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.917 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.917 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.917 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.917 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.917 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.917 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.917 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.917 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.917 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.917 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.918 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.918 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.918 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.918 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.918 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.918 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.918 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.918 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.918 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-15T23:24:28.918 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-15T23:24:28.918 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.918 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.918 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.919 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-15T23:24:28.920 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.920 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.920 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.920 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-15T23:24:28.920 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.920 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.920 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.920 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.920 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-15T23:24:28.920 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-15T23:24:28.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.920 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.921 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.921 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-15T23:24:28.921 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.921 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.921 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.921 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T23:24:28.921 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.921 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.921 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.921 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.921 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-15T23:24:28.921 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-15T23:24:28.921 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.922 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.922 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.922 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.922 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.922 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.922 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.922 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-15T23:24:28.922 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.922 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.922 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.922 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.922 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-15T23:24:28.923 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-15T23:24:28.923 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.923 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.923 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.923 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-15T23:24:28.923 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.923 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.923 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.923 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T23:24:28.923 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T23:24:28.924 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.924 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.924 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.924 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.924 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.924 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.924 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-15T23:24:28.924 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.924 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.924 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.924 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.924 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.925 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.925 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.925 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.925 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.925 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.925 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.925 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.925 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.925 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.925 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.925 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.925 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.925 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.926 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.926 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.926 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.926 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.926 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.926 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.926 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.926 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.926 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.926 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.926 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.926 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.926 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.927 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.928 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.928 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.928 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.928 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.928 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.928 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.928 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.928 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.928 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.928 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.928 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.928 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.928 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.929 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.930 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.931 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.932 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.932 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.932 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.932 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.932 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.932 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.932 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.932 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.932 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.932 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.932 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.932 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.933 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.933 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.933 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.933 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.933 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.933 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.933 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.933 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.933 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.933 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.933 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.933 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.934 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.934 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.934 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.934 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.934 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.934 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.934 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.935 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.935 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.935 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.935 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.935 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.935 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.935 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.935 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.935 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.935 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.935 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.935 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.936 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.936 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.936 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.936 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.936 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.936 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.936 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-15T23:24:28.936 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.936 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.936 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.936 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.936 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.938 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.939 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.940 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.940 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.940 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.940 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.940 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.940 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.940 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.940 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.940 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.940 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.940 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.940 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-15T23:24:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-15T23:24:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-15T23:24:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.943 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.943 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.943 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.943 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.943 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T23:24:28.943 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.943 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.943 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.943 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.943 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.943 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.943 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.944 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.944 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.944 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.944 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.944 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.944 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.944 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.944 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.944 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.944 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.944 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.944 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.944 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.945 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.945 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.945 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.945 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.945 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.945 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.945 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.945 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.945 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.945 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.945 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.945 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.947 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.948 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.948 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.948 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.948 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.948 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.948 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.948 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.948 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.948 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.948 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.948 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.949 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.949 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.949 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.949 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-15T23:24:28.949 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-15T23:24:28.949 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.950 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.950 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.950 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.950 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.950 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.950 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.950 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-15T23:24:28.951 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-15T23:24:28.951 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-15T23:24:28.951 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.951 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-15T23:24:28.951 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.951 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.951 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.952 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.952 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.952 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.952 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-15T23:24:28.952 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.953 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.953 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.953 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.953 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.953 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.953 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.953 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.953 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.953 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.954 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.954 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.954 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.954 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.954 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.954 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.954 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.955 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.955 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.955 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.955 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.955 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.955 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.955 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.955 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.955 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.956 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.956 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.956 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.956 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.956 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.956 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.956 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.956 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.956 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.956 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.956 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.956 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.956 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.957 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.958 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.959 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.959 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.959 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.959 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.959 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.959 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.959 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.959 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.959 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-15T23:24:28.959 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.959 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.959 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.960 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.961 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.961 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.961 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.961 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.961 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.961 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.961 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.961 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.961 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.961 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.961 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.962 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.962 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.962 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.962 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.962 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.962 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.962 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.962 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.962 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.962 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.962 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.962 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.963 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.963 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.963 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.963 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.963 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.963 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.963 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.963 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.963 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.963 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.963 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.963 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.964 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.964 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.964 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.964 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.964 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.964 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.964 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.964 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.964 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.964 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.965 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.965 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.965 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.965 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.965 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.965 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.965 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.965 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.965 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-15T23:24:28.965 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.965 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.965 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.966 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.966 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.966 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.966 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.966 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.966 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.966 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.966 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.966 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.966 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.966 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.966 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.967 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.967 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.967 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.967 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.967 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.967 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.967 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.967 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.967 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.967 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.968 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.969 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.969 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.969 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.969 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.969 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.969 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.969 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.969 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.969 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.969 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.969 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.970 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.970 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.970 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.970 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.970 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.970 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.970 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.970 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.970 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.970 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.970 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.972 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.972 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:28.972 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.972 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.972 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.972 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.972 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.972 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.972 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.972 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-15T23:24:28.972 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-15T23:24:28.973 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:28.973 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.973 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.973 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-15T23:24:28.973 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-15T23:24:28.973 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.973 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.973 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-15T23:24:28.973 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T23:24:28.973 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.973 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.973 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.973 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.974 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.974 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.974 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-15T23:24:28.974 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.974 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.974 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.974 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-15T23:24:28.974 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-15T23:24:28.974 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.974 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.974 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.974 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.975 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.976 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.976 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.976 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.976 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.976 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.976 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.976 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.976 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.976 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.976 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.976 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.977 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.977 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.977 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.977 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.977 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.977 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.977 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.977 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.977 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.977 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.977 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.977 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.978 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.978 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.978 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.978 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.978 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.978 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.978 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.978 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.980 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.980 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.980 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.980 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.980 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.980 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.980 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.980 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.980 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.980 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.980 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.981 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.981 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.981 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.981 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.981 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.981 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.981 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.981 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.981 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.981 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.981 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.981 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.982 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.982 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.982 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.982 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.982 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.982 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.982 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.982 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.982 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.982 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.982 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.983 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.983 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.983 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.983 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.983 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.983 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.983 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.983 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.983 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.983 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-15T23:24:28.983 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-15T23:24:28.983 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:28.984 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:28.985 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.985 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.985 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:28.985 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.985 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.985 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.985 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-15T23:24:28.985 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.985 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.985 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.985 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.985 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:28.986 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.986 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:28.986 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-15T23:24:28.986 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:28.986 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:28.986 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:28.986 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-15T23:24:28.986 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-15T23:24:28.986 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.986 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.986 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.986 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.986 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.987 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.987 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.987 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.987 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.987 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.987 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.987 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-15T23:24:28.987 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-15T23:24:28.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.987 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.987 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.987 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:28.988 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.988 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.988 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.988 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T23:24:28.988 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T23:24:28.988 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.988 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.988 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:28.988 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:28.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.988 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.988 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.989 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.989 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.989 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.989 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.989 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.989 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.989 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.989 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.989 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.989 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.989 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.989 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.990 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.990 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.990 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.990 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:28.990 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:28.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.990 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.990 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.990 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.990 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.990 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.990 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.991 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.991 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.991 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.991 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.991 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:28.991 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:28.991 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.991 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.991 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.991 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:28.991 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.991 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.992 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:28.992 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:28.992 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:28.992 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:28.992 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:28.992 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:28.992 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:28.992 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:28.992 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.992 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.992 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.992 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.993 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:28.993 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:28.993 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:28.993 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.993 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.993 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:28.993 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.993 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.993 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.993 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.993 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.993 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.994 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.994 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.994 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-15T23:24:28.994 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-15T23:24:28.994 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.994 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.994 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.994 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:28.994 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.994 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.994 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.994 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.995 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-15T23:24:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-15T23:24:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-15T23:24:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-15T23:24:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-15T23:24:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-15T23:24:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.998 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.998 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.998 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T23:24:28.998 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.998 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.998 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.998 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.998 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-15T23:24:28.998 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-15T23:24:28.998 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:28.998 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.998 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:28.998 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-15T23:24:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T23:24:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-15T23:24:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-15T23:24:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.000 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-15T23:24:29.000 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.000 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.000 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.000 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.000 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.000 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.000 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.000 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-15T23:24:29.000 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-15T23:24:29.000 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.000 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.001 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-15T23:24:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-15T23:24:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-15T23:24:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-15T23:24:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-15T23:24:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.002 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.003 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.004 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.005 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.005 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.005 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.005 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.005 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.005 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.005 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.005 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.005 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.005 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.005 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.005 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.007 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.007 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.007 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.007 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.007 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.007 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.007 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.007 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.007 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.007 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.007 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.007 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.008 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.008 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.008 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.008 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.008 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.008 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.008 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.008 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.008 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.008 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.008 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-15T23:24:29.008 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T23:24:29.009 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.010 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.010 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.010 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.010 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.010 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.010 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.010 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.010 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.010 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.010 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.010 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.010 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-15T23:24:29.010 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-15T23:24:29.011 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.011 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.011 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.011 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.011 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.011 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.011 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.011 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.011 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.011 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.011 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.011 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.011 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.012 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.012 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-15T23:24:29.012 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.012 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.012 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.012 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-15T23:24:29.012 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-15T23:24:29.012 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.012 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.012 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.012 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.012 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.013 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.013 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.013 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.013 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.013 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.013 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.013 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-15T23:24:29.013 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-15T23:24:29.013 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.013 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.013 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.014 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.014 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.014 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.014 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.014 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.014 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.014 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.014 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.014 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.015 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.015 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.015 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.015 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.015 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.015 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.015 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.015 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.015 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.015 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.015 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.015 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.015 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.016 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.016 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.016 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.016 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.016 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.016 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.016 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.016 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.016 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.016 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.016 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.016 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.017 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.017 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.017 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.017 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.017 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.017 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.017 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.017 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.017 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.017 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.017 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.017 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.018 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.018 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.018 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.018 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.018 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.018 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.018 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.018 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.018 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.018 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.018 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.018 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.018 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.019 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-15T23:24:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-15T23:24:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-15T23:24:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-15T23:24:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.022 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.022 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.022 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.022 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.022 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.022 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.022 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.022 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.022 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.022 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.022 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.022 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.022 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.023 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-15T23:24:29.023 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.023 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.023 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.023 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.023 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.023 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.023 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.023 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.023 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.023 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.023 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.023 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.024 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.024 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.024 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.024 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.024 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.024 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.024 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.024 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.024 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.024 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.024 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.024 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.025 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.025 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.025 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.025 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.025 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.025 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.025 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.025 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.025 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.025 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.025 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.025 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.026 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.026 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.026 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.026 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.026 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.026 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.026 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.026 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.026 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.026 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.026 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.026 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.026 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.027 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.027 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.027 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.027 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.027 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.027 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.027 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.027 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.027 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.027 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.027 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.028 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.028 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.028 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.028 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.028 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.028 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.028 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.028 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.028 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.028 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T23:24:29.028 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T23:24:29.028 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.029 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.029 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.029 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:29.029 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.029 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.029 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.029 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T23:24:29.029 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.029 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.029 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.029 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.029 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.029 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.030 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.030 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-15T23:24:29.030 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.030 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.030 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.030 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.030 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.030 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.030 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.030 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.030 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.031 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.033 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.034 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-15T23:24:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-15T23:24:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-15T23:24:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.036 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T23:24:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-15T23:24:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.037 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.038 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.039 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.040 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.041 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.042 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-15T23:24:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-15T23:24:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.043 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-15T23:24:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-15T23:24:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-15T23:24:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.044 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-15T23:24:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-15T23:24:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.045 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-15T23:24:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-15T23:24:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.046 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-15T23:24:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-15T23:24:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.047 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-15T23:24:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-15T23:24:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.048 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-15T23:24:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-15T23:24:29.049 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.050 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.050 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.050 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.050 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.050 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.050 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.050 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.050 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.050 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.050 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.050 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.050 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-15T23:24:29.050 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-15T23:24:29.051 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.051 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.051 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.051 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.051 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.051 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.051 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.051 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.051 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.051 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.051 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.051 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.051 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.052 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-15T23:24:29.053 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-15T23:24:29.053 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.053 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.053 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.053 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.053 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.053 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.053 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.053 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.053 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.053 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.053 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-15T23:24:29.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-15T23:24:29.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.055 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.055 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.055 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.055 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.055 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.055 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.055 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.055 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.055 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.055 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.055 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.056 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.057 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.057 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.057 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T23:24:29.057 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.057 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.057 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.057 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-15T23:24:29.057 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-15T23:24:29.057 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.057 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.057 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.058 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.060 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.060 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.060 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.060 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.060 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.060 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.060 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.060 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.060 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.060 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.060 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.060 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.060 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.061 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-15T23:24:29.064 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.064 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.064 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.064 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.064 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.064 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.064 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.064 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.064 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.064 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.064 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.064 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.065 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.066 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.067 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.068 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.068 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.068 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.068 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.068 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.068 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.068 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.068 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.068 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.068 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.070 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.071 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.071 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.071 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.071 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.071 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.071 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.071 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.071 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.071 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.072 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.072 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.072 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.072 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.072 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.072 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.072 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.072 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.073 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.073 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.073 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.073 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.073 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.073 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.073 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.073 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.074 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.074 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.074 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.074 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.074 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.074 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.074 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.074 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.075 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.075 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.075 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.075 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.075 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.075 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.075 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.076 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.076 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.076 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.076 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.076 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.076 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.077 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.077 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.077 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.077 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.077 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.077 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.078 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-15T23:24:29.078 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.078 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.078 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.078 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-15T23:24:29.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-15T23:24:29.078 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.078 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.078 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.078 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.079 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-15T23:24:29.080 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.080 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.080 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.080 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.080 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.080 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.080 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.080 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.080 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.080 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.080 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.081 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.082 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.082 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.082 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.082 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.082 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.082 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.082 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.082 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.082 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.082 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.082 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.082 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.082 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.083 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.083 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.083 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.083 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.083 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.083 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.083 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.083 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.083 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.083 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.083 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.083 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.083 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.084 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.084 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.084 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.084 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.084 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.084 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.084 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.084 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.084 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.084 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.084 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.084 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.084 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.085 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.085 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.085 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.085 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.085 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.085 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.085 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.085 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.085 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.085 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.085 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.085 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.086 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.088 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.088 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.088 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T23:24:29.088 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.088 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.088 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.088 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.088 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-15T23:24:29.088 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-15T23:24:29.088 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.088 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.088 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.088 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.089 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.089 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.089 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T23:24:29.089 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.089 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.089 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.089 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.089 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-15T23:24:29.089 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-15T23:24:29.089 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.089 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.090 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.090 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.090 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.090 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.090 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.090 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T23:24:29.090 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.090 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.090 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.090 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.090 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-15T23:24:29.090 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-15T23:24:29.090 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.091 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.091 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.091 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.091 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.091 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.091 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.091 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T23:24:29.091 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.091 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.091 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.091 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.091 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-15T23:24:29.092 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-15T23:24:29.092 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.092 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.092 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.092 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.092 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.092 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.092 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.092 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.092 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.092 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.092 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.092 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.093 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-15T23:24:29.093 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-15T23:24:29.093 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.093 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.093 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.093 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.093 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.093 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.093 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.093 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.093 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.093 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.094 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.094 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.094 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-15T23:24:29.094 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-15T23:24:29.094 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.094 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.094 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.094 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T23:24:29.094 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.094 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.094 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.094 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.094 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.095 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.096 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.096 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.096 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.096 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:29.096 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:29.096 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.096 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.096 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.096 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-15T23:24:29.096 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-15T23:24:29.096 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.096 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.097 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.097 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.097 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.097 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.097 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.097 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-15T23:24:29.097 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-15T23:24:29.097 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.097 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.097 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.097 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-15T23:24:29.097 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.098 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.098 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.098 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.098 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.098 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.098 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.098 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.098 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-15T23:24:29.098 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-15T23:24:29.098 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.098 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.099 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.099 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.099 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.099 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.099 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.099 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.099 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.099 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.099 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.099 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.100 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-15T23:24:29.100 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-15T23:24:29.100 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.100 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.100 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.100 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.100 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.100 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.100 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.100 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.100 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.100 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.100 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.101 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.101 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.101 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.101 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.101 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.101 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.101 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.101 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.102 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.102 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.102 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.102 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.102 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.102 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.102 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.102 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.102 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.102 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.102 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.102 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.103 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.103 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.103 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.103 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.103 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.103 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.103 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.103 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.104 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.104 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.104 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.104 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.104 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.104 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.104 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.104 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.104 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.104 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.104 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.105 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.105 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.105 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.105 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.105 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.105 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.105 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.105 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.105 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.106 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.106 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.106 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.106 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.106 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.106 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.106 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.106 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.106 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.106 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.106 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.106 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.107 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.107 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.107 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.107 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.107 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.107 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.107 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.107 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-15T23:24:29.107 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-15T23:24:29.107 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.107 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.108 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.108 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.108 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.108 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.108 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.108 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.108 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.108 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.109 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.109 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.109 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-15T23:24:29.109 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-15T23:24:29.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.109 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.109 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.109 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.109 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.109 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.109 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.110 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.110 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.110 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.110 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.110 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.110 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-15T23:24:29.110 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-15T23:24:29.110 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.110 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.111 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.111 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T23:24:29.111 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.111 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.111 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.111 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.111 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.111 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.111 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.111 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.112 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.112 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.112 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-15T23:24:29.112 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.112 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.112 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.112 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.112 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.113 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.113 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.113 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.113 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.113 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.113 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.113 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.115 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.116 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.116 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.116 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.116 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.116 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.116 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.116 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.116 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.116 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.116 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.116 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.116 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.117 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.117 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.117 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.117 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.117 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.117 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.117 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.117 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.117 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.117 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.117 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.117 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-15T23:24:29.118 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.119 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.119 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.119 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.119 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.119 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.119 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.119 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.119 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.119 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.119 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.119 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.119 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.119 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.120 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.121 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.121 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.121 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.121 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.121 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.121 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.121 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.121 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.121 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.121 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.121 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.121 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.122 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.123 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.124 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T23:24:29.125 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.125 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.125 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.125 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.125 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-15T23:24:29.125 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-15T23:24:29.125 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.125 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.125 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.125 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.125 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.126 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.126 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.126 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-15T23:24:29.126 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.126 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.126 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.126 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-15T23:24:29.126 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-15T23:24:29.126 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.126 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.126 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.126 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:29.127 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.127 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.127 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.127 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T23:24:29.127 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.127 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.127 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.127 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.127 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-15T23:24:29.127 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T23:24:29.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.127 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.127 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.128 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.128 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.128 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.128 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T23:24:29.128 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.128 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.128 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.128 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.128 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.128 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.128 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.128 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-15T23:24:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-15T23:24:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-15T23:24:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-15T23:24:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.131 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.132 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.132 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.132 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.132 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.132 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.132 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.132 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.132 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.132 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.132 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.132 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.132 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.133 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.133 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.133 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.133 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.133 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.133 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.133 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.133 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.133 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.133 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.133 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.133 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.133 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.134 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.134 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.134 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.134 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.134 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.134 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.134 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.134 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.134 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.134 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.135 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.135 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.135 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.135 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.135 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.135 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.135 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.135 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.135 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.135 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.135 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.135 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.135 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-15T23:24:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-15T23:24:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-15T23:24:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-15T23:24:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-15T23:24:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-15T23:24:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-15T23:24:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T23:24:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-15T23:24:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 24764, 2024-09-15T23:24:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "y", 2024-09-15T23:24:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-09-15T23:24:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-15T23:24:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-15T23:24:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T23:24:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-15T23:24:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-15T23:24:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-09-15T23:24:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-15T23:24:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-15T23:24:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-15T23:24:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-15T23:24:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-15T23:24:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-15T23:24:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-15T23:24:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-15T23:24:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-15T23:24:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.160 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T23:24:29.161 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.161 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.161 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.161 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-15T23:24:29.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-15T23:24:29.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.161 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.161 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.161 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-15T23:24:29.161 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.161 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-15T23:24:29.162 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-15T23:24:29.163 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-15T23:24:29.164 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.164 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T23:24:29.164 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.164 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.164 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.164 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.164 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-15T23:24:29.164 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-15T23:24:29.164 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.164 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.164 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.164 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T23:24:29.164 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.165 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.165 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.165 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T23:24:29.165 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T23:24:29.165 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.165 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.165 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.165 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-15T23:24:29.165 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-15T23:24:29.165 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.165 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.165 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.165 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-15T23:24:29.166 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-15T23:24:29.166 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-15T23:24:29.166 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.166 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-15T23:24:29.166 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T23:24:29.166 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.166 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.166 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.166 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-15T23:24:29.166 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-15T23:24:29.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.166 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.166 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.167 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.168 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:29.168 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-15T23:24:29.168 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-15T23:24:29.168 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.168 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T23:24:29.168 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:24:29.168 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.168 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.168 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.168 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.168 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.168 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.168 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.169 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.170 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.170 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.170 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.170 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.170 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.170 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.170 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.170 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.170 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.170 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.170 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.170 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.170 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.171 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.172 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.173 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.173 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.173 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.173 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.173 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.173 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.173 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.173 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.173 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.173 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.173 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-15T23:24:29.174 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-15T23:24:29.174 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.174 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.174 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.174 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:29.174 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.174 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.174 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.174 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T23:24:29.174 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.174 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.174 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.175 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.175 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-15T23:24:29.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-15T23:24:29.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.175 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.175 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.175 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-15T23:24:29.175 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.175 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.175 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.176 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-15T23:24:29.176 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-15T23:24:29.176 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-15T23:24:29.176 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-15T23:24:29.176 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-15T23:24:29.176 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.176 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-15T23:24:29.176 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.176 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.176 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.176 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-15T23:24:29.177 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-15T23:24:29.177 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.177 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.177 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.177 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.177 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.177 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.177 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.177 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T23:24:29.177 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.178 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.178 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.178 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.178 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:29.178 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:29.178 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.178 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.178 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.178 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:29.178 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.178 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.179 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.179 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T23:24:29.179 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.179 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.179 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.179 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.179 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-15T23:24:29.179 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-15T23:24:29.179 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.180 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.180 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.180 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:29.180 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-15T23:24:29.180 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.180 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.180 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T23:24:29.180 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T23:24:29.180 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.180 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.180 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-15T23:24:29.181 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-15T23:24:29.181 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:29.181 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.181 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.181 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.181 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.181 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.181 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.181 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T23:24:29.181 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.182 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.182 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.182 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.182 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.182 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.182 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-15T23:24:29.183 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.183 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-15T23:24:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-15T23:24:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-15T23:24:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T23:24:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.185 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.185 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.185 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.185 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-15T23:24:29.185 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-15T23:24:29.185 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.185 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.185 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.185 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-15T23:24:29.186 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.186 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.186 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.186 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T23:24:29.186 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.186 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.186 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.186 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-15T23:24:29.186 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-15T23:24:29.186 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.187 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.187 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.187 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-15T23:24:29.187 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.187 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.187 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.187 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T23:24:29.187 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.187 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.188 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.188 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.188 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-15T23:24:29.188 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-15T23:24:29.188 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.188 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.188 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.188 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.189 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.189 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.189 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.189 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T23:24:29.189 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T23:24:29.189 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.189 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.189 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-15T23:24:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-15T23:24:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T23:24:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.191 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.192 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T23:24:29.193 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.193 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.193 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.193 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.193 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-15T23:24:29.193 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-15T23:24:29.193 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.193 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.193 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.193 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.193 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.193 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.193 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.194 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.195 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T23:24:29.195 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.195 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.195 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.195 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.195 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-15T23:24:29.195 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-15T23:24:29.195 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.195 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.195 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.195 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.195 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.196 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.196 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.196 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T23:24:29.196 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.196 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.196 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.196 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-15T23:24:29.196 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-15T23:24:29.196 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.196 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.198 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.199 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.199 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T23:24:29.199 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.199 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.199 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.199 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-15T23:24:29.199 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.199 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.199 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.199 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-15T23:24:29.199 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-15T23:24:29.199 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-15T23:24:29.200 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-15T23:24:29.201 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-15T23:24:29.202 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.203 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.203 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.203 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T23:24:29.203 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.203 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.203 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.203 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-15T23:24:29.203 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.203 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.203 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.203 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.203 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-15T23:24:29.203 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-15T23:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T23:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-15T23:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.205 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-15T23:24:29.205 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-15T23:24:29.205 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.205 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.205 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.205 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T23:24:29.205 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.205 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.205 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.205 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-15T23:24:29.205 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.205 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.205 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-15T23:24:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-15T23:24:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T23:24:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-15T23:24:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.207 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.208 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.209 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.210 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.211 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.212 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-15T23:24:29.212 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-15T23:24:29.212 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.212 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.212 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.212 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T23:24:29.212 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.212 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.212 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.212 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-15T23:24:29.213 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.213 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.213 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.213 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.213 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-15T23:24:29.213 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-15T23:24:29.213 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.213 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.213 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.213 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.214 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.214 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.214 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.214 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T23:24:29.214 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.214 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.214 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.214 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-15T23:24:29.215 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-15T23:24:29.215 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.215 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.215 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.215 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:29.215 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.215 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.216 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.216 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T23:24:29.216 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.216 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.216 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.216 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.216 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-15T23:24:29.216 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T23:24:29.216 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.216 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.216 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.216 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-15T23:24:29.217 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.217 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.217 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.217 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T23:24:29.217 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.217 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.218 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.218 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.218 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-15T23:24:29.218 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-15T23:24:29.218 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.218 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.218 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.218 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-15T23:24:29.218 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.218 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.219 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.219 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T23:24:29.219 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.219 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.219 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.219 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-15T23:24:29.219 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-15T23:24:29.219 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.220 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.220 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.220 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-15T23:24:29.220 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.220 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.221 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.221 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-15T23:24:29.221 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.221 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.221 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.221 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.221 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-15T23:24:29.221 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-15T23:24:29.221 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.222 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.222 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.222 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.222 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.222 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.222 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.223 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T23:24:29.223 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.223 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.223 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.223 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.224 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-15T23:24:29.224 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-15T23:24:29.224 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.224 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.224 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:29.224 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.224 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.225 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.226 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.226 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T23:24:29.226 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.226 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.226 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.226 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.226 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-15T23:24:29.226 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-15T23:24:29.226 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.226 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.226 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.226 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:29.226 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.227 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.228 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.228 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T23:24:29.228 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.228 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.228 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.228 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.228 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-15T23:24:29.228 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-15T23:24:29.228 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.228 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.228 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.228 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.228 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.229 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.230 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.231 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-15T23:24:29.231 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-15T23:24:29.231 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.231 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.231 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.231 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.231 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.231 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.231 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.231 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.232 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T23:24:29.233 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.233 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.233 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.233 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.233 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.233 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.233 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.233 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.233 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.233 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.233 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.233 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.233 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.234 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.235 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.235 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.235 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.235 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.235 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.235 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.235 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.235 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.235 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.235 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.235 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.235 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.235 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.236 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.237 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.238 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-15T23:24:29.239 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-15T23:24:29.240 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.241 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.242 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.244 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.246 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-15T23:24:29.247 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-15T23:24:29.248 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.248 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.248 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.248 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.248 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.248 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.248 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T23:24:29.248 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.248 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.249 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.249 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.249 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-15T23:24:29.249 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-15T23:24:29.249 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.249 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.249 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.249 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-15T23:24:29.249 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.250 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.251 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.251 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.251 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T23:24:29.251 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.251 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.251 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.251 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.251 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-15T23:24:29.251 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-15T23:24:29.251 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.252 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.252 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.252 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.252 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.252 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.252 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T23:24:29.252 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.252 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.252 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.252 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-15T23:24:29.252 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-15T23:24:29.253 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.253 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.253 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.253 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.253 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.253 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.253 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.253 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T23:24:29.253 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.253 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-15T23:24:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-15T23:24:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T23:24:29.254 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.255 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.255 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.255 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-15T23:24:29.255 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-15T23:24:29.255 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.255 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.255 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.255 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.255 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.255 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.256 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.256 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T23:24:29.256 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.256 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.256 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.256 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-15T23:24:29.256 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-15T23:24:29.256 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.257 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.257 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.257 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.257 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.257 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.257 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.257 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T23:24:29.257 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.257 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.257 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.257 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.257 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.258 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.258 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.258 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-15T23:24:29.258 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.258 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.258 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.258 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.258 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.258 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.259 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.259 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.259 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.259 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.259 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.259 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.259 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.260 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.260 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.260 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.260 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.260 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.260 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.260 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.260 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.260 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.261 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.261 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.261 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.261 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.261 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.261 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.261 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.261 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.261 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.262 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.263 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.263 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.263 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.263 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.263 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.263 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.263 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.263 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.263 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.263 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.263 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.263 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.263 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.264 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.264 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.264 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.264 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.264 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.264 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.264 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.264 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.264 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.264 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.264 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.264 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.264 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.265 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.265 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-15T23:24:29.265 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-15T23:24:29.265 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.265 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.265 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.265 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-15T23:24:29.265 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.265 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.265 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.265 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T23:24:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-15T23:24:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-15T23:24:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-15T23:24:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T23:24:29.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T23:24:29.268 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T23:24:29.269 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.270 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.270 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.270 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.270 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.270 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.270 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.270 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.270 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.270 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.270 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.270 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.270 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-15T23:24:29.270 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T23:24:29.271 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T23:24:29.272 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T23:24:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T23:24:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.275 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.275 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.275 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.275 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.275 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.275 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.275 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.275 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.275 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.275 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.275 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.275 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T23:24:29.275 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T23:24:29.276 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.276 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.276 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.276 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.276 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.276 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.276 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.276 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.276 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.276 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.276 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.276 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.276 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.277 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T23:24:29.278 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T23:24:29.278 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.278 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.278 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.278 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.278 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.278 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.278 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.278 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.278 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.278 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.278 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.278 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T23:24:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T23:24:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.279 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.280 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.281 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.281 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T23:24:29.281 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T23:24:29.281 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.281 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.281 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.281 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.281 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.281 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.281 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.281 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.281 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.282 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.283 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.283 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.283 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T23:24:29.283 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T23:24:29.283 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.283 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.283 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.283 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.283 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.283 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.283 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.284 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.284 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.284 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.284 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.284 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.284 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-15T23:24:29.284 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-15T23:24:29.284 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.284 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.284 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.284 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.284 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-15T23:24:29.285 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.286 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.286 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.286 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.286 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.286 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.286 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.286 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.286 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T23:24:29.286 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T23:24:29.287 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.287 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.287 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.287 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.287 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.287 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.287 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.287 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.287 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.287 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.287 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.287 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.287 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T23:24:29.288 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T23:24:29.288 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.288 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.288 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.289 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.289 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.289 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.289 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.289 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.289 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.289 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.289 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.289 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.289 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T23:24:29.289 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T23:24:29.289 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.289 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.290 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.290 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.290 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.290 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.290 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.290 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.291 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.291 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.291 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.291 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.291 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T23:24:29.291 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T23:24:29.291 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.291 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.291 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.291 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.292 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.292 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.292 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.292 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.292 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.292 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.292 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.292 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.292 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T23:24:29.293 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T23:24:29.293 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.293 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.293 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.293 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.293 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.293 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.293 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.294 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.294 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.294 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.294 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.294 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.295 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T23:24:29.295 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T23:24:29.295 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.295 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.295 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.295 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.295 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.296 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.296 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.296 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.296 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.296 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.296 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.297 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.297 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T23:24:29.297 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T23:24:29.297 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.297 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.297 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T23:24:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T23:24:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.299 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.300 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.300 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.300 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.300 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.300 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.300 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.300 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.300 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.300 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.300 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.300 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T23:24:29.300 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T23:24:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T23:24:29.305 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T23:24:29.305 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.305 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.305 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.305 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.305 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.305 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.305 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.305 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.305 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.305 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.305 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.306 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.307 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.307 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T23:24:29.307 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T23:24:29.307 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.307 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.307 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.307 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.307 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.307 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.307 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.307 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.307 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.308 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.309 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.309 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.309 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.309 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T23:24:29.309 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T23:24:29.309 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.309 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.309 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.309 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-15T23:24:29.309 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.309 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.309 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.309 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.310 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.311 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.311 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.311 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.311 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.311 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T23:24:29.311 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T23:24:29.311 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.311 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.311 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.311 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-15T23:24:29.311 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T23:24:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T23:24:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T23:24:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T23:24:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.314 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.315 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:29.315 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.315 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.315 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.315 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.315 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.315 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.315 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.315 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.315 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T23:24:29.315 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T23:24:29.315 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.315 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.316 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.316 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.316 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.316 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.316 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.316 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.316 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.316 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.316 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.316 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.316 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T23:24:29.316 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T23:24:29.316 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.317 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.317 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.317 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:29.317 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.317 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.317 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.317 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.317 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.317 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.317 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.317 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.318 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.319 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-15T23:24:29.319 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-15T23:24:29.319 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.319 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.319 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.319 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.319 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.319 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.319 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.319 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.319 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.319 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.319 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.320 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.320 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-15T23:24:29.320 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-15T23:24:29.320 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.320 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.320 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.320 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.320 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.320 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.320 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.320 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-15T23:24:29.320 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.321 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.322 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.322 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.322 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.322 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-15T23:24:29.322 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-15T23:24:29.322 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.322 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.322 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.322 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.322 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.322 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.322 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.322 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.323 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.323 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.323 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.323 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.324 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.324 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.324 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.324 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.324 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.324 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.324 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.324 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.324 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.324 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.324 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.324 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.325 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.325 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.325 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.325 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.325 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.325 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.326 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.326 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.326 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.326 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.326 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.326 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.326 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.326 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.326 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.326 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.326 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.326 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.327 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.327 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.327 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.327 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.327 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.327 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.327 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.327 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.328 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.328 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.328 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.328 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.328 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.328 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.328 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.329 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.329 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.329 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.329 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.329 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.329 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.329 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.329 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.329 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.330 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.330 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.330 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.330 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.330 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.330 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.330 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.331 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.331 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.331 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.331 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.331 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.331 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.331 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.331 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.332 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-15T23:24:29.332 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-15T23:24:29.332 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.332 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.332 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.332 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.332 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.332 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.333 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.333 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-15T23:24:29.333 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.333 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.333 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.333 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.333 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-15T23:24:29.334 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T23:24:29.334 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.334 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.334 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.334 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.334 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.335 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.335 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.335 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.335 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.335 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.335 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.335 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.335 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-15T23:24:29.335 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-15T23:24:29.335 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.335 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.335 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.336 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-15T23:24:29.336 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.336 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.336 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.336 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.336 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.336 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.336 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.336 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.336 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-15T23:24:29.336 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-15T23:24:29.336 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.336 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.337 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.338 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.339 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.339 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-15T23:24:29.339 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.339 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.339 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.339 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.339 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.339 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.339 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.339 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.339 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-15T23:24:29.339 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-15T23:24:29.339 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.340 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.340 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.340 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-15T23:24:29.340 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.340 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.340 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.340 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.340 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-15T23:24:29.340 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.340 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.340 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.340 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.340 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.342 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.343 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.344 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.344 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.344 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.344 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-15T23:24:29.344 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.344 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.344 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.344 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.344 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.344 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.344 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.344 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.344 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.345 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.345 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.345 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.345 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.345 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.345 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.345 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.345 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.345 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.345 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.345 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.345 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.345 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.346 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.347 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.348 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.348 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.348 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.348 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.348 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.348 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.348 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.348 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.348 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.348 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.348 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.348 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.348 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-15T23:24:29.349 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-15T23:24:29.350 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-15T23:24:29.351 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-15T23:24:29.352 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.353 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.353 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.353 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-15T23:24:29.353 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.353 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.353 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.353 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T23:24:29.353 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.353 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.353 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.353 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.353 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.354 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T23:24:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.355 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.356 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.357 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.357 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.357 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.357 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-15T23:24:29.357 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.357 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.357 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.357 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.357 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.357 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.357 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.357 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.358 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.359 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.359 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.359 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.359 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.359 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.359 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.359 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.359 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.359 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.359 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.359 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.360 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.360 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.360 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.360 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.360 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.360 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.360 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.360 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.360 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.360 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.360 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.360 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.361 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.361 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.361 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.361 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.361 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.361 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.361 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.361 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.361 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.361 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.361 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.361 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.362 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.362 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.362 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.362 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.362 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.362 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.362 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.362 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.362 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.362 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.363 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.363 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.363 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.363 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.363 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-15T23:24:29.363 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-15T23:24:29.363 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.363 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.363 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.363 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-15T23:24:29.363 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.363 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.364 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.364 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.364 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.364 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.364 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.364 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.364 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-15T23:24:29.364 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-15T23:24:29.364 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.365 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.365 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.365 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-15T23:24:29.365 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.365 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.365 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.365 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.365 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.365 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.365 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.365 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-15T23:24:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-15T23:24:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-15T23:24:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-15T23:24:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-15T23:24:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-15T23:24:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T23:24:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-15T23:24:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-15T23:24:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-15T23:24:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T23:24:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-15T23:24:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-15T23:24:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-15T23:24:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-15T23:24:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-15T23:24:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-15T23:24:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-15T23:24:29.381 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-15T23:24:29.382 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.383 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.383 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.383 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.383 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.383 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.383 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.383 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-15T23:24:29.383 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.383 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.383 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.383 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.383 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-15T23:24:29.383 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.384 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.385 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.386 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.386 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.386 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.386 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.386 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.386 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.387 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.387 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.388 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.388 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.388 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.388 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.388 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.388 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.388 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.388 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.388 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.388 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.388 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.388 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.388 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.389 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.390 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.392 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.393 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.393 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.393 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.393 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.393 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.393 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.393 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.393 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.393 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.393 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.393 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.393 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.393 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.394 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.395 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.396 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.396 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.396 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.396 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.396 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.396 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.396 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.396 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.396 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.396 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.396 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.396 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.396 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-15T23:24:29.397 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-15T23:24:29.398 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.398 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.398 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.398 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-15T23:24:29.398 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.398 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.398 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.398 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T23:24:29.398 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.399 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.399 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.399 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-15T23:24:29.399 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-15T23:24:29.399 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.399 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.399 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.399 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.399 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-15T23:24:29.400 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.400 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.400 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T23:24:29.400 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.400 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.400 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.401 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.401 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.401 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.401 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.401 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.401 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.401 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.401 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.401 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.401 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.401 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.402 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.402 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.402 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.402 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.402 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.402 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.402 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.402 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.402 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.402 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.403 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.403 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.403 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.403 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.403 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.403 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.403 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.403 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.403 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.403 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.403 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.404 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.404 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.404 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.404 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.404 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.404 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.404 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.404 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.404 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.404 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.405 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.405 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.405 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.405 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.405 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.405 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.405 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.405 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.405 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.405 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.405 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.406 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.406 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.406 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.406 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.406 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.406 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.406 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.406 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.406 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.406 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.407 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.407 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.407 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.407 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.407 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.407 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.407 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.407 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.407 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-15T23:24:29.408 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.408 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.408 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.408 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-15T23:24:29.408 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-15T23:24:29.408 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.408 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.408 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.408 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-15T23:24:29.409 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.409 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.409 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.409 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-15T23:24:29.409 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T23:24:29.409 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.409 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.409 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.409 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.410 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.410 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.410 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.410 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.410 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.410 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.410 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.410 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.410 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.411 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.411 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.411 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.411 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.411 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.411 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.411 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.411 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.411 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.411 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.411 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.412 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.413 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.415 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-15T23:24:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T23:24:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-15T23:24:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-15T23:24:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-15T23:24:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-15T23:24:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-15T23:24:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-15T23:24:29.417 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-15T23:24:29.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-15T23:24:29.419 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.420 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-15T23:24:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.421 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.422 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.423 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.424 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.425 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-15T23:24:29.426 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.428 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.428 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.428 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.428 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.428 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.428 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.428 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.428 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.428 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.428 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.428 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.428 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.431 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.431 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.431 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.431 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.431 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.431 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.431 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.431 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.431 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.431 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.431 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.431 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.432 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.432 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.432 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.432 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.432 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.432 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.432 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.432 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.432 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-15T23:24:29.432 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.432 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.432 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.433 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.433 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.433 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.433 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.433 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.433 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.433 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.433 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.433 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.433 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.433 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.433 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.433 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.434 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.434 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.434 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.434 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.434 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.434 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.434 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.434 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.434 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.434 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.434 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.434 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.435 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.435 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.435 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.435 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.435 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.435 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.435 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.435 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.435 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.435 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.435 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.436 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.436 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.436 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.436 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.436 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.436 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.436 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.436 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.436 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.436 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.436 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.437 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.437 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.437 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.437 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.437 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.437 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.437 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.437 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.437 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.437 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.437 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.437 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.437 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.438 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.438 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.438 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.438 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.438 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.438 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.438 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.438 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.438 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.439 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.440 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.440 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.440 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.440 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T23:24:29.440 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.440 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.440 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.441 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.442 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.442 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.442 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.442 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.442 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.442 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.442 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.442 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.442 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.443 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.444 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.444 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.444 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.444 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.444 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.444 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.444 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.444 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.444 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.445 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.445 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.445 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.445 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.445 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.445 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.445 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.445 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.445 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.445 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.445 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.445 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.446 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.446 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.446 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.446 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.446 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.446 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.446 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.446 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.446 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.446 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.446 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.447 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.447 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-15T23:24:29.447 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-15T23:24:29.447 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.447 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.447 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.447 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.447 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.447 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.447 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.447 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-15T23:24:29.447 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-15T23:24:29.447 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-15T23:24:29.448 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.448 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-15T23:24:29.448 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.448 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.448 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.448 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.448 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.448 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.448 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-15T23:24:29.449 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.449 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.449 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.449 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.449 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.449 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.449 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.449 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.449 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.449 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.449 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.449 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.450 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.450 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.450 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.450 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.450 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.450 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.450 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.450 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.450 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.450 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.450 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.451 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.451 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.451 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.451 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.451 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.451 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.451 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.451 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.451 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.452 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.453 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.454 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.455 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.456 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.456 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.456 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.456 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.456 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.456 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.456 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.456 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.456 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.456 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.456 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.456 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.456 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.457 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.458 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.459 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.460 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.460 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.460 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.460 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.460 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.460 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.460 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.460 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.460 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.460 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-15T23:24:29.460 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.460 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.460 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.461 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.462 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.463 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.464 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.466 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.468 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.468 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-15T23:24:29.468 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.468 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.468 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.468 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-15T23:24:29.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-15T23:24:29.468 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.468 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.468 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.468 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.469 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.470 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.471 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.471 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.471 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.471 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.471 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.471 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.471 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.471 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.471 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.471 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.471 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.471 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.471 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.472 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.472 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.472 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.472 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.472 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.472 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.472 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.472 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.472 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.472 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.472 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.472 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.473 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.474 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.475 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.475 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.475 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.475 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.475 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.475 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.475 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.475 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.475 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-15T23:24:29.476 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-15T23:24:29.476 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.476 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.476 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.476 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-15T23:24:29.476 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.476 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.476 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.476 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-15T23:24:29.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.476 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.477 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:29.477 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:29.477 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.477 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.477 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.477 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:29.477 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.477 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.477 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.477 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-15T23:24:29.477 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.477 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.478 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.479 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.479 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.479 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.479 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.479 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.479 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.479 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.479 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.479 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-15T23:24:29.479 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-15T23:24:29.479 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.479 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.480 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.480 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.480 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.480 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.480 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.480 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T23:24:29.480 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T23:24:29.480 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.480 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.480 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.481 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.481 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.481 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.481 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.481 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.481 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.481 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.481 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.481 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.481 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.482 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.482 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.482 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.482 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.482 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.482 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.482 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.482 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.482 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.482 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.482 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.483 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.483 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.483 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.483 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.483 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.483 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.484 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.484 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.484 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.485 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.485 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.485 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.485 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.485 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.485 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.485 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.485 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.486 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.487 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.487 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.487 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.487 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.487 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.487 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.487 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.487 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.487 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.487 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.488 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.488 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-15T23:24:29.488 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-15T23:24:29.488 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.488 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.488 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.488 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.488 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.488 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.488 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.488 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.488 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.489 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.490 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.490 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.490 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.490 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-15T23:24:29.490 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-15T23:24:29.490 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.490 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.490 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.490 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-15T23:24:29.491 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.491 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.491 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.491 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.491 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.491 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.491 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.491 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.491 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-15T23:24:29.491 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-15T23:24:29.491 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.492 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.492 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.492 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-15T23:24:29.492 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.492 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.492 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.492 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T23:24:29.492 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.492 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.492 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.492 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.492 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-15T23:24:29.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-15T23:24:29.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.493 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.493 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.493 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-15T23:24:29.493 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.493 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.493 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.493 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T23:24:29.493 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.494 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.494 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.494 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.494 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-15T23:24:29.494 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-15T23:24:29.494 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.494 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.494 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.494 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-15T23:24:29.494 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.495 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.495 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.495 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.495 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.495 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.495 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.495 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.495 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-15T23:24:29.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-15T23:24:29.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.495 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.495 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.496 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-15T23:24:29.496 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.496 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.496 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-15T23:24:29.496 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-15T23:24:29.496 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.496 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.497 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.497 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.497 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.497 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-15T23:24:29.497 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-15T23:24:29.497 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.497 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.497 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.497 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-15T23:24:29.497 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-15T23:24:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-15T23:24:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-15T23:24:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.500 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.500 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.500 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.500 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.500 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.500 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.500 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.500 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.500 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.500 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.500 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.500 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.501 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.501 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.501 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.501 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.501 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.501 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.501 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.501 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.501 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.501 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.501 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.501 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.501 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.502 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.502 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.502 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.502 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.502 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.502 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.502 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.502 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.502 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.502 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.502 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.503 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.503 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.503 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.503 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.503 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.503 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.503 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.503 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.503 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.504 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.504 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.504 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.504 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.504 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.504 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.504 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.504 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.504 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.504 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.504 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.504 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.505 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-15T23:24:29.505 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-15T23:24:29.505 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.505 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.505 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.505 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.505 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.505 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.505 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.505 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.505 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.506 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.506 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.506 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.506 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-15T23:24:29.506 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T23:24:29.506 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.506 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.506 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.506 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.506 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.506 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.507 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.508 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.509 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.509 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.509 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.509 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.509 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.509 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.509 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.509 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.509 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.509 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-15T23:24:29.510 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-15T23:24:29.510 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.510 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.510 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.510 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.510 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.510 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.510 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.510 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.511 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.511 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.511 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.511 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.511 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.511 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.511 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.511 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.511 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.511 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.511 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.512 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.513 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.514 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.515 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.515 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.515 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.515 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.515 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.515 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.515 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.515 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.516 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.516 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.516 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.516 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.516 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.516 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-15T23:24:29.516 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-15T23:24:29.516 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.516 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.516 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.516 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.516 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.516 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.517 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.518 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.519 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.519 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.519 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.519 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.519 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.519 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.519 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.519 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.519 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.519 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.519 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.519 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.519 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.520 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.521 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.521 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.521 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.521 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.521 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.521 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.521 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.521 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.521 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.521 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.521 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.521 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.522 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.523 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.523 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.523 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.523 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.523 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.523 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.523 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.523 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.523 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.523 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.523 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.523 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.523 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.524 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.524 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.524 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T23:24:29.524 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T23:24:29.524 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.524 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.524 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.524 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T23:24:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-15T23:24:29.525 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.526 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.526 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.526 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.526 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.526 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.526 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.526 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.526 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.526 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.527 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.528 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.528 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.528 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.528 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.528 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.528 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.528 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.528 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.529 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.529 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.529 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.529 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.529 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.529 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.529 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.529 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.529 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.529 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.530 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.530 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.530 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.530 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.530 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.530 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.530 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.530 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.530 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.530 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.530 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.531 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.531 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.531 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.531 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.531 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.531 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.531 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.531 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.531 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.531 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.532 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.532 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.532 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.532 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.532 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.532 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.532 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.532 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.532 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.532 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-15T23:24:29.533 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-15T23:24:29.533 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.533 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.533 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.533 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-15T23:24:29.533 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.533 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.533 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.533 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T23:24:29.533 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.534 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.534 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.534 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.534 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.534 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.534 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.534 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-15T23:24:29.534 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.534 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.535 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.535 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.535 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.535 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.535 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.535 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.535 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.535 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.536 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.536 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.536 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.536 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.536 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.536 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.536 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.536 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.536 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.536 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.536 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.536 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.536 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.537 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.538 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.539 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.540 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.540 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.540 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.540 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.540 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.540 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-15T23:24:29.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-15T23:24:29.540 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.540 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.540 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.540 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.541 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.541 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.541 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.541 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.541 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.541 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.541 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.541 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.541 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-15T23:24:29.541 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-15T23:24:29.541 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.541 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.541 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.542 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-15T23:24:29.542 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.542 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.542 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.542 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.542 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.542 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.542 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.542 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.542 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-15T23:24:29.542 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-15T23:24:29.542 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-15T23:24:29.543 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.544 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.544 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.544 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.544 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.544 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.544 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.544 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.544 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.544 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.544 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.544 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.544 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-15T23:24:29.545 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-15T23:24:29.545 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.545 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.545 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.545 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.545 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.545 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.545 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.545 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.545 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.545 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.545 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.546 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-15T23:24:29.546 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-15T23:24:29.546 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.546 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.546 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.546 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.546 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.546 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.546 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.546 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.546 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.546 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.546 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.547 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.548 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.549 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.552 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-15T23:24:29.552 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-15T23:24:29.552 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.552 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.552 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.552 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.552 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.552 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.552 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.552 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.552 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.552 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.552 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.553 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.554 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.555 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.555 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.555 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.555 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-15T23:24:29.555 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.555 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.555 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.555 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.555 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.555 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.555 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.555 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.556 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.556 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.556 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.556 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.556 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.556 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.556 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.556 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.556 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.556 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.556 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.556 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.556 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.557 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.558 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.558 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.558 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.558 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.558 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.558 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.558 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.558 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.558 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.558 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.558 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.558 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.559 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.559 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.559 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.559 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.559 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.559 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.559 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.559 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.559 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.559 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.559 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.560 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.560 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.560 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.560 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.560 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.560 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.560 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.560 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.560 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.560 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.561 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.561 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.561 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.561 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.561 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.561 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.561 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.561 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-15T23:24:29.561 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.561 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.561 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.562 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.562 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.562 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.562 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.562 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.562 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.562 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.562 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.562 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.562 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.562 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.562 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.563 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.563 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.563 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.563 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.563 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.563 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.563 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.563 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.563 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.563 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.563 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.564 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.564 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.564 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.564 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.564 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.564 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.564 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.565 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.565 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.565 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.565 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.565 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.565 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.565 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.565 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.565 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.566 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.566 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.566 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.566 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.566 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.566 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.566 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.566 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.566 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.566 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.566 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.567 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.568 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.568 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.568 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.568 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.568 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.568 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-15T23:24:29.568 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.569 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.569 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.569 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.569 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.569 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.569 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.569 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.569 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.569 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.570 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.570 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.570 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.570 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.570 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.570 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.570 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.570 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.571 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.571 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.571 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.571 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.571 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.571 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.571 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.571 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.571 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.571 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.571 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.572 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.574 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.574 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.574 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.574 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.574 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.574 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.574 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.574 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.574 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.574 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.574 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.574 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.574 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.575 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.576 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T23:24:29.576 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.576 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.576 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.576 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.576 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.576 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.576 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.576 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.576 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:29.576 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:29.576 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.577 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.578 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.578 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.578 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.578 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.578 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.578 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.578 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.578 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.578 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.578 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.578 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.578 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.578 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.579 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.579 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.579 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.579 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.579 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.579 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.579 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.579 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.579 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.579 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.579 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.579 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.580 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.581 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.582 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.583 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T23:24:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-15T23:24:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-15T23:24:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.584 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.585 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T23:24:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-15T23:24:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-15T23:24:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.586 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T23:24:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-15T23:24:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-15T23:24:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T23:24:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-15T23:24:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-15T23:24:29.588 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-15T23:24:29.589 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-15T23:24:29.590 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-15T23:24:29.591 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.591 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.591 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.591 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T23:24:29.591 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.591 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.591 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.591 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.591 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.591 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.591 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.591 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.591 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-15T23:24:29.592 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-15T23:24:29.592 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.592 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.592 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.592 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.592 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.592 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.592 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.592 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.592 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.592 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.592 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.593 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.593 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:29.593 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:29.593 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.593 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.593 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.593 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-15T23:24:29.593 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-15T23:24:29.593 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.593 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.593 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.593 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.594 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.594 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.594 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-15T23:24:29.594 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-15T23:24:29.594 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.594 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.594 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-15T23:24:29.594 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.594 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.595 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.595 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.595 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.595 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.595 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.595 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-15T23:24:29.595 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-15T23:24:29.595 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.595 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.596 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.596 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.596 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.596 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.596 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.596 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.596 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.596 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.596 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-15T23:24:29.597 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-15T23:24:29.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.597 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.597 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.597 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.597 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.597 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.597 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.597 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.597 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.598 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.598 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.598 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.598 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.598 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.598 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.598 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.598 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.598 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.599 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.599 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.599 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.599 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.599 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.599 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.599 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.599 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.599 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.599 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.599 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.599 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.600 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.600 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.600 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.600 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.600 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.600 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.600 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.600 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.600 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.600 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.600 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.600 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.601 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.601 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.601 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.601 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.601 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.601 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.601 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.601 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.601 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.602 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.602 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.602 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.602 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.602 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.602 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.602 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.602 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.602 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.602 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.602 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.602 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.603 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.603 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.603 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.603 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.603 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.603 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.603 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.603 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.603 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.603 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.603 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.604 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.604 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.604 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.604 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-15T23:24:29.604 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-15T23:24:29.604 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.604 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.604 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.605 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.605 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.605 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.605 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.605 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.605 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.605 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.606 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-15T23:24:29.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-15T23:24:29.606 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.606 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.606 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.606 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.607 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.607 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.607 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.607 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.607 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.607 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.607 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-15T23:24:29.607 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-15T23:24:29.607 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.607 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.608 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-15T23:24:29.609 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.609 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.609 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.609 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.609 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.609 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.609 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.609 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.609 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.609 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.609 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.609 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.609 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.610 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.611 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.611 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.611 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.611 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.611 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.611 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.611 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.611 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.611 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.611 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.611 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.611 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.611 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.612 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.612 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.612 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.612 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.612 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.612 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.612 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.612 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.612 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.612 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.612 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.612 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.612 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.613 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.613 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.613 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.613 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.613 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.613 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.613 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.613 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.613 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.613 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.613 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.614 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.614 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.614 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.614 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.614 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.614 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.614 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.614 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.614 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.614 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-15T23:24:29.614 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.615 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.616 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.616 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.616 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.616 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.616 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.616 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.616 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.616 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.616 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.616 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.616 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.616 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.616 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.617 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.619 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.619 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.619 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.619 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.619 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.619 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.619 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.619 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.619 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.619 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.619 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.619 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-15T23:24:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-15T23:24:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-15T23:24:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.620 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.621 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.621 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T23:24:29.621 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.621 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.621 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.621 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-15T23:24:29.621 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-15T23:24:29.621 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.621 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.621 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.621 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.621 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.622 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.623 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.624 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T23:24:29.624 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.624 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.624 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.624 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.624 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.624 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.624 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-15T23:24:29.624 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.624 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.624 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.625 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-15T23:24:29.625 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-15T23:24:29.625 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:29.625 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.625 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.625 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-15T23:24:29.625 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.625 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.625 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.625 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.625 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.625 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.625 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.626 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.627 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:29.627 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:29.627 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.627 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.627 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.627 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:29.627 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.627 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.627 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.627 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.627 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.627 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.628 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.628 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.628 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.628 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.628 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.628 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.628 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.628 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.628 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.628 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.628 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.628 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.629 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.629 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.629 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.629 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.629 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.629 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.629 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.629 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.629 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.629 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.629 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.630 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.630 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.630 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.630 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.630 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.630 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.630 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.630 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.631 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.631 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.631 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.631 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.631 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.631 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.631 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.631 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.631 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.631 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.631 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.631 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.631 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.632 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.632 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.632 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.632 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.632 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.632 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.632 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.632 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.632 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.632 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.633 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.633 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.633 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.633 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.633 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.633 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.633 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.633 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.633 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.633 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.634 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.634 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.634 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.634 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.634 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.634 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-15T23:24:29.634 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-15T23:24:29.635 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.635 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.635 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.635 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.635 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.635 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.635 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.635 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.635 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.635 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.635 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.636 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-15T23:24:29.636 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-15T23:24:29.636 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.636 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.636 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.636 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-15T23:24:29.636 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.636 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.636 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.636 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.637 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.637 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.637 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.637 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.637 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-15T23:24:29.637 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-15T23:24:29.637 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.637 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.637 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.637 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T23:24:29.637 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.638 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.638 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.638 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.638 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.638 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.638 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.638 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.638 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.639 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.639 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-15T23:24:29.639 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.639 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.639 INFO:teuthology.orchestra.run.smithi002.stdout: "modules": [ 2024-09-15T23:24:29.639 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-15T23:24:29.639 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard", 2024-09-15T23:24:29.639 INFO:teuthology.orchestra.run.smithi002.stdout: "iostat", 2024-09-15T23:24:29.639 INFO:teuthology.orchestra.run.smithi002.stdout: "nfs", 2024-09-15T23:24:29.639 INFO:teuthology.orchestra.run.smithi002.stdout: "restful", 2024-09-15T23:24:29.640 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_schedule" 2024-09-15T23:24:29.640 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.640 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-09-15T23:24:29.640 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.640 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-09-15T23:24:29.640 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.640 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.640 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.640 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:29.641 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:29.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.641 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.641 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.641 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:29.641 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.641 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.641 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.641 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.642 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.643 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.644 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.644 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.644 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.644 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.644 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.644 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.644 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.644 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.644 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.644 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.644 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.644 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.646 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.647 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.647 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.647 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.647 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.647 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-09-15T23:24:29.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-09-15T23:24:29.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.647 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.647 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.648 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.648 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-09-15T23:24:29.648 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.648 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.648 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.648 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-09-15T23:24:29.648 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-09-15T23:24:29.648 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.648 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.648 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.648 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-09-15T23:24:29.648 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.649 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.650 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-09-15T23:24:29.651 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.652 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.652 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.652 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-09-15T23:24:29.652 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.652 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.652 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.652 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.652 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-09-15T23:24:29.652 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-09-15T23:24:29.652 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.652 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.652 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.652 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.653 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.654 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.655 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.655 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.655 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.655 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-09-15T23:24:29.655 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.655 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.655 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.655 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.655 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.655 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.655 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-09-15T23:24:29.655 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.656 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.656 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.656 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-09-15T23:24:29.656 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-09-15T23:24:29.656 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.656 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.656 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.656 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.656 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.656 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.656 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.656 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T23:24:29.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-09-15T23:24:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-09-15T23:24:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-09-15T23:24:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.658 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T23:24:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:24:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-09-15T23:24:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-09-15T23:24:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-09-15T23:24:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-15T23:24:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-09-15T23:24:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T23:24:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-09-15T23:24:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-09-15T23:24:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T23:24:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.660 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.661 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.661 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T23:24:29.661 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T23:24:29.661 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.661 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.661 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.661 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-09-15T23:24:29.661 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-09-15T23:24:29.661 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.661 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.661 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.661 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-09-15T23:24:29.661 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-09-15T23:24:29.662 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:29.663 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-09-15T23:24:29.664 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-09-15T23:24:29.664 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.664 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T23:24:29.664 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:24:29.664 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.664 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.664 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.664 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.664 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.664 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.664 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.664 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.665 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.665 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.665 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.665 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.665 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.665 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.665 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.666 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.666 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.666 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.666 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.666 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.666 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.666 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.666 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.666 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.666 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.666 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.667 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.667 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.667 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.667 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.667 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.667 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.667 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.667 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.667 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.668 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.668 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.668 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.668 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.668 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.668 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.668 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.668 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.668 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.668 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.668 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.668 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.668 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.669 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.669 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.669 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.669 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.669 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.669 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.669 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.669 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-09-15T23:24:29.670 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.671 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.671 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.671 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:29.671 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.671 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.671 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.671 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T23:24:29.671 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.671 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.672 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.672 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-15T23:24:29.672 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-15T23:24:29.672 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.672 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.672 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.672 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-09-15T23:24:29.672 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.673 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.673 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.673 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-09-15T23:24:29.673 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-09-15T23:24:29.673 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-09-15T23:24:29.673 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-09-15T23:24:29.673 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-09-15T23:24:29.673 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.673 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-09-15T23:24:29.674 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.674 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.674 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.674 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-09-15T23:24:29.674 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-09-15T23:24:29.674 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.674 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.674 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.674 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.675 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.675 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.675 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.675 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T23:24:29.675 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.675 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.675 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.675 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:29.675 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:29.676 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.676 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.676 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.676 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:29.676 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.676 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.676 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.677 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T23:24:29.677 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.677 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.677 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.677 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-09-15T23:24:29.677 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-09-15T23:24:29.677 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.677 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.677 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.677 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:29.677 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-15T23:24:29.677 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-09-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-09-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.679 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.679 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.679 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T23:24:29.679 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.679 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.679 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.679 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.679 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.679 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.679 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.679 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-09-15T23:24:29.679 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.679 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.680 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.680 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-09-15T23:24:29.680 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-09-15T23:24:29.680 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.680 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.680 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.680 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-15T23:24:29.680 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.680 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.680 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.680 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T23:24:29.680 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.680 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.681 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-09-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-09-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-09-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.683 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.683 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.683 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-09-15T23:24:29.683 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-09-15T23:24:29.683 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.683 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.683 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.683 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.683 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.683 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.683 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.683 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T23:24:29.684 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T23:24:29.684 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.684 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.684 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.684 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-09-15T23:24:29.684 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-09-15T23:24:29.684 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.684 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.684 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.684 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:29.684 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.685 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.685 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.685 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T23:24:29.685 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.685 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.685 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.685 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.685 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-09-15T23:24:29.685 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T23:24:29.685 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.685 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.685 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.685 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.686 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-09-15T23:24:29.687 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-09-15T23:24:29.688 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-09-15T23:24:29.689 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.689 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.689 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.689 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.689 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.689 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.689 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.689 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T23:24:29.689 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.689 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.689 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.689 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.690 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-09-15T23:24:29.690 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-09-15T23:24:29.690 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.690 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.690 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.690 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.690 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.690 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.690 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.690 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T23:24:29.690 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.690 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.691 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.692 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.692 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.692 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-09-15T23:24:29.692 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-09-15T23:24:29.692 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.692 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.692 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.692 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T23:24:29.692 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.692 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.692 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.692 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-09-15T23:24:29.693 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.693 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.693 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.693 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.693 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-09-15T23:24:29.693 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-09-15T23:24:29.693 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.693 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.693 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.693 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T23:24:29.693 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.693 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.693 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.694 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-09-15T23:24:29.694 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.694 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.694 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.694 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.694 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-09-15T23:24:29.694 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-09-15T23:24:29.694 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.694 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.694 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.694 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T23:24:29.694 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.695 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.695 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.695 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-15T23:24:29.695 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.695 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.695 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.695 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.695 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-09-15T23:24:29.695 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-09-15T23:24:29.695 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T23:24:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-09-15T23:24:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-09-15T23:24:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-09-15T23:24:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T23:24:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-09-15T23:24:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-09-15T23:24:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-09-15T23:24:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T23:24:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-09-15T23:24:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.699 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.699 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-09-15T23:24:29.699 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-09-15T23:24:29.699 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.699 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.699 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.699 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T23:24:29.699 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.699 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.699 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.699 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-09-15T23:24:29.700 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.700 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.700 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.700 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.700 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-09-15T23:24:29.700 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-09-15T23:24:29.700 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.700 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.700 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.701 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T23:24:29.701 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.701 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.701 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.701 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-09-15T23:24:29.701 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.701 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.701 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.702 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-09-15T23:24:29.702 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-09-15T23:24:29.702 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.702 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.702 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.702 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T23:24:29.702 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.702 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.702 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.702 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-09-15T23:24:29.703 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.703 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.703 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.703 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-09-15T23:24:29.703 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-09-15T23:24:29.703 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.703 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.703 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.703 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T23:24:29.703 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.703 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-15T23:24:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-09-15T23:24:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-09-15T23:24:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.705 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.705 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T23:24:29.705 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.705 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.705 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.705 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-09-15T23:24:29.705 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.705 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.705 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.705 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.705 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-09-15T23:24:29.705 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-09-15T23:24:29.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.706 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.706 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.706 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T23:24:29.706 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.706 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.706 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.706 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-09-15T23:24:29.706 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.706 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.707 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.707 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.707 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-09-15T23:24:29.707 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-09-15T23:24:29.707 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.707 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.707 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.707 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T23:24:29.707 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.707 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.708 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.708 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-09-15T23:24:29.708 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.708 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.708 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.708 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.708 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-09-15T23:24:29.708 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-09-15T23:24:29.708 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.708 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.708 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.708 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T23:24:29.709 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.709 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.709 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.709 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-09-15T23:24:29.709 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.709 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.709 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.709 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.709 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-09-15T23:24:29.709 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-09-15T23:24:29.710 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-09-15T23:24:29.711 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.711 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.711 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.711 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.711 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.711 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.711 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.711 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T23:24:29.711 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.711 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.711 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.711 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.711 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.712 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-09-15T23:24:29.713 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T23:24:29.713 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.713 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.713 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.713 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-09-15T23:24:29.713 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.713 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.713 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.713 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T23:24:29.713 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.713 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.713 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.713 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.714 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-09-15T23:24:29.714 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-09-15T23:24:29.714 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.714 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.714 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.714 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-09-15T23:24:29.714 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.714 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.714 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.714 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T23:24:29.714 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.714 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.714 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.715 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.715 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-09-15T23:24:29.715 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-09-15T23:24:29.715 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.715 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.715 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.715 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-09-15T23:24:29.715 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.715 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.715 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.715 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-09-15T23:24:29.715 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.715 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.716 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.716 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-09-15T23:24:29.716 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-09-15T23:24:29.716 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.716 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.716 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.716 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.716 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.716 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.716 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.716 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T23:24:29.716 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-09-15T23:24:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-09-15T23:24:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-09-15T23:24:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-09-15T23:24:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-09-15T23:24:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T23:24:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.719 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T23:24:29.719 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.719 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.719 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.719 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-09-15T23:24:29.719 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-09-15T23:24:29.719 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.719 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.719 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.719 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.721 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.721 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.721 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.721 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T23:24:29.721 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.721 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.721 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.721 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.721 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-09-15T23:24:29.721 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-09-15T23:24:29.721 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.721 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.721 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.722 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.722 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.722 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.722 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.722 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T23:24:29.722 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.722 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.722 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.722 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.722 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.722 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.722 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.723 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.723 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.723 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.723 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.723 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.723 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.723 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.723 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.723 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.723 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.723 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.723 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.723 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.724 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.724 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.724 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.724 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.724 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.724 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-09-15T23:24:29.724 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-09-15T23:24:29.724 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.724 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.724 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.724 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.724 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.725 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.725 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.725 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T23:24:29.725 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.725 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.725 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.725 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.725 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.725 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.725 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.725 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.725 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.725 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.726 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.726 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.726 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.726 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T23:24:29.726 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.726 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.726 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.726 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.726 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.726 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.726 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.726 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.726 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.727 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.727 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.727 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.727 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.727 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.727 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.727 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.727 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.727 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.727 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.727 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.727 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.728 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.728 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.728 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.728 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.728 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.728 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.728 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.728 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.728 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.728 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.729 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.730 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.730 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T23:24:29.730 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.730 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.730 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.730 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T23:24:29.730 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T23:24:29.730 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.730 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.730 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.730 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-09-15T23:24:29.730 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.731 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.732 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.732 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.732 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-09-15T23:24:29.732 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.732 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.732 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.732 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-09-15T23:24:29.732 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-09-15T23:24:29.732 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.732 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.732 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.732 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.733 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-09-15T23:24:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-09-15T23:24:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-09-15T23:24:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-09-15T23:24:29.735 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-09-15T23:24:29.736 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.736 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.736 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.736 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-09-15T23:24:29.736 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.736 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.736 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.736 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T23:24:29.736 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.736 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.736 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.736 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.736 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-09-15T23:24:29.737 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-09-15T23:24:29.737 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.737 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.737 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.737 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T23:24:29.737 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.737 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.737 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.737 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T23:24:29.737 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.737 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.737 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.737 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.738 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.739 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-09-15T23:24:29.739 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-09-15T23:24:29.739 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.739 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.739 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.739 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.739 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.739 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.739 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.739 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T23:24:29.739 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.739 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.739 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.740 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-09-15T23:24:29.740 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-09-15T23:24:29.740 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.740 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.740 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.740 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.740 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.740 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.740 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.740 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T23:24:29.740 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.740 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.741 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.741 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.741 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-09-15T23:24:29.741 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-09-15T23:24:29.741 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.741 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.741 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.741 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.741 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.741 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.741 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.741 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T23:24:29.741 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T23:24:29.742 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-09-15T23:24:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.744 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.744 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.744 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-09-15T23:24:29.744 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-09-15T23:24:29.744 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.744 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.744 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.744 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.744 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.744 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.744 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.745 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T23:24:29.745 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.745 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.745 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.745 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.745 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-09-15T23:24:29.745 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-09-15T23:24:29.745 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.745 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.745 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.745 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.745 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.745 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T23:24:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-09-15T23:24:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-09-15T23:24:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.747 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.748 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.748 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.748 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T23:24:29.748 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.748 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.748 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.748 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.748 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-09-15T23:24:29.748 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-09-15T23:24:29.748 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.748 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.748 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.749 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.750 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.750 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.750 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.750 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.750 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T23:24:29.750 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.750 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.750 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.750 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.750 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.751 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.751 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-09-15T23:24:29.751 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.751 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.751 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.751 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.751 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.751 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.751 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.751 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.751 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.751 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.752 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.752 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.752 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.752 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.752 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.752 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.752 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.752 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.752 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.752 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.752 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.752 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.752 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.753 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.753 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.753 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.753 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.753 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.753 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.753 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.753 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.753 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.753 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.753 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.754 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.754 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.754 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.754 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.754 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.754 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.754 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.754 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.754 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.754 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.754 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.755 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.755 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.755 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.755 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.755 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.755 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.755 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.755 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.755 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.755 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.755 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.755 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.757 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-09-15T23:24:29.757 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-09-15T23:24:29.757 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.757 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.757 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.757 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-09-15T23:24:29.757 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.757 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.757 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T23:24:29.757 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.757 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.758 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.759 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.759 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.759 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.759 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.759 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.759 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-09-15T23:24:29.759 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.759 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.759 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.759 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T23:24:29.759 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T23:24:29.759 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.760 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.760 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.760 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.760 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.760 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.760 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.760 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.760 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.760 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.760 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.760 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.760 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T23:24:29.761 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T23:24:29.761 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.761 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.761 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.761 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.761 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.761 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.761 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.761 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.761 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.761 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.761 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.762 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T23:24:29.762 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T23:24:29.762 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.762 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.762 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.762 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.762 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.762 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.762 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.762 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.762 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.762 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-09-15T23:24:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T23:24:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.763 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.764 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.765 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.765 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.765 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T23:24:29.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T23:24:29.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.765 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.765 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.765 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.765 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.765 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.766 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.766 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.766 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T23:24:29.766 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T23:24:29.766 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.766 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.766 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.766 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.766 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.766 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.766 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.766 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.767 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.768 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.768 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.768 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.768 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.768 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T23:24:29.768 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T23:24:29.768 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.768 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.768 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.768 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.768 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.768 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.768 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.769 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T23:24:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T23:24:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.771 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.771 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.771 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.771 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.771 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.771 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.771 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T23:24:29.771 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T23:24:29.771 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.771 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.771 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.772 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.772 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.772 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.772 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.772 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.772 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.772 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.772 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.772 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.772 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T23:24:29.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T23:24:29.772 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.772 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.773 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.773 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.773 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.773 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.773 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.773 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.773 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.773 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.773 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.773 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.773 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T23:24:29.773 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T23:24:29.773 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T23:24:29.774 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.775 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.775 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.775 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-15T23:24:29.775 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.775 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.775 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.775 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.775 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.775 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.775 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.775 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.775 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T23:24:29.776 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T23:24:29.776 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.776 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.776 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.776 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.776 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.776 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.776 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.776 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.776 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.776 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.776 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.777 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-09-15T23:24:29.777 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-09-15T23:24:29.777 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.777 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.777 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.777 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.777 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.777 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.777 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.777 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.777 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.777 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.778 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.779 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.779 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.779 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T23:24:29.779 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T23:24:29.779 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.779 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.779 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.779 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.779 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.779 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.779 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.779 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.779 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.780 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.781 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.781 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.781 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.781 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T23:24:29.781 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T23:24:29.781 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.781 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.781 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.781 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.781 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.781 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.782 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.782 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.782 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.782 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.782 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.782 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T23:24:29.782 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T23:24:29.782 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.782 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.782 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T23:24:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T23:24:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.783 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.784 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.785 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.785 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.785 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.785 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.785 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.785 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.785 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.785 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.785 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.785 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T23:24:29.785 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T23:24:29.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.786 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T23:24:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T23:24:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.788 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.788 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.788 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.788 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.788 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.788 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.788 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.788 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.788 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.788 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.788 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.789 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T23:24:29.789 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T23:24:29.789 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.789 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.789 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.789 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.789 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.789 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.789 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.789 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.789 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.789 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.789 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.790 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.791 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.791 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T23:24:29.791 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T23:24:29.791 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.791 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.791 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.791 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.791 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.791 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.791 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.791 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.791 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.791 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.792 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.793 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.793 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.793 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T23:24:29.793 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T23:24:29.793 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.793 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.793 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.793 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.793 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.793 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.793 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.793 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.793 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.794 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.794 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.794 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.794 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T23:24:29.794 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T23:24:29.795 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T23:24:29.796 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.797 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.797 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.797 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.797 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.797 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.797 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.797 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.797 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.797 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.797 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.797 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T23:24:29.798 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T23:24:29.798 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.798 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.798 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.798 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-09-15T23:24:29.798 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.798 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.798 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.798 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.798 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.798 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.798 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.798 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.799 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T23:24:29.799 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T23:24:29.799 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.799 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-09-15T23:24:29.799 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.799 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.799 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.799 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.800 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.800 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.800 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.800 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.800 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T23:24:29.800 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T23:24:29.800 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.800 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.800 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.800 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.800 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.800 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.801 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.801 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.801 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.801 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.801 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.801 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.801 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T23:24:29.801 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T23:24:29.801 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.801 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.801 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.801 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-09-15T23:24:29.801 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.802 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.802 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.802 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.802 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.802 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.802 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.802 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.802 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T23:24:29.802 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T23:24:29.802 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.802 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.802 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.803 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.804 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.804 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.804 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.804 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.804 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.804 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.804 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.804 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.804 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.804 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T23:24:29.804 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T23:24:29.804 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.805 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.805 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.805 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:29.805 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.805 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.805 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.805 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.805 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.805 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.805 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.805 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T23:24:29.805 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T23:24:29.806 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-09-15T23:24:29.807 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-09-15T23:24:29.808 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-09-15T23:24:29.809 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-09-15T23:24:29.810 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.810 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.810 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.810 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.810 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.810 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.810 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.810 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-09-15T23:24:29.810 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.810 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.810 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.810 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.810 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-09-15T23:24:29.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-09-15T23:24:29.811 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.811 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.811 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.811 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-09-15T23:24:29.811 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.811 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.811 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.811 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.811 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.811 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.811 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.812 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-15T23:24:29.812 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-15T23:24:29.812 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.812 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.812 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.812 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.812 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.812 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.812 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.812 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.812 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.812 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.813 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.813 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.813 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.813 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.813 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.813 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.813 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.813 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.813 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.813 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.813 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.813 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.814 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.814 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.814 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.814 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.814 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.814 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.814 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.814 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.814 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.814 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.816 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.816 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.816 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.816 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.816 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.816 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.816 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.816 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.816 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.816 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.816 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.816 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.816 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.817 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.818 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.818 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.818 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.818 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.818 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.818 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.818 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.818 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-09-15T23:24:29.818 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-09-15T23:24:29.818 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.818 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.818 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-09-15T23:24:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-09-15T23:24:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T23:24:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.819 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.820 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.821 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.822 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.822 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-09-15T23:24:29.822 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.822 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.822 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.822 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.822 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.822 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.822 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.822 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-15T23:24:29.822 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-15T23:24:29.822 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.823 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.823 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.823 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.823 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.823 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.823 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.823 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.823 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.823 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.823 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.823 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-09-15T23:24:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-09-15T23:24:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-09-15T23:24:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.825 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.826 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.827 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.827 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.827 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.827 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-09-15T23:24:29.827 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-09-15T23:24:29.827 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.827 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.827 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.827 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.827 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.827 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.827 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.827 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.828 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.828 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.828 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.828 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.828 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.828 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.828 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-15T23:24:29.828 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.828 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.828 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.828 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.829 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.830 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.831 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.831 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.831 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.831 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.831 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.831 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.831 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.831 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.831 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.831 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.831 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.831 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.831 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.832 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.832 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.832 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.832 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.832 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.832 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.832 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.832 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.832 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.832 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.832 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.832 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.832 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.833 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.833 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.833 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.833 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.833 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.833 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.833 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.833 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.833 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.833 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.833 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.833 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.833 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.834 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-09-15T23:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-09-15T23:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-09-15T23:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.835 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.836 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T23:24:29.836 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.836 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.836 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.836 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-09-15T23:24:29.836 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-09-15T23:24:29.836 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.836 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.836 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.836 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-09-15T23:24:29.836 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.836 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.837 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.838 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.838 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-09-15T23:24:29.838 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.838 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.838 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.838 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-09-15T23:24:29.838 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-09-15T23:24:29.838 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.838 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.838 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.838 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-15T23:24:29.838 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.839 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.840 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.840 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.840 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T23:24:29.840 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.840 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.840 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.840 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.840 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:29.840 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:29.840 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.840 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.840 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.840 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:29.841 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.841 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.841 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.841 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T23:24:29.841 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.841 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.841 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.841 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-09-15T23:24:29.841 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-09-15T23:24:29.841 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.841 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.841 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.842 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-09-15T23:24:29.842 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.842 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.842 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.842 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T23:24:29.842 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.842 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.842 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.842 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.842 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.842 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.843 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.844 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.844 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.844 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.844 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.844 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.844 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.844 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.844 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.844 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.844 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.844 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.844 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.845 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.845 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.845 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.845 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.845 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.845 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.845 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.845 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.846 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.846 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.846 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.846 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.846 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.846 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.846 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.846 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.846 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.846 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.846 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.846 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.847 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.848 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.848 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.848 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.848 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.848 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.848 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.848 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.848 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.848 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-09-15T23:24:29.848 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-09-15T23:24:29.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.848 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.848 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.849 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-09-15T23:24:29.849 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.849 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.849 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.849 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.849 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.849 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.849 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.849 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-09-15T23:24:29.849 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-09-15T23:24:29.849 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.850 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.850 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.850 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-09-15T23:24:29.850 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.850 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.850 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.850 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.850 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.850 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.850 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.850 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.850 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:29.851 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:29.851 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.851 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.851 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.851 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-09-15T23:24:29.851 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.851 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.851 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.851 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.851 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.851 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.851 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.851 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.852 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.852 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.852 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.852 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-09-15T23:24:29.852 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-09-15T23:24:29.852 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-09-15T23:24:29.852 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.852 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-09-15T23:24:29.852 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-09-15T23:24:29.852 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.852 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.852 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.853 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-09-15T23:24:29.853 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.853 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.853 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.853 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T23:24:29.853 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.853 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.853 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.853 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-09-15T23:24:29.853 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-09-15T23:24:29.853 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.853 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.854 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.854 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-09-15T23:24:29.854 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.854 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.854 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.854 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T23:24:29.854 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.854 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.854 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.854 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.854 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-09-15T23:24:29.854 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-09-15T23:24:29.854 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:29.855 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.856 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.856 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.856 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-09-15T23:24:29.856 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-09-15T23:24:29.856 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.856 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.856 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T23:24:29.856 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.856 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.856 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.856 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.856 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.857 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.857 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.857 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.857 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.857 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.857 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.857 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.857 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.857 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.857 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.857 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.857 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.857 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.858 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.859 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.859 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.859 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.859 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.859 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.859 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.859 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.859 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.859 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.859 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.859 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.859 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.860 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.860 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.860 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.860 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.860 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.860 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.860 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.860 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.860 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.860 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.860 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.860 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.861 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.861 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.861 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.861 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.861 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.861 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.861 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.861 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.861 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.861 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.861 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.861 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.862 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.862 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.862 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-09-15T23:24:29.862 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-09-15T23:24:29.862 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.862 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.862 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.862 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.862 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.862 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.862 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.862 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-09-15T23:24:29.862 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-09-15T23:24:29.863 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.864 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.864 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.864 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-09-15T23:24:29.864 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-09-15T23:24:29.864 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.864 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.864 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.864 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-09-15T23:24:29.864 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.864 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.864 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-09-15T23:24:29.865 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.866 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T23:24:29.866 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.866 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.866 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.866 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-09-15T23:24:29.866 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-09-15T23:24:29.866 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.866 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.866 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.866 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.866 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.866 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.867 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.867 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-09-15T23:24:29.867 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.867 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.867 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.867 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-09-15T23:24:29.867 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-09-15T23:24:29.867 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.867 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.867 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.868 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-09-15T23:24:29.868 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.868 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.868 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.868 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:24:29.868 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.868 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.868 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.868 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.868 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.868 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.868 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-09-15T23:24:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.870 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.871 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.872 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.874 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.875 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.875 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.875 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.875 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.875 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.875 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.875 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.875 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.875 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.875 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.875 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.875 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.875 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.876 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.877 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.877 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.877 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.877 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.877 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.877 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.877 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.877 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.877 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.877 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.877 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.877 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.877 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.878 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.878 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.878 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.878 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.878 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.878 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.878 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.878 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.878 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.878 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.878 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.878 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.878 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.879 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.879 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.879 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.879 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.879 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.879 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.879 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.879 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.879 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.879 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.879 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.879 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-09-15T23:24:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-09-15T23:24:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-09-15T23:24:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.881 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.881 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.881 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-09-15T23:24:29.881 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.881 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.881 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.881 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T23:24:29.881 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.881 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.881 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.881 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.881 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-09-15T23:24:29.881 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-09-15T23:24:29.882 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.882 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.882 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.882 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.882 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-09-15T23:24:29.882 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.882 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.882 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T23:24:29.882 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.882 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.882 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.882 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.882 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.883 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.884 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.884 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.884 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.884 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.884 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.884 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.884 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.884 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.884 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.884 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.884 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.884 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.885 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.885 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.885 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.885 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.885 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.885 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.885 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.885 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.885 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.885 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.885 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.885 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.886 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.887 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.887 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.887 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.887 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.887 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.887 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.887 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.887 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.887 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.887 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.887 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.887 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.888 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.888 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.888 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.888 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.888 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.888 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-09-15T23:24:29.888 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.888 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.888 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.888 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-09-15T23:24:29.888 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-09-15T23:24:29.888 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.889 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.890 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.890 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.890 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.890 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.890 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.890 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.890 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.890 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.890 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.890 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.890 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.890 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.891 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.892 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.892 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.892 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.892 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.892 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.892 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.892 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.892 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.892 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.892 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.892 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.892 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.893 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.893 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.893 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.893 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.893 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.893 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.893 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.893 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.893 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.893 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.893 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.893 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.894 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.894 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.894 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.894 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.894 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.894 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.894 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.894 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.894 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.894 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.894 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.894 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.894 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-09-15T23:24:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-09-15T23:24:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.895 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-09-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-09-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-09-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-09-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.896 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.897 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.897 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-09-15T23:24:29.897 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.897 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.897 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.897 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.897 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-09-15T23:24:29.897 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-09-15T23:24:29.897 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.897 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.897 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.897 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-09-15T23:24:29.897 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.898 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.898 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.898 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T23:24:29.898 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.898 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.898 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.898 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.898 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-09-15T23:24:29.898 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-09-15T23:24:29.898 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.898 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.898 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.898 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.899 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.899 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.899 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.899 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-09-15T23:24:29.899 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.899 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.899 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.899 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.899 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-09-15T23:24:29.899 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-09-15T23:24:29.899 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.899 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.899 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.900 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-09-15T23:24:29.900 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.900 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.900 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.900 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T23:24:29.900 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T23:24:29.900 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.900 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.900 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.900 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.900 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.900 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-09-15T23:24:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.901 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.902 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.903 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.903 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.903 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.903 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.903 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.903 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.903 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.903 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.903 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.903 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.905 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.905 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.905 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.905 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.905 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.905 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.905 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.905 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.905 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.905 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.905 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.906 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.907 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.907 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.907 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-09-15T23:24:29.907 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.907 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.907 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.907 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.907 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.907 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.907 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.907 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.907 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.909 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.909 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.909 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.909 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.909 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.909 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.909 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.909 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.909 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.909 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.909 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.909 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.910 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.910 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.910 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.910 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.910 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.910 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.910 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.910 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.910 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.910 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.910 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.910 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.910 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.911 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.911 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.911 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.911 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.911 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.911 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.911 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.911 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.911 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.911 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.911 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.912 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.912 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.912 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.912 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.912 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.912 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.912 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.912 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.912 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.912 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.912 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.912 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.912 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.913 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.914 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.915 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.917 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.918 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.918 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.918 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.918 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.918 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.918 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.918 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.918 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.918 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.918 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.918 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.919 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.920 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T23:24:29.920 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.920 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.920 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.920 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.920 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.920 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.920 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.920 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.920 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.920 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.920 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.921 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.921 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.921 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.921 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.921 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.921 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.921 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.921 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.921 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.921 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.921 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.921 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.921 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.922 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.922 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.922 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.922 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.922 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.922 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.922 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.922 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.922 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.922 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.922 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.922 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.922 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.923 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.923 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.923 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.923 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.923 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.923 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.923 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.923 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.923 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.923 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.923 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.923 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.923 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.924 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.924 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.924 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.924 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.924 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.924 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.924 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.924 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.924 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.924 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.924 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.924 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.925 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.925 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.925 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.925 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.925 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.925 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.925 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.925 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.925 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.925 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.925 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.925 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-09-15T23:24:29.925 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-09-15T23:24:29.926 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.926 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.926 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.926 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.926 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.926 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.926 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.926 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-09-15T23:24:29.926 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-09-15T23:24:29.926 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-09-15T23:24:29.926 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.926 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.927 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.928 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.928 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.928 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.928 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.928 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.928 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.928 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.928 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.928 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.928 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.928 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.928 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.930 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.930 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.930 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.930 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.930 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.930 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.930 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.930 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.930 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.930 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.930 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.930 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.930 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.932 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.932 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.932 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.932 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.932 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.932 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.932 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.932 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.932 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.932 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.932 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.932 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.933 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.934 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.934 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.934 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.934 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.934 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.934 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.934 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.934 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.934 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.934 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.934 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.934 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.934 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.935 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.936 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.937 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.938 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.939 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-09-15T23:24:29.939 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.939 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.939 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.939 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.939 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.939 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.939 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.939 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.939 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.939 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.939 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.939 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.940 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.940 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.940 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.940 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.940 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.940 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.940 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.940 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.940 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.940 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.940 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.941 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.942 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.943 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.944 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.945 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:29.945 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.945 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.945 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.945 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.945 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.945 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.945 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.945 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.945 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-09-15T23:24:29.945 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-09-15T23:24:29.945 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.946 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.946 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.946 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-09-15T23:24:29.946 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-09-15T23:24:29.946 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.946 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.946 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-09-15T23:24:29.946 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T23:24:29.946 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.946 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.946 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.946 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.946 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.947 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.947 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-09-15T23:24:29.947 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.947 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.947 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.947 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-09-15T23:24:29.947 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-09-15T23:24:29.947 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.947 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.947 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.947 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.947 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.947 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.948 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.948 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T23:24:29.948 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.948 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.948 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.948 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-15T23:24:29.948 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-15T23:24:29.948 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.948 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.948 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.948 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.949 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.949 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.949 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.949 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.949 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.949 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.949 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.949 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.949 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.949 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.949 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.949 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.949 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.951 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.951 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.951 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.951 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.951 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.951 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.951 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.951 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.951 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.951 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.951 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.951 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.951 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.952 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.952 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.952 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.952 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.952 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.952 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.952 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.952 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.952 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.952 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.952 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.952 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.953 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.953 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.953 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.953 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.953 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.953 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.953 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.953 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.953 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.953 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.953 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.953 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.953 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.954 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.954 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.954 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.954 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.954 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.954 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.954 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.954 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.954 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.954 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.954 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.954 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.954 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-09-15T23:24:29.955 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-09-15T23:24:29.955 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.955 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.955 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.955 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-09-15T23:24:29.955 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.955 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.955 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.955 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-09-15T23:24:29.955 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.955 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.955 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.955 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.956 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-09-15T23:24:29.956 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-09-15T23:24:29.956 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:29.956 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.956 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.956 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:29.956 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.956 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.956 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.956 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-09-15T23:24:29.956 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.956 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.956 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.957 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.957 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.957 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.957 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.957 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-09-15T23:24:29.957 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.957 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.957 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.957 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-09-15T23:24:29.957 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-09-15T23:24:29.957 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.958 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.958 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.958 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.958 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.958 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.958 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.958 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.958 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.958 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.958 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.958 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.958 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-09-15T23:24:29.958 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.959 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.960 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.960 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.960 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.960 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.960 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.960 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.960 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.960 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.960 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.960 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.960 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.960 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.960 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.961 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.962 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.963 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.964 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.964 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.964 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.964 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.964 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.964 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.964 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.964 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.964 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.964 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.964 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.965 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.965 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-09-15T23:24:29.965 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-09-15T23:24:29.965 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.965 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.965 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.965 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.965 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.965 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.965 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.965 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.965 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T23:24:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T23:24:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-09-15T23:24:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.966 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.967 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.967 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.967 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.967 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-09-15T23:24:29.967 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-09-15T23:24:29.967 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:29.967 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.967 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.967 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-09-15T23:24:29.967 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.967 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.967 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.968 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.968 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.968 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.968 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.968 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.968 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-15T23:24:29.968 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-15T23:24:29.968 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.968 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.968 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.968 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-09-15T23:24:29.968 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.968 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.969 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-09-15T23:24:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-09-15T23:24:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-09-15T23:24:29.971 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-09-15T23:24:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-09-15T23:24:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-09-15T23:24:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-09-15T23:24:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.973 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.973 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.973 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-09-15T23:24:29.973 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-09-15T23:24:29.973 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-09-15T23:24:29.973 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.973 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.973 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.973 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.973 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.973 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.973 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.974 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.974 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.974 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-15T23:24:29.974 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.974 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.974 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.974 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.974 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.974 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.974 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.974 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.974 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.974 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.975 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.975 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.975 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.975 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.975 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.975 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.975 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.975 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.975 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.975 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.975 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.975 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.976 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.976 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.976 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.976 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.976 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.976 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.976 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.976 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.976 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.976 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.976 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.976 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.977 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.977 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.977 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.977 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.977 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.977 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.977 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.977 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.977 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.977 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.977 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.977 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.978 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.978 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.978 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.978 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.978 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.978 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.978 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.978 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.978 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.978 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.978 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.978 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.979 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.979 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.979 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.979 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.979 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.979 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.979 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.979 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.979 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.979 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.979 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.979 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.980 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.981 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-09-15T23:24:29.981 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T23:24:29.981 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.981 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.981 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.981 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.981 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.981 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.981 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.981 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.981 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.981 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.982 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:29.984 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.984 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.984 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.984 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.984 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.984 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.984 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.984 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.984 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-09-15T23:24:29.984 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-09-15T23:24:29.984 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.984 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.984 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.985 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.985 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.985 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.985 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.985 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.985 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.985 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.985 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.985 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.985 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.985 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.985 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.985 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.986 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.986 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.986 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.986 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.986 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.986 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.986 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.986 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.986 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.986 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.986 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.986 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.986 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.987 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.987 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.987 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.987 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.987 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.987 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.987 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.987 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.987 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.987 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.987 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.988 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.988 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.988 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.988 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.988 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.988 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.988 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.988 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.988 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.988 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.988 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.989 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.990 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.990 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.990 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.990 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.990 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.990 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.990 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.990 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.990 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.990 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.990 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.991 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-09-15T23:24:29.991 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-09-15T23:24:29.991 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.991 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.991 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.991 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.991 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.991 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.991 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.991 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.991 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.991 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.992 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.993 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.993 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.993 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:29.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.993 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:29.993 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-09-15T23:24:29.993 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:29.993 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:29.993 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:29.993 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:29.993 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:29.993 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.994 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.995 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.995 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.995 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.995 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.995 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:29.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:29.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.995 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.995 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.995 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.995 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.995 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.995 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:29.996 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:29.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:29.998 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:29.998 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:29.998 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:29.998 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:29.998 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:29.998 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:29.999 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.000 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.000 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.000 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.000 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.000 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.000 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.000 INFO:teuthology.orchestra.run.smithi002.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T23:24:30.000 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T23:24:30.000 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:30.000 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.000 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.000 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:30.001 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.002 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.003 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.004 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.005 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.006 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.007 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.009 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.009 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.009 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.009 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.009 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.009 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.009 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.009 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.009 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.009 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.009 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.009 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.009 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.010 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.011 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.011 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.011 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:30.011 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:30.011 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.011 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.011 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.011 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:30.011 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.011 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.011 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.011 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.012 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.012 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.012 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.012 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.012 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.012 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.012 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.012 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.012 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.012 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.012 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:30.012 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:30.013 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.013 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.013 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.013 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.013 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.013 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.013 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.013 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.013 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.013 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.013 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.013 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-09-15T23:24:30.014 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-09-15T23:24:30.014 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.014 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.014 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.014 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.014 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.014 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.014 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.014 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.014 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.014 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-09-15T23:24:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-09-15T23:24:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-09-15T23:24:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.015 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.016 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.016 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.016 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.016 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-09-15T23:24:30.016 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-09-15T23:24:30.016 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.016 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.016 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.016 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.016 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.016 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.016 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.016 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.017 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.017 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.017 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.017 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.017 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-09-15T23:24:30.017 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-09-15T23:24:30.017 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:30.017 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.017 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.017 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.017 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.017 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.018 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.018 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.018 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.018 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.018 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.018 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.018 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-09-15T23:24:30.018 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-09-15T23:24:30.018 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-09-15T23:24:30.018 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.018 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.018 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.018 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.019 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.019 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.019 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.019 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.019 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.019 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.019 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-09-15T23:24:30.019 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-09-15T23:24:30.019 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.019 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.020 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.020 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.020 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.020 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.020 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.020 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.020 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.020 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.020 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.020 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.020 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-09-15T23:24:30.020 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-09-15T23:24:30.021 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.021 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.021 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.021 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.021 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.021 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.021 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.021 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.021 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.021 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.021 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.021 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.021 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-09-15T23:24:30.022 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-09-15T23:24:30.022 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.022 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.022 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.022 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:30.022 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.022 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.022 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.022 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.022 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.022 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.022 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.022 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.023 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-09-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-09-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.024 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.025 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-09-15T23:24:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-09-15T23:24:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.027 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.028 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.028 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.028 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.028 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.028 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T23:24:30.028 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.028 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.028 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.028 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-09-15T23:24:30.028 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-09-15T23:24:30.028 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.029 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.029 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.029 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.029 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.029 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.029 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.029 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-09-15T23:24:30.029 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.029 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.029 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.029 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.029 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:30.030 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:30.030 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.030 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.030 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.030 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.030 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.030 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.030 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.030 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.030 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.030 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.030 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.031 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.031 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.031 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.031 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.031 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.031 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.031 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.031 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:30.031 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:30.031 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.031 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.031 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.032 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.032 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.032 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.032 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.032 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.032 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.032 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.032 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.032 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.032 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:30.032 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.033 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.034 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:30.035 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:30.036 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.036 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.036 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.036 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.036 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.036 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.036 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.036 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.036 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.036 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.036 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.036 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.036 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.037 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.037 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.037 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.037 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.037 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.037 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:30.037 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:30.037 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.037 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.037 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.037 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.037 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.038 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.038 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.038 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.038 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.038 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.038 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.038 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:30.038 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:30.038 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.038 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.038 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.038 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:30.039 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.039 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.039 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.039 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.039 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.039 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.039 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.039 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.039 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.039 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.039 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.039 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.040 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.041 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.041 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.041 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.041 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.041 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.041 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.041 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-09-15T23:24:30.041 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:30.041 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:30.041 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:30.041 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:30.041 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:30.042 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.042 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.042 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.042 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.042 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.042 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.042 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.042 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.042 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.042 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.042 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.042 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.042 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.043 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.044 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.044 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.044 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.044 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.044 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.044 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:30.044 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:30.044 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.044 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.044 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.044 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:30.044 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.045 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.045 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.045 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.045 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.045 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.045 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.045 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.045 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.045 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.045 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.045 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.045 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.045 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.046 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:30.046 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:30.046 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.046 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.046 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.046 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.046 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.046 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.046 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.046 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.046 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.046 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.047 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.047 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.047 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.047 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.047 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-09-15T23:24:30.047 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:30.047 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:30.047 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:30.047 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-09-15T23:24:30.047 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-09-15T23:24:30.047 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.047 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.048 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.048 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T23:24:30.048 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.048 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.048 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.048 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.048 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.048 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.048 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.048 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:30.048 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:30.048 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:30.049 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.049 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.049 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-09-15T23:24:30.049 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.049 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.049 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.049 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.049 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.049 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.049 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.050 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.051 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.052 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.052 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.052 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.052 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.052 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.052 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.052 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.052 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:30.052 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:30.052 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.052 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.052 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.053 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:30.053 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.053 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.053 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.053 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.053 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.053 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.053 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.053 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.053 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.053 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.053 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.053 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.054 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.054 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.054 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:30.054 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:30.054 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.054 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.054 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.054 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.054 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.054 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.054 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.054 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-09-15T23:24:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.056 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.056 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.056 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:30.056 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.056 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.056 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.056 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T23:24:30.056 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.056 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.056 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.056 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-09-15T23:24:30.056 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-09-15T23:24:30.057 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.057 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.057 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.057 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:30.057 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.057 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.057 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.057 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T23:24:30.057 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.057 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.057 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.057 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-09-15T23:24:30.058 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-09-15T23:24:30.058 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.058 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.058 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.058 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:30.058 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.058 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.058 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.058 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T23:24:30.058 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.058 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.058 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.059 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.060 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-09-15T23:24:30.060 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-09-15T23:24:30.060 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.060 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.060 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.060 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.060 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.060 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.060 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.060 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T23:24:30.060 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.060 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.061 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.062 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.064 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.064 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-09-15T23:24:30.064 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-09-15T23:24:30.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.064 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.064 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.064 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.064 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.064 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.064 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.064 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.065 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.066 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.066 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.066 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.066 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.066 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-09-15T23:24:30.066 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-09-15T23:24:30.066 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:30.066 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.066 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.066 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-09-15T23:24:30.067 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.067 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.067 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.067 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.067 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.067 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.067 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.067 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-09-15T23:24:30.067 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-09-15T23:24:30.067 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.067 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.067 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.068 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.069 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.069 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.069 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.069 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.069 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.069 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.069 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.069 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.069 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.069 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:30.069 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:30.069 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.069 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.070 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.071 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.072 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.072 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.072 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.072 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:30.072 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:30.072 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.072 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.072 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.072 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:30.072 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.072 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.072 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.072 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:30.073 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.074 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.074 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.074 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.074 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.074 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.074 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.074 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.074 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.074 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.074 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.074 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.074 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-09-15T23:24:30.075 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-09-15T23:24:30.075 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.075 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.075 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.075 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.075 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.075 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.075 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.075 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.075 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.075 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.075 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.076 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-09-15T23:24:30.076 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-09-15T23:24:30.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.076 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.076 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.076 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.076 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.076 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.076 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.076 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.076 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.077 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.077 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-09-15T23:24:30.077 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-09-15T23:24:30.077 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.077 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.077 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.077 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T23:24:30.077 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.077 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.077 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.077 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.077 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.078 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.079 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.080 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.080 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.080 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.080 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:30.080 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:30.080 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.080 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.080 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.080 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.080 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.080 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.081 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.081 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.081 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.081 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.081 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.081 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:30.081 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:30.081 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.081 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.081 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.081 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:30.081 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.081 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.082 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.082 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.082 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.082 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.082 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.082 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.082 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.082 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.082 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.082 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.082 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.082 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.083 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.083 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:30.083 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:30.083 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.083 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.083 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.083 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.083 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.083 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.083 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.083 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.083 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.084 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.084 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.084 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.084 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.084 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.084 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.084 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-15T23:24:30.084 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:30.084 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:30.084 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:30.085 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:30.085 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:30.085 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.085 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.085 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.085 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.085 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.085 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.085 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.085 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.085 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.085 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.086 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.086 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.086 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.086 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.086 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.086 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.086 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.086 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.086 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:30.086 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:30.086 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.086 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.087 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.087 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.087 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.087 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.087 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.087 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.087 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.087 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.087 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.087 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.087 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:30.087 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:30.087 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.088 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.089 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.090 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.090 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.090 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.090 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.090 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.090 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-09-15T23:24:30.090 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-09-15T23:24:30.090 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:30.090 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.090 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.090 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-09-15T23:24:30.090 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.090 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.091 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.091 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T23:24:30.091 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.091 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.091 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.091 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.091 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-09-15T23:24:30.091 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-09-15T23:24:30.091 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.091 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.091 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.091 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.091 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.092 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.092 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.092 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-09-15T23:24:30.092 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.092 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.092 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.092 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.092 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-09-15T23:24:30.092 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-09-15T23:24:30.092 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:30.092 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.092 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.092 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-09-15T23:24:30.093 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.093 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.093 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.093 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T23:24:30.093 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.093 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.093 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.093 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.093 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-09-15T23:24:30.093 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T23:24:30.093 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.093 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.094 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.094 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-09-15T23:24:30.094 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.094 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.094 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.094 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T23:24:30.094 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.094 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.094 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.094 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.094 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.094 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.094 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.095 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-09-15T23:24:30.095 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-09-15T23:24:30.095 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-09-15T23:24:30.095 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-09-15T23:24:30.095 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-09-15T23:24:30.095 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-09-15T23:24:30.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-09-15T23:24:30.095 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.095 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-09-15T23:24:30.095 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.095 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.095 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.096 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.096 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.096 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.096 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.096 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.096 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-09-15T23:24:30.096 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-09-15T23:24:30.096 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.096 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.096 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.096 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.096 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.096 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.097 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.097 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.097 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.097 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.097 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.097 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.097 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-09-15T23:24:30.097 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-09-15T23:24:30.097 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-09-15T23:24:30.097 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.097 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.097 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.098 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.099 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.099 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.099 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.099 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.099 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.099 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.099 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.099 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.099 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.099 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.099 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.099 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-09-15T23:24:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-09-15T23:24:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.100 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.101 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.101 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.101 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.101 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-09-15T23:24:30.101 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-09-15T23:24:30.101 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.101 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.101 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.101 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-09-15T23:24:30.101 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.102 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-09-15T23:24:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-09-15T23:24:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-09-15T23:24:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-09-15T23:24:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-09-15T23:24:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.103 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-09-15T23:24:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-09-15T23:24:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-09-15T23:24:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.104 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.105 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.105 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.105 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-09-15T23:24:30.105 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-09-15T23:24:30.105 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-09-15T23:24:30.105 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.105 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.105 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-09-15T23:24:30.105 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.105 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.105 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.105 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.106 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.106 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.106 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.106 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.106 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-09-15T23:24:30.106 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-09-15T23:24:30.106 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-09-15T23:24:30.106 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-09-15T23:24:30.106 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-09-15T23:24:30.106 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: "services": { 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard": "https://172.21.15.2:8443/" 2024-09-15T23:24:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: "always_on_modules": { 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: "octopus": [ 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: "pacific": [ 2024-09-15T23:24:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-15T23:24:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-15T23:24:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-15T23:24:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-15T23:24:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-15T23:24:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-15T23:24:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-15T23:24:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-15T23:24:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-15T23:24:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-15T23:24:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: "quincy": [ 2024-09-15T23:24:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "reef": [ 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-15T23:24:30.110 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: "squid": [ 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-09-15T23:24:30.111 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-09-15T23:24:30.112 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-09-15T23:24:30.112 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-09-15T23:24:30.112 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-09-15T23:24:30.112 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-09-15T23:24:30.112 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-15T23:24:30.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.112 INFO:teuthology.orchestra.run.smithi002.stdout: "last_failure_osd_epoch": 84, 2024-09-15T23:24:30.112 INFO:teuthology.orchestra.run.smithi002.stdout: "active_clients": [ 2024-09-15T23:24:30.112 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.112 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-09-15T23:24:30.112 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-15T23:24:30.112 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.112 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1965703189 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "libcephsqlite", 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 217162278 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.113 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 545710353 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-15T23:24:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1180986822 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-15T23:24:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 4186950499 2024-09-15T23:24:30.116 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.116 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-15T23:24:30.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.116 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.116 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-09-15T23:24:30.116 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-09-15T23:24:30.116 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-15T23:24:30.116 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-09-15T23:24:30.116 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-15T23:24:30.116 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3076191605 2024-09-15T23:24:30.116 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.116 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-15T23:24:30.117 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.117 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-15T23:24:30.117 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-15T23:24:30.118 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:29 smithi112 ceph-mon[34367]: pgmap v315: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:30.118 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:29 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1416501789' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T23:24:30.118 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:29 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3975645271' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T23:24:30.118 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:29 smithi145 ceph-mon[34901]: pgmap v315: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:30.119 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:29 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1416501789' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T23:24:30.119 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:29 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3975645271' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T23:24:30.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.653+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/3975645271 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f1af00a3440 msgr2=0x7f1af00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.653+0000 7f1b0c0b7640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f1af00a3440 0x7f1af00a5900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000bbe0 tx=0x7f1b0000b390 comp rx=0 tx=0).stop 2024-09-15T23:24:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.653+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/3975645271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b04103610 msgr2=0x7f1b04100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.653+0000 7f1b0c0b7640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b04103610 0x7f1b04100e80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1af4005940 tx=0x7f1af40042f0 comp rx=0 tx=0).stop 2024-09-15T23:24:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.653+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/3975645271 shutdown_connections 2024-09-15T23:24:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.653+0000 7f1b0c0b7640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f1af00a3440 0x7f1af00a5900 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.653+0000 7f1b0c0b7640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b0410c0c0 0x7f1b041013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.653+0000 7f1b0c0b7640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b04103610 0x7f1b04100e80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.653+0000 7f1b0c0b7640 1 --2- 172.21.15.2:0/3975645271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b04102cf0 0x7f1b04100940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.653+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/3975645271 >> 172.21.15.2:0/3975645271 conn(0x7f1b04077a10 msgr2=0x7f1b040fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.653+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/3975645271 shutdown_connections 2024-09-15T23:24:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:28.653+0000 7f1b0c0b7640 1 -- 172.21.15.2:0/3975645271 wait complete. 2024-09-15T23:24:30.127 DEBUG:tasks.check_counter:Getting stats from a 2024-09-15T23:24:30.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-15T23:24:30.128 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:29 smithi002 ceph-mon[31019]: pgmap v315: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:30.128 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:29 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1416501789' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T23:24:30.128 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:29 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3975645271' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T23:24:30.394 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:24:30.933 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-15T23:24:30.933 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:24:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 206, 2024-09-15T23:24:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 195, 2024-09-15T23:24:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1582128, 2024-09-15T23:24:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 119584, 2024-09-15T23:24:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-15T23:24:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-15T23:24:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.038378026, 2024-09-15T23:24:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.013419230, 2024-09-15T23:24:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.036091472, 2024-09-15T23:24:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 194, 2024-09-15T23:24:30.934 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.009315609, 2024-09-15T23:24:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000048018 2024-09-15T23:24:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1582128, 2024-09-15T23:24:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 119584 2024-09-15T23:24:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:24:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-09-15T23:24:30.935 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 149, 2024-09-15T23:24:30.936 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-09-15T23:24:30.936 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 183264, 2024-09-15T23:24:30.936 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-15T23:24:30.936 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-15T23:24:30.936 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.012144318, 2024-09-15T23:24:30.936 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.007800776, 2024-09-15T23:24:30.936 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002371572, 2024-09-15T23:24:30.936 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:30.936 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:30.936 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 146, 2024-09-15T23:24:30.936 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.011423107, 2024-09-15T23:24:30.936 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000078240 2024-09-15T23:24:30.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 183264 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 4, 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 4, 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 2944, 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 448, 2024-09-15T23:24:30.937 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.002900802, 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000045240, 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002845811, 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 3, 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.005071323, 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.001690441 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:30.938 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:24:30.939 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-15T23:24:30.940 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:24:30.941 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:24:30.941 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:24:30.941 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:24:30.941 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:24:30.941 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:24:30.941 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:24:30.941 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-15T23:24:30.941 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:24:30.941 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:24:30.941 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:24:30.941 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-15T23:24:30.941 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-15T23:24:30.941 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 150008, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 31, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:24:30.942 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:30.943 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 208, 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1553071, 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 208, 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 208, 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1553071, 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:30.944 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:30.945 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:30.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:30.945 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-15T23:24:31.441 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:31 smithi002 ceph-mon[31019]: pgmap v316: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:31.608 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:31 smithi112 ceph-mon[34367]: pgmap v316: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:31.608 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:31 smithi145 ceph-mon[34901]: pgmap v316: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:31.885 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-15T23:24:31.885 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-15T23:24:31.885 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-15T23:24:31.885 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-15T23:24:31.885 DEBUG:tasks.check_counter:Getting stats from d 2024-09-15T23:24:31.886 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-15T23:24:32.145 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:24:32.669 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-15T23:24:32.669 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:24:32.669 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-09-15T23:24:32.669 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-09-15T23:24:32.669 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-09-15T23:24:32.669 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-09-15T23:24:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-15T23:24:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-15T23:24:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.001389318, 2024-09-15T23:24:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T23:24:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000322677, 2024-09-15T23:24:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:32.670 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 211, 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 200, 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1583488, 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 122784, 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-15T23:24:32.671 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.041750413, 2024-09-15T23:24:32.672 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.013035024, 2024-09-15T23:24:32.672 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.042462142, 2024-09-15T23:24:32.672 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:32.672 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:32.672 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 199, 2024-09-15T23:24:32.672 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.010005313, 2024-09-15T23:24:32.672 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000050277 2024-09-15T23:24:32.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:32.672 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:32.672 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:32.672 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:32.672 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:32.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1583488, 2024-09-15T23:24:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 122784 2024-09-15T23:24:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:24:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 6, 2024-09-15T23:24:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 155, 2024-09-15T23:24:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3264, 2024-09-15T23:24:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 184416, 2024-09-15T23:24:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-15T23:24:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-15T23:24:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.015213260, 2024-09-15T23:24:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.008953630, 2024-09-15T23:24:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.004040144, 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 153, 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.015032970, 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000098254 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 184416 2024-09-15T23:24:32.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:32.675 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-15T23:24:32.675 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-15T23:24:32.675 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-15T23:24:32.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:32.675 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-15T23:24:32.675 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:24:32.675 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-15T23:24:32.675 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:24:32.675 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:24:32.676 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:24:32.676 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:24:32.676 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:24:32.676 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:24:32.676 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:24:32.676 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:24:32.676 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:24:32.676 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:24:32.676 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:24:32.676 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:24:32.676 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:24:32.676 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-15T23:24:32.677 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:24:32.677 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-15T23:24:32.677 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:24:32.677 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:24:32.677 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:24:32.677 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:24:32.677 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:24:32.677 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:24:32.677 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:24:32.677 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-15T23:24:32.677 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148977, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 30, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-15T23:24:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-15T23:24:32.679 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 213, 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1553721, 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 213, 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-15T23:24:32.680 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-15T23:24:32.681 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 213, 2024-09-15T23:24:32.681 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1553721, 2024-09-15T23:24:32.681 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-15T23:24:32.681 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:32.681 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:32.681 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:32.681 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:32.681 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:32.681 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-15T23:24:33.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:33 smithi002 ceph-mon[31019]: pgmap v317: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:33.363 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-15T23:24:33.363 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-15T23:24:33.363 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-15T23:24:33.363 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-15T23:24:33.363 DEBUG:tasks.check_counter:Getting stats from g 2024-09-15T23:24:33.364 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-15T23:24:33.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:33 smithi145 ceph-mon[34901]: pgmap v317: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:33.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:33 smithi112 ceph-mon[34367]: pgmap v317: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:33.621 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:24:34.247 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-15T23:24:34.247 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:24:34.247 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 211, 2024-09-15T23:24:34.247 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 198, 2024-09-15T23:24:34.247 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1585344, 2024-09-15T23:24:34.247 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 120672, 2024-09-15T23:24:34.247 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-15T23:24:34.247 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-15T23:24:34.247 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.042700901, 2024-09-15T23:24:34.248 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.012750235, 2024-09-15T23:24:34.248 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.042765632, 2024-09-15T23:24:34.248 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:34.248 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:34.248 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 198, 2024-09-15T23:24:34.248 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.013407642, 2024-09-15T23:24:34.248 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000067715 2024-09-15T23:24:34.248 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:34.248 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:34.248 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:34.248 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:34.248 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:34.249 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:34.249 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1585344, 2024-09-15T23:24:34.249 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 120672 2024-09-15T23:24:34.249 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:34.249 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:24:34.249 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-09-15T23:24:34.249 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 150, 2024-09-15T23:24:34.249 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-09-15T23:24:34.249 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 183440, 2024-09-15T23:24:34.249 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-15T23:24:34.249 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-15T23:24:34.249 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.012748052, 2024-09-15T23:24:34.250 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.008253900, 2024-09-15T23:24:34.250 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.002185404, 2024-09-15T23:24:34.250 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:34.250 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:34.250 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 147, 2024-09-15T23:24:34.250 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.011665593, 2024-09-15T23:24:34.250 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000079357 2024-09-15T23:24:34.250 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:34.250 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:34.251 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:34.251 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:34.251 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:34.251 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:34.251 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T23:24:34.251 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 183440 2024-09-15T23:24:34.251 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:34.251 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:24:34.251 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-09-15T23:24:34.252 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-09-15T23:24:34.252 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-09-15T23:24:34.252 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-09-15T23:24:34.252 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-15T23:24:34.252 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-15T23:24:34.252 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.000275614, 2024-09-15T23:24:34.252 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T23:24:34.252 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000171282, 2024-09-15T23:24:34.252 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:34.252 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:34.253 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:34.253 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:34.253 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:34.253 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:34.253 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:34.253 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:34.253 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:34.253 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:34.253 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:34.253 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:24:34.253 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:24:34.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:34.254 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-15T23:24:34.254 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-15T23:24:34.254 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-15T23:24:34.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:34.254 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-15T23:24:34.254 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:24:34.254 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-15T23:24:34.254 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:24:34.254 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:24:34.254 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:24:34.254 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:24:34.255 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:24:34.255 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:24:34.255 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:24:34.255 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:24:34.255 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:24:34.255 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:24:34.255 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:24:34.255 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:24:34.255 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:24:34.255 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-15T23:24:34.256 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:24:34.256 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-15T23:24:34.256 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:24:34.256 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:24:34.256 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:24:34.256 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:24:34.256 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:24:34.256 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:24:34.256 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:24:34.256 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-15T23:24:34.256 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:24:34.257 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:24:34.257 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:24:34.257 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-15T23:24:34.257 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-15T23:24:34.257 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-15T23:24:34.257 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:24:34.257 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:24:34.257 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:24:34.257 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:24:34.257 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148977, 2024-09-15T23:24:34.257 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 30, 2024-09-15T23:24:34.257 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:24:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-15T23:24:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-15T23:24:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-15T23:24:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:24:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-15T23:24:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:24:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-15T23:24:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-15T23:24:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-15T23:24:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:24:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:24:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-15T23:24:34.258 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-15T23:24:34.259 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-15T23:24:34.259 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-15T23:24:34.259 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-15T23:24:34.259 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-15T23:24:34.259 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-15T23:24:34.259 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-15T23:24:34.259 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:34.259 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:24:34.259 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-15T23:24:34.259 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-15T23:24:34.259 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-15T23:24:34.259 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 209, 2024-09-15T23:24:34.260 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1553201, 2024-09-15T23:24:34.260 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:34.260 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 209, 2024-09-15T23:24:34.260 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-15T23:24:34.260 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-15T23:24:34.260 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 209, 2024-09-15T23:24:34.260 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1553201, 2024-09-15T23:24:34.260 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-15T23:24:34.260 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:34.261 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:34.261 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:34.261 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:34.262 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:34.262 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-15T23:24:34.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:34 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:34.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:34 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:34.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:34 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:34.943 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-15T23:24:34.944 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-15T23:24:34.944 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-15T23:24:34.944 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-15T23:24:34.944 DEBUG:tasks.check_counter:Getting stats from j 2024-09-15T23:24:34.944 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-15T23:24:35.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:35 smithi145 ceph-mon[34901]: pgmap v318: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:35.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:35 smithi112 ceph-mon[34367]: pgmap v318: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:35.505 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:35 smithi002 ceph-mon[31019]: pgmap v318: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:24:36.473 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-15T23:24:36.473 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:24:36.473 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 213, 2024-09-15T23:24:36.473 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 202, 2024-09-15T23:24:36.474 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1584032, 2024-09-15T23:24:36.474 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 124064, 2024-09-15T23:24:36.474 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-09-15T23:24:36.474 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-09-15T23:24:36.474 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.043749118, 2024-09-15T23:24:36.474 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.013620205, 2024-09-15T23:24:36.474 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.043455518, 2024-09-15T23:24:36.474 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:36.474 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:36.474 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 201, 2024-09-15T23:24:36.474 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.009886360, 2024-09-15T23:24:36.474 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000049185 2024-09-15T23:24:36.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1584032, 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 124064 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 6, 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 157, 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3264, 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 184768, 2024-09-15T23:24:36.475 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.016131932, 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.009137244, 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.004437262, 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 155, 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.013445388, 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000086744 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:36.476 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 184768 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.000378737, 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T23:24:36.477 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000306068, 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:24:36.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:24:36.479 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:24:36.480 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:24:36.481 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 149011, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 32, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-09-15T23:24:36.482 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 215, 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1553981, 2024-09-15T23:24:36.483 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:36.484 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 215, 2024-09-15T23:24:36.484 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-09-15T23:24:36.484 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-09-15T23:24:36.484 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 215, 2024-09-15T23:24:36.484 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1553981, 2024-09-15T23:24:36.484 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-09-15T23:24:36.484 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-09-15T23:24:36.484 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-09-15T23:24:36.484 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-09-15T23:24:36.484 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:36.484 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-15T23:24:36.484 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-15T23:24:36.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:36 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:36 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:36 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:36 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:36 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:36 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:36 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:36 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:36 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:36 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:36 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:36 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:36 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:36.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:36 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:36.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:36 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:36.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:36 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:36.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:36 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:36 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:36 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:36 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:36 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:36 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:36 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:36 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:36 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:36.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:36 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:36.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:36 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:36.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:36 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:36.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:36 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:36 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:36 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:36 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:36 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:36 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:36 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:36.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:36 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:37.187 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-15T23:24:37.187 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-15T23:24:37.187 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-15T23:24:37.187 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-15T23:24:37.187 DEBUG:tasks.check_counter:Getting stats from b 2024-09-15T23:24:37.187 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-15T23:24:37.445 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:24:37.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:37 smithi112 ceph-mon[34367]: pgmap v319: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:37.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:37 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi112 to 176.0M 2024-09-15T23:24:37.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:37 smithi112 ceph-mon[34367]: Unable to set osd_memory_target on smithi112 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-15T23:24:37.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:37 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-15T23:24:37.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:37 smithi112 ceph-mon[34367]: Unable to set osd_memory_target on smithi145 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-15T23:24:37.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:37 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:37.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:37 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:37.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:37 smithi002 ceph-mon[31019]: pgmap v319: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:37.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:37 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi112 to 176.0M 2024-09-15T23:24:37.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:37 smithi002 ceph-mon[31019]: Unable to set osd_memory_target on smithi112 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-15T23:24:37.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:37 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-15T23:24:37.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:37 smithi002 ceph-mon[31019]: Unable to set osd_memory_target on smithi145 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-15T23:24:37.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:37 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:37.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:37 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:37.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:37 smithi145 ceph-mon[34901]: pgmap v319: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:37.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:37 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi112 to 176.0M 2024-09-15T23:24:37.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:37 smithi145 ceph-mon[34901]: Unable to set osd_memory_target on smithi112 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-15T23:24:37.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:37 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-15T23:24:37.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:37 smithi145 ceph-mon[34901]: Unable to set osd_memory_target on smithi145 to 184563814: error parsing value: Value '184563814' is below minimum 939524096 2024-09-15T23:24:37.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:37 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:37.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:37 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:37.999 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:24:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:24:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 9533, 2024-09-15T23:24:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 8986, 2024-09-15T23:24:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 2725449, 2024-09-15T23:24:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 166879552, 2024-09-15T23:24:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 12, 2024-09-15T23:24:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 5, 2024-09-15T23:24:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 1.087360500, 2024-09-15T23:24:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.521566304, 2024-09-15T23:24:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.169439596, 2024-09-15T23:24:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.346316447, 2024-09-15T23:24:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 8984, 2024-09-15T23:24:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 3.396880352, 2024-09-15T23:24:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000378103 2024-09-15T23:24:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 833, 2024-09-15T23:24:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000124338, 2024-09-15T23:24:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000149 2024-09-15T23:24:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 303984, 2024-09-15T23:24:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 87536 2024-09-15T23:24:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:24:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 9550, 2024-09-15T23:24:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 9398, 2024-09-15T23:24:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 3859954, 2024-09-15T23:24:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 204954027, 2024-09-15T23:24:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 10, 2024-09-15T23:24:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 4, 2024-09-15T23:24:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.980403241, 2024-09-15T23:24:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.515905229, 2024-09-15T23:24:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.144797347, 2024-09-15T23:24:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.271321740, 2024-09-15T23:24:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 9396, 2024-09-15T23:24:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2.570705368, 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000273595 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 207, 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000030689, 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000148 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 89392, 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 129184 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 655271, 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 137128, 2024-09-15T23:24:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 230637857, 2024-09-15T23:24:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 107635095, 2024-09-15T23:24:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 10, 2024-09-15T23:24:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 6, 2024-09-15T23:24:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 16.689338145, 2024-09-15T23:24:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 6.587080671, 2024-09-15T23:24:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 15.034966847, 2024-09-15T23:24:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.154881899, 2024-09-15T23:24:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 137127, 2024-09-15T23:24:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 3.681861852, 2024-09-15T23:24:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000026850 2024-09-15T23:24:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 764956, 2024-09-15T23:24:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.065869034, 2024-09-15T23:24:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000086 2024-09-15T23:24:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 1667904, 2024-09-15T23:24:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 471296 2024-09-15T23:24:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-09-15T23:24:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 1, 2024-09-15T23:24:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-09-15T23:24:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MDSRank": { 2024-09-15T23:24:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-09-15T23:24:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-09-15T23:24:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 7411, 2024-09-15T23:24:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 30.395903881, 2024-09-15T23:24:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.004101457 2024-09-15T23:24:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-PurgeQueue": { 2024-09-15T23:24:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-09-15T23:24:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-09-15T23:24:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 12101, 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2.276406512, 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000188117 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "request": 53734, 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": 53734, 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "reply_latency": { 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 53734, 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 409.620567383, 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.007623116 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_reply": 0, 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "forward": 0, 2024-09-15T23:24:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_complete": 0, 2024-09-15T23:24:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_keys": 0, 2024-09-15T23:24:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_commit": 583, 2024-09-15T23:24:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_split": 34, 2024-09-15T23:24:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_merge": 0, 2024-09-15T23:24:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes": 14853, 2024-09-15T23:24:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_top": 1980, 2024-09-15T23:24:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_bottom": 12873, 2024-09-15T23:24:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pin_tail": 0, 2024-09-15T23:24:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pinned": 11710, 2024-09-15T23:24:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_expired": 0, 2024-09-15T23:24:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_with_caps": 5, 2024-09-15T23:24:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": 6, 2024-09-15T23:24:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "subtrees": 2, 2024-09-15T23:24:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse": 64989, 2024-09-15T23:24:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_hit": 64704, 2024-09-15T23:24:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_forward": 0, 2024-09-15T23:24:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_discover": 0, 2024-09-15T23:24:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_dir_fetch": 0, 2024-09-15T23:24:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_remote_ino": 0, 2024-09-15T23:24:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_lock": 0, 2024-09-15T23:24:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "load_cent": 0, 2024-09-15T23:24:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "q": 0, 2024-09-15T23:24:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "exported": 0, 2024-09-15T23:24:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "exported_inodes": 0, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "imported": 0, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "imported_inodes": 0, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_dir_fetch": 0, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_backtrace_fetch": 0, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_peer_discover": 0, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rfiles": 4, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rbytes": 234, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rsnaps": 6, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_set_tag": 0, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_inodes": 0, 2024-09-15T23:24:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_file_inodes": 0, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_inode_file_caps": 0, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_revoke": 13909, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_grant": 26349, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_trunc": 5, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps": 596299, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps_dirty": 10870, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_cap_release": 343, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "process_request_cap_release": 59138 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache": { 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update": 0, 2024-09-15T23:24:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update_receipt": 0, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_try_discover": 0, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_send_discover": 0, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_handle_discover": 0, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays": 46, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_delayed": 0, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_created": 10721, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_enqueued": 10675, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_reintegrated": 0, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_migrated": 0, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_processing": 0, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:24:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_started": 0, 2024-09-15T23:24:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_completed": 0, 2024-09-15T23:24:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_path": 0, 2024-09-15T23:24:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_inode": 0, 2024-09-15T23:24:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T23:24:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_exportdir": 0, 2024-09-15T23:24:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_flush": 0, 2024-09-15T23:24:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragmentdir": 34, 2024-09-15T23:24:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragstats": 0, 2024-09-15T23:24:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_inodestats": 0 2024-09-15T23:24:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log": { 2024-09-15T23:24:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "evlrg": 0, 2024-09-15T23:24:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "evadd": 231322, 2024-09-15T23:24:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "evex": 125620, 2024-09-15T23:24:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "evtrm": 122901, 2024-09-15T23:24:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "ev": 108421, 2024-09-15T23:24:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "evexg": 0, 2024-09-15T23:24:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "evexd": 2719, 2024-09-15T23:24:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "segadd": 279, 2024-09-15T23:24:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "segex": 151, 2024-09-15T23:24:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "segtrm": 148, 2024-09-15T23:24:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "seg": 131, 2024-09-15T23:24:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "segmjr": 9, 2024-09-15T23:24:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "segexg": 0, 2024-09-15T23:24:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "segexd": 3, 2024-09-15T23:24:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "expos": 208643605, 2024-09-15T23:24:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "wrpos": 406995118, 2024-09-15T23:24:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "rdpos": 0, 2024-09-15T23:24:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "jlat": { 2024-09-15T23:24:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 3357, 2024-09-15T23:24:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 16.348355613, 2024-09-15T23:24:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.004869930 2024-09-15T23:24:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "replayed": 0 2024-09-15T23:24:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mem": { 2024-09-15T23:24:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 7654, 2024-09-15T23:24:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "ino+": 18329, 2024-09-15T23:24:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "ino-": 10675, 2024-09-15T23:24:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "dir": 295, 2024-09-15T23:24:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "dir+": 342, 2024-09-15T23:24:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "dir-": 47, 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "dn": 14853, 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "dn+": 31289, 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "dn-": 16436, 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "cap": 6, 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "cap+": 10742, 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "cap-": 10736, 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "rss": 118240, 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "heap": 231712 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server": { 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_client_request": 57275, 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_server_request": 0, 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_request": 53734, 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_session": 31, 2024-09-15T23:24:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_peer_request": 0, 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "req_create_latency": { 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 10670, 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 17.418735191, 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001632496 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getattr_latency": { 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 726, 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 1.907638818, 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.002627601 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getfilelock_latency": { 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "req_link_latency": { 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookup_latency": { 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 5, 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.001471404, 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000294280 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookuphash_latency": { 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupino_latency": { 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupname_latency": { 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupparent_latency": { 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupsnap_latency": { 2024-09-15T23:24:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lssnap_latency": { 2024-09-15T23:24:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 10, 2024-09-15T23:24:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.001659153, 2024-09-15T23:24:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000165915 2024-09-15T23:24:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mkdir_latency": { 2024-09-15T23:24:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 58, 2024-09-15T23:24:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.063174107, 2024-09-15T23:24:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001089208 2024-09-15T23:24:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mknod_latency": { 2024-09-15T23:24:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mksnap_latency": { 2024-09-15T23:24:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 10, 2024-09-15T23:24:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.546414903, 2024-09-15T23:24:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.054641490 2024-09-15T23:24:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "req_open_latency": { 2024-09-15T23:24:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 24615, 2024-09-15T23:24:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 20.441157630, 2024-09-15T23:24:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000830435 2024-09-15T23:24:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "req_readdir_latency": { 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 524, 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.795034998, 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001517242 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rename_latency": { 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 10292, 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 354.129164382, 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.034408197 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "req_renamesnap_latency": { 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "req_snapdiff_latency": { 2024-09-15T23:24:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmdir_latency": { 2024-09-15T23:24:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 52, 2024-09-15T23:24:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 4.416850235, 2024-09-15T23:24:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.084939427 2024-09-15T23:24:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmsnap_latency": { 2024-09-15T23:24:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 4, 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.047549280, 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.011887320 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmxattr_latency": { 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setattr_latency": { 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1, 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000784709, 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000784709 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setdirlayout_latency": { 2024-09-15T23:24:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setfilelock_latency": { 2024-09-15T23:24:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setlayout_latency": { 2024-09-15T23:24:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setxattr_latency": { 2024-09-15T23:24:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 7, 2024-09-15T23:24:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.016869388, 2024-09-15T23:24:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.002409912 2024-09-15T23:24:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "req_symlink_latency": { 2024-09-15T23:24:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 3, 2024-09-15T23:24:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.002136365, 2024-09-15T23:24:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000712121 2024-09-15T23:24:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "req_unlink_latency": { 2024-09-15T23:24:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 6757, 2024-09-15T23:24:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 9.831926820, 2024-09-15T23:24:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001455072 2024-09-15T23:24:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:24:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:24:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getvxattr_latency": { 2024-09-15T23:24:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessions": { 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "session_count": 2, 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "session_add": 5, 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "session_remove": 3, 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_open": 2, 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_stale": 0, 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "total_load": 1971, 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "average_load": 985, 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "avg_session_uptime": 595, 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "mdthresh_evicted": 0 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-09-15T23:24:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:24:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:24:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 684824, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 209, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-09-15T23:24:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 8416, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 185, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 27328316, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 158733, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-09-15T23:24:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-09-15T23:24:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-09-15T23:24:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2024-09-15T23:24:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2024-09-15T23:24:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2024-09-15T23:24:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 22301, 2024-09-15T23:24:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 416650983, 2024-09-15T23:24:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 37, 2024-09-15T23:24:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 22301, 2024-09-15T23:24:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "op_latency": { 2024-09-15T23:24:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 22301, 2024-09-15T23:24:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 167.124624477, 2024-09-15T23:24:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.007494041 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "op_inflight": 0, 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 22301, 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 34109 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 22301, 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 626, 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 21675, 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 246, 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 5011, 2024-09-15T23:24:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 626, 2024-09-15T23:24:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 3983, 2024-09-15T23:24:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 350, 2024-09-15T23:24:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2024-09-15T23:24:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2024-09-15T23:24:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 0, 2024-09-15T23:24:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 34, 2024-09-15T23:24:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 11339, 2024-09-15T23:24:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2024-09-15T23:24:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2024-09-15T23:24:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2024-09-15T23:24:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 0, 2024-09-15T23:24:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 10022, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 5, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2024-09-15T23:24:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 94, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2024-09-15T23:24:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 13, 2024-09-15T23:24:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 12, 2024-09-15T23:24:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 12, 2024-09-15T23:24:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2024-09-15T23:24:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2024-09-15T23:24:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 1867, 2024-09-15T23:24:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 0, 2024-09-15T23:24:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 626 2024-09-15T23:24:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "oft": { 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_objs": 1, 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_updates": 0, 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_removes": 0 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "osd-slow-ops": { 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_ops_count": 0 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "purge_queue": { 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops": 0, 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops_high_water": 40, 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing": 0, 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_high_water": 32, 2024-09-15T23:24:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed_ops": 10683, 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed": 10675, 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_item_in_journal": 0 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 674350, 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 176468772, 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 674350, 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 674350, 2024-09-15T23:24:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 176468772, 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-15T23:24:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 22301, 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 417891334, 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 22301, 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 417891334, 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-15T23:24:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-15T23:24:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-15T23:24:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 22301, 2024-09-15T23:24:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 22301, 2024-09-15T23:24:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 22301, 2024-09-15T23:24:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 22301, 2024-09-15T23:24:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T23:24:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:24:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 10675, 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 1240351, 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 10675, 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 626, 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 1240351, 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle-0x562bd8856960": { 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 231322, 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 402800814, 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 231322, 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 3357, 2024-09-15T23:24:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 402800814, 2024-09-15T23:24:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T23:24:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:38.049 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:24:38.609 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:38 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:38.609 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:38 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:38.609 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:38 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:38.610 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:38 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:38.610 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:38 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:38.610 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:38 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:38.610 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:38 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:38.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:38 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:38.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:38 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:38.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:38 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:38.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:38 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:38.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:38 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:38.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:38 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:38.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:38 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:38.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:38 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:38.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:38 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:38.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:38 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:38.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:38 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:38.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:38 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:38.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:38 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:38.958 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:38 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' 2024-09-15T23:24:38.962 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-15T23:24:38.962 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-15T23:24:38.962 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-15T23:24:38.963 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=34 2024-09-15T23:24:38.963 DEBUG:tasks.check_counter:Getting stats from e 2024-09-15T23:24:38.963 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-15T23:24:39.216 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:24:39.655 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:39 smithi112 ceph-mon[34367]: pgmap v320: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:39.655 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:39 smithi112 ceph-mon[34367]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-15T23:24:39.655 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:39 smithi112 ceph-mon[34367]: Unable to set osd_memory_target on smithi002 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-15T23:24:39.764 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:24:39.764 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:24:39.764 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 0, 2024-09-15T23:24:39.765 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 2, 2024-09-15T23:24:39.765 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 0, 2024-09-15T23:24:39.765 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 0, 2024-09-15T23:24:39.765 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 4, 2024-09-15T23:24:39.765 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 0, 2024-09-15T23:24:39.765 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.001048737, 2024-09-15T23:24:39.766 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T23:24:39.766 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.000219072, 2024-09-15T23:24:39.766 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:39.766 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:39.766 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:39.766 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:39.767 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:39.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:39.767 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:39.767 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:39.767 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:39.768 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:39.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:39.768 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:24:39.768 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:24:39.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:39.768 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:24:39.769 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 212, 2024-09-15T23:24:39.769 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 201, 2024-09-15T23:24:39.769 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 1583760, 2024-09-15T23:24:39.769 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 123424, 2024-09-15T23:24:39.769 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 2, 2024-09-15T23:24:39.770 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 1, 2024-09-15T23:24:39.770 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.038714748, 2024-09-15T23:24:39.770 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.013260892, 2024-09-15T23:24:39.770 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.039588281, 2024-09-15T23:24:39.770 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:39.770 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:39.771 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 200, 2024-09-15T23:24:39.771 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.010381662, 2024-09-15T23:24:39.771 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000051908 2024-09-15T23:24:39.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:39.771 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:39.771 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:39.772 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:39.772 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:39.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:39.772 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 1583760, 2024-09-15T23:24:39.772 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 123424 2024-09-15T23:24:39.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:39.773 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:24:39.773 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 6, 2024-09-15T23:24:39.773 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 157, 2024-09-15T23:24:39.773 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 3264, 2024-09-15T23:24:39.773 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 184768, 2024-09-15T23:24:39.773 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 5, 2024-09-15T23:24:39.773 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 3, 2024-09-15T23:24:39.774 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.011814005, 2024-09-15T23:24:39.774 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.006297374, 2024-09-15T23:24:39.774 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.003761166, 2024-09-15T23:24:39.774 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:39.774 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:39.774 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 155, 2024-09-15T23:24:39.774 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.019671031, 2024-09-15T23:24:39.774 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000126909 2024-09-15T23:24:39.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:39.774 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:39.774 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:39.775 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:39.775 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:39.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:39.775 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-15T23:24:39.775 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 184768 2024-09-15T23:24:39.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:39.775 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-09-15T23:24:39.775 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 0, 2024-09-15T23:24:39.775 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-09-15T23:24:39.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:39.775 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-09-15T23:24:39.776 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:24:39.776 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-09-15T23:24:39.776 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:24:39.776 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:24:39.776 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:24:39.776 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:24:39.776 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:24:39.776 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:24:39.777 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:24:39.778 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:24:39.778 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:24:39.778 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:24:39.778 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-09-15T23:24:39.778 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:24:39.778 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:24:39.778 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:24:39.778 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-09-15T23:24:39.778 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-09-15T23:24:39.778 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-09-15T23:24:39.778 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 148977, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 30, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-09-15T23:24:39.779 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 0, 2024-09-15T23:24:39.780 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 0, 2024-09-15T23:24:39.780 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:24:39.780 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:24:39.780 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-09-15T23:24:39.780 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-09-15T23:24:39.780 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 928, 2024-09-15T23:24:39.780 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 2, 2024-09-15T23:24:39.781 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-09-15T23:24:39.781 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-09-15T23:24:39.781 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-09-15T23:24:39.781 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-09-15T23:24:39.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:39.781 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:24:39.782 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T23:24:39.782 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-15T23:24:39.782 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T23:24:39.782 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 214, 2024-09-15T23:24:39.782 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 1553851, 2024-09-15T23:24:39.782 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:39.782 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 214, 2024-09-15T23:24:39.782 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T23:24:39.782 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T23:24:39.783 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 214, 2024-09-15T23:24:39.783 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 1553851, 2024-09-15T23:24:39.783 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T23:24:39.783 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:39.783 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:39.783 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:39.783 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:39.783 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:39.783 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:24:39.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:39 smithi002 ceph-mon[31019]: pgmap v320: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:39.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:39 smithi002 ceph-mon[31019]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-15T23:24:39.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:39 smithi002 ceph-mon[31019]: Unable to set osd_memory_target on smithi002 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-15T23:24:39.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:39 smithi145 ceph-mon[34901]: pgmap v320: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:39.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:39 smithi145 ceph-mon[34901]: Adjusting osd_memory_target on smithi002 to 177.0M 2024-09-15T23:24:39.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:39 smithi145 ceph-mon[34901]: Unable to set osd_memory_target on smithi002 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-15T23:24:40.404 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-15T23:24:40.404 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-15T23:24:40.404 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-15T23:24:40.404 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.e 2024-09-15T23:24:40.404 DEBUG:tasks.check_counter:Getting stats from h 2024-09-15T23:24:40.405 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-15T23:24:40.651 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:24:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:40 smithi112 ceph-mon[34367]: pgmap v321: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:40.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:40 smithi002 ceph-mon[31019]: pgmap v321: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:40.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:40 smithi145 ceph-mon[34901]: pgmap v321: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T23:24:41.147 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:24:41.147 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:24:41.147 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 0, 2024-09-15T23:24:41.147 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 2, 2024-09-15T23:24:41.147 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 0, 2024-09-15T23:24:41.147 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 0, 2024-09-15T23:24:41.147 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 4, 2024-09-15T23:24:41.147 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 0, 2024-09-15T23:24:41.147 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.000977173, 2024-09-15T23:24:41.147 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T23:24:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.000099625, 2024-09-15T23:24:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:41.148 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:24:41.149 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:24:41.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:41.149 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:24:41.149 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 211, 2024-09-15T23:24:41.149 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 200, 2024-09-15T23:24:41.149 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 1583488, 2024-09-15T23:24:41.149 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 122784, 2024-09-15T23:24:41.149 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 2, 2024-09-15T23:24:41.149 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 1, 2024-09-15T23:24:41.149 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.033395908, 2024-09-15T23:24:41.149 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.011389704, 2024-09-15T23:24:41.149 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.034404880, 2024-09-15T23:24:41.149 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 199, 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.010105936, 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000050783 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 1583488, 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 122784 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:41.150 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 6, 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 155, 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 3264, 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 184416, 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 5, 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 3, 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.011766469, 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.006043136, 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.004047206, 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 153, 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.023527843, 2024-09-15T23:24:41.151 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000153776 2024-09-15T23:24:41.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:41.152 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:41.152 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:41.152 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:41.152 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:41.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:41.152 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-15T23:24:41.152 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 184416 2024-09-15T23:24:41.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:41.152 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-09-15T23:24:41.152 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 0, 2024-09-15T23:24:41.152 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-09-15T23:24:41.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:24:41.153 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-09-15T23:24:41.154 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 148933, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 30, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-09-15T23:24:41.155 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 0, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 0, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 928, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 2, 2024-09-15T23:24:41.156 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 213, 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 1553721, 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 213, 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T23:24:41.157 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T23:24:41.158 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 213, 2024-09-15T23:24:41.158 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 1553721, 2024-09-15T23:24:41.158 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T23:24:41.158 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:41.158 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:41.158 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:41.158 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:41.158 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:41.158 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:24:41.854 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.h 2024-09-15T23:24:41.854 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.h 2024-09-15T23:24:41.854 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.h 2024-09-15T23:24:41.854 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.h 2024-09-15T23:24:41.854 DEBUG:tasks.check_counter:Getting stats from k 2024-09-15T23:24:41.854 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-15T23:24:42.098 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:24:42.589 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-15T23:24:42.589 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:24:42.589 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 4, 2024-09-15T23:24:42.589 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 4, 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 2944, 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 448, 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 4, 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 0, 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.002897333, 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.000033717, 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.002195436, 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 3, 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.003932594, 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001310864 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:42.590 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:42.591 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:42.591 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:42.591 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:42.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:42.591 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-15T23:24:42.591 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T23:24:42.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:42.591 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:24:42.591 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 215, 2024-09-15T23:24:42.591 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 204, 2024-09-15T23:24:42.591 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 1584576, 2024-09-15T23:24:42.591 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 125344, 2024-09-15T23:24:42.591 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 2, 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 1, 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.037556461, 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.012357099, 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.038897781, 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 203, 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.011030142, 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000054335 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:42.592 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:42.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:42.593 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 1584576, 2024-09-15T23:24:42.593 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 125344 2024-09-15T23:24:42.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:42.593 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:24:42.593 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 2, 2024-09-15T23:24:42.593 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 157, 2024-09-15T23:24:42.593 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 320, 2024-09-15T23:24:42.593 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 184672, 2024-09-15T23:24:42.593 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 5, 2024-09-15T23:24:42.594 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 3, 2024-09-15T23:24:42.594 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.010199794, 2024-09-15T23:24:42.594 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.006828732, 2024-09-15T23:24:42.594 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.001465925, 2024-09-15T23:24:42.594 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:42.594 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:42.594 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 154, 2024-09-15T23:24:42.594 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.015170645, 2024-09-15T23:24:42.594 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000098510 2024-09-15T23:24:42.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:42.594 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:42.594 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:42.594 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 184672 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 0, 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:24:42.595 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:24:42.596 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:24:42.596 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:24:42.596 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:24:42.596 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:24:42.596 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:24:42.596 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:24:42.596 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:24:42.596 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:24:42.596 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:24:42.596 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:24:42.597 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:24:42.598 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:24:42.598 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-09-15T23:24:42.598 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-09-15T23:24:42.598 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-09-15T23:24:42.598 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:24:42.598 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:24:42.598 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:24:42.598 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:24:42.598 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 148967, 2024-09-15T23:24:42.598 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 29, 2024-09-15T23:24:42.598 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:24:42.598 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 0, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 0, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 928, 2024-09-15T23:24:42.599 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 2, 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 217, 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 1554241, 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 217, 2024-09-15T23:24:42.600 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-15T23:24:42.601 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-15T23:24:42.601 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 217, 2024-09-15T23:24:42.601 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 1554241, 2024-09-15T23:24:42.601 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-15T23:24:42.601 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-15T23:24:42.601 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-15T23:24:42.601 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-15T23:24:42.601 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:42.601 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-15T23:24:42.601 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-15T23:24:42.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:42 smithi112 ceph-mon[34367]: pgmap v322: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:43.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:42 smithi002 ceph-mon[31019]: pgmap v322: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:43.207 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:42 smithi145 ceph-mon[34901]: pgmap v322: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:43.253 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-15T23:24:43.253 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-15T23:24:43.253 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-15T23:24:43.253 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-15T23:24:43.254 DEBUG:tasks.check_counter:Getting stats from c 2024-09-15T23:24:43.254 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-15T23:24:43.512 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:24:43.996 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-15T23:24:43.996 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:24:43.996 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 4, 2024-09-15T23:24:43.996 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 4, 2024-09-15T23:24:43.996 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 2944, 2024-09-15T23:24:43.996 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 448, 2024-09-15T23:24:43.996 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 4, 2024-09-15T23:24:43.996 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 0, 2024-09-15T23:24:43.997 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.003133840, 2024-09-15T23:24:43.997 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.000052850, 2024-09-15T23:24:43.997 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.002267103, 2024-09-15T23:24:43.997 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:43.997 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:43.997 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3, 2024-09-15T23:24:43.997 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.004015004, 2024-09-15T23:24:43.997 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001338334 2024-09-15T23:24:43.997 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:43.997 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:43.997 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:43.997 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:43.997 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 2, 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 153, 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 320, 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 183968, 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 5, 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 3, 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.011574216, 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.007248790, 2024-09-15T23:24:43.998 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.001525811, 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 150, 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.015357906, 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000102386 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 183968 2024-09-15T23:24:43.999 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:44.000 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:24:44.000 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 212, 2024-09-15T23:24:44.000 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 201, 2024-09-15T23:24:44.000 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 1583760, 2024-09-15T23:24:44.000 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 123424, 2024-09-15T23:24:44.000 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 2, 2024-09-15T23:24:44.000 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 1, 2024-09-15T23:24:44.000 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.040314728, 2024-09-15T23:24:44.000 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.014477299, 2024-09-15T23:24:44.000 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.038416306, 2024-09-15T23:24:44.000 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:44.000 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:44.001 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 200, 2024-09-15T23:24:44.001 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.013330361, 2024-09-15T23:24:44.001 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000066651 2024-09-15T23:24:44.001 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:44.001 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:44.001 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:44.001 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:44.001 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:44.001 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:44.001 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1583760, 2024-09-15T23:24:44.001 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 123424 2024-09-15T23:24:44.001 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:44.002 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-09-15T23:24:44.002 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 0, 2024-09-15T23:24:44.002 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-09-15T23:24:44.002 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:44.002 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-09-15T23:24:44.002 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:24:44.002 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-09-15T23:24:44.002 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:24:44.002 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:24:44.002 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:24:44.002 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:24:44.002 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:24:44.002 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:24:44.003 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:24:44.004 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:24:44.005 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 148984, 2024-09-15T23:24:44.005 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 30, 2024-09-15T23:24:44.005 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:24:44.005 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2024-09-15T23:24:44.005 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-09-15T23:24:44.005 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-09-15T23:24:44.005 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:24:44.005 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-09-15T23:24:44.005 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:24:44.005 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-09-15T23:24:44.005 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 0, 2024-09-15T23:24:44.005 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 0, 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 928, 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 2, 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-15T23:24:44.006 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-15T23:24:44.007 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-15T23:24:44.007 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 214, 2024-09-15T23:24:44.007 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 1553851, 2024-09-15T23:24:44.007 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:44.007 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 214, 2024-09-15T23:24:44.007 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-15T23:24:44.007 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-15T23:24:44.007 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 214, 2024-09-15T23:24:44.007 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 1553851, 2024-09-15T23:24:44.007 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-15T23:24:44.007 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:44.008 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:44.008 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:44.008 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:44.008 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:44.008 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-15T23:24:44.794 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2024-09-15T23:24:44.794 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2024-09-15T23:24:44.794 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2024-09-15T23:24:44.794 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.c 2024-09-15T23:24:44.795 DEBUG:tasks.check_counter:Getting stats from f 2024-09-15T23:24:44.795 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-15T23:24:44.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:44 smithi145 ceph-mon[34901]: pgmap v323: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:44.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:44 smithi112 ceph-mon[34367]: pgmap v323: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:45.048 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:24:45.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:44 smithi002 ceph-mon[31019]: pgmap v323: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:45.618 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-15T23:24:45.618 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:24:45.618 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 0, 2024-09-15T23:24:45.618 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 2, 2024-09-15T23:24:45.618 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 0, 2024-09-15T23:24:45.618 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 0, 2024-09-15T23:24:45.618 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 4, 2024-09-15T23:24:45.618 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 0, 2024-09-15T23:24:45.618 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.001030861, 2024-09-15T23:24:45.618 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T23:24:45.618 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.000168968, 2024-09-15T23:24:45.619 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:45.619 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:45.619 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:45.619 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:45.619 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:45.619 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:45.619 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:45.619 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:45.619 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:45.619 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:45.619 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:45.619 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:24:45.620 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:24:45.620 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:45.620 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:24:45.620 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 6, 2024-09-15T23:24:45.620 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 157, 2024-09-15T23:24:45.620 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 3264, 2024-09-15T23:24:45.620 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 184768, 2024-09-15T23:24:45.620 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 5, 2024-09-15T23:24:45.620 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 3, 2024-09-15T23:24:45.620 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.011570698, 2024-09-15T23:24:45.620 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.006345550, 2024-09-15T23:24:45.620 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.003206164, 2024-09-15T23:24:45.621 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:45.621 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:45.621 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 155, 2024-09-15T23:24:45.621 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.020319889, 2024-09-15T23:24:45.621 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000131096 2024-09-15T23:24:45.621 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:45.621 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:45.621 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:45.621 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:45.621 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:45.621 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:45.621 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-15T23:24:45.621 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 184768 2024-09-15T23:24:45.622 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:45.622 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:24:45.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 213, 2024-09-15T23:24:45.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 202, 2024-09-15T23:24:45.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 1584032, 2024-09-15T23:24:45.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 124064, 2024-09-15T23:24:45.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 2, 2024-09-15T23:24:45.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 1, 2024-09-15T23:24:45.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.040989191, 2024-09-15T23:24:45.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.013515064, 2024-09-15T23:24:45.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.042578775, 2024-09-15T23:24:45.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:45.622 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 201, 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.012894060, 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000064149 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1584032, 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 124064 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-09-15T23:24:45.623 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 0, 2024-09-15T23:24:45.624 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-09-15T23:24:45.624 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:45.624 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-09-15T23:24:45.624 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:24:45.624 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-09-15T23:24:45.624 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:24:45.624 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:24:45.624 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:24:45.624 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:24:45.624 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:24:45.624 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:24:45.624 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:24:45.624 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:24:45.625 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:24:45.626 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:24:45.626 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-09-15T23:24:45.626 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:24:45.626 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:24:45.626 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:24:45.626 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-09-15T23:24:45.626 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-09-15T23:24:45.626 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-09-15T23:24:45.626 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:24:45.626 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:24:45.626 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:24:45.626 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 148967, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 29, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 0, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 0, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:24:45.627 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:24:45.628 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-09-15T23:24:45.628 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-09-15T23:24:45.628 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 928, 2024-09-15T23:24:45.628 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 2, 2024-09-15T23:24:45.628 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-09-15T23:24:45.628 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-09-15T23:24:45.628 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-09-15T23:24:45.628 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-09-15T23:24:45.628 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:45.628 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:24:45.628 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-15T23:24:45.628 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-15T23:24:45.628 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-15T23:24:45.629 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 215, 2024-09-15T23:24:45.629 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 1553981, 2024-09-15T23:24:45.629 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:45.629 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 215, 2024-09-15T23:24:45.629 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-15T23:24:45.629 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-15T23:24:45.629 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 215, 2024-09-15T23:24:45.629 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 1553981, 2024-09-15T23:24:45.629 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-15T23:24:45.629 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:45.629 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:45.629 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:45.629 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:45.630 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:45.630 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-15T23:24:46.324 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-15T23:24:46.324 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-15T23:24:46.324 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-15T23:24:46.324 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.f 2024-09-15T23:24:46.324 DEBUG:tasks.check_counter:Getting stats from i 2024-09-15T23:24:46.325 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-15T23:24:46.571 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:24:46.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:46 smithi145 ceph-mon[34901]: pgmap v324: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:24:46.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:46 smithi112 ceph-mon[34367]: pgmap v324: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:24:47.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:46 smithi002 ceph-mon[31019]: pgmap v324: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:24:47.136 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-15T23:24:47.136 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:24:47.136 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 1642, 2024-09-15T23:24:47.136 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 1642, 2024-09-15T23:24:47.136 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 143248815, 2024-09-15T23:24:47.136 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 521342, 2024-09-15T23:24:47.136 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 8, 2024-09-15T23:24:47.136 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 4, 2024-09-15T23:24:47.136 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.237028861, 2024-09-15T23:24:47.137 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.050800182, 2024-09-15T23:24:47.137 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.122097035, 2024-09-15T23:24:47.137 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.048688274, 2024-09-15T23:24:47.137 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:47.137 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1641, 2024-09-15T23:24:47.137 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.070953643, 2024-09-15T23:24:47.137 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000043238 2024-09-15T23:24:47.137 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.137 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:47.137 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.137 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.137 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.137 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.138 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-15T23:24:47.138 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T23:24:47.138 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.138 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:24:47.138 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 459, 2024-09-15T23:24:47.138 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 610, 2024-09-15T23:24:47.138 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 125951455, 2024-09-15T23:24:47.138 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 577392, 2024-09-15T23:24:47.138 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 9, 2024-09-15T23:24:47.138 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 7, 2024-09-15T23:24:47.138 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.105590195, 2024-09-15T23:24:47.138 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.017527285, 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.072750345, 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.010395462, 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 607, 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.029429229, 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000048483 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 432000 2024-09-15T23:24:47.139 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.140 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:24:47.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 1028, 2024-09-15T23:24:47.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 1016, 2024-09-15T23:24:47.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 136040968, 2024-09-15T23:24:47.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 379511, 2024-09-15T23:24:47.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 5, 2024-09-15T23:24:47.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 4, 2024-09-15T23:24:47.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.176399916, 2024-09-15T23:24:47.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.037898163, 2024-09-15T23:24:47.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.123394515, 2024-09-15T23:24:47.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.021808486, 2024-09-15T23:24:47.140 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:47.140 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1015, 2024-09-15T23:24:47.141 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.041218773, 2024-09-15T23:24:47.141 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000040609 2024-09-15T23:24:47.141 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.141 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:47.141 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.141 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.141 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.141 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.142 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1604240, 2024-09-15T23:24:47.142 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 126064 2024-09-15T23:24:47.142 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.142 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-09-15T23:24:47.142 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2024-09-15T23:24:47.142 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-09-15T23:24:47.142 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.142 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2024-09-15T23:24:47.142 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-09-15T23:24:47.142 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-09-15T23:24:47.142 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4567, 2024-09-15T23:24:47.142 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.179233659, 2024-09-15T23:24:47.142 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000039245 2024-09-15T23:24:47.143 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:47.143 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.143 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2024-09-15T23:24:47.143 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-09-15T23:24:47.143 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-09-15T23:24:47.143 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.143 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.143 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.143 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:47.143 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.143 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2024-09-15T23:24:47.143 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 0, 2024-09-15T23:24:47.143 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 0, 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_reply": 0, 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 0, 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_complete": 0, 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_keys": 0, 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 0, 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 0, 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 30849, 2024-09-15T23:24:47.144 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 6748, 2024-09-15T23:24:47.145 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 24101, 2024-09-15T23:24:47.145 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 0, 2024-09-15T23:24:47.145 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 21209, 2024-09-15T23:24:47.145 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 0, 2024-09-15T23:24:47.145 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 0, 2024-09-15T23:24:47.145 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 0, 2024-09-15T23:24:47.145 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 2, 2024-09-15T23:24:47.145 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 0, 2024-09-15T23:24:47.145 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 0, 2024-09-15T23:24:47.146 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 0, 2024-09-15T23:24:47.146 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 0, 2024-09-15T23:24:47.146 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 0, 2024-09-15T23:24:47.146 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2024-09-15T23:24:47.146 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 0, 2024-09-15T23:24:47.146 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 0, 2024-09-15T23:24:47.146 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2024-09-15T23:24:47.146 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 0, 2024-09-15T23:24:47.146 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 0, 2024-09-15T23:24:47.146 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 0, 2024-09-15T23:24:47.146 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2024-09-15T23:24:47.146 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2024-09-15T23:24:47.146 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 4, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 234, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 6, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_set_tag": 0, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_inodes": 0, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_file_inodes": 0, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_inode_file_caps": 0, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T23:24:47.147 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_grant": 0, 2024-09-15T23:24:47.148 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T23:24:47.148 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:24:47.148 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:24:47.148 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps": 0, 2024-09-15T23:24:47.148 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps_dirty": 0, 2024-09-15T23:24:47.148 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_cap_release": 0, 2024-09-15T23:24:47.148 INFO:teuthology.orchestra.run.smithi145.stdout: "process_request_cap_release": 0 2024-09-15T23:24:47.148 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.148 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2024-09-15T23:24:47.148 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update": 0, 2024-09-15T23:24:47.148 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update_receipt": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_try_discover": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_send_discover": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_handle_discover": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:24:47.149 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2024-09-15T23:24:47.150 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2024-09-15T23:24:47.150 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_quiesce_path": 0, 2024-09-15T23:24:47.150 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_quiesce_inode": 0, 2024-09-15T23:24:47.150 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T23:24:47.150 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 0, 2024-09-15T23:24:47.150 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2024-09-15T23:24:47.150 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 0, 2024-09-15T23:24:47.150 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2024-09-15T23:24:47.150 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2024-09-15T23:24:47.150 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.151 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2024-09-15T23:24:47.151 INFO:teuthology.orchestra.run.smithi145.stdout: "evlrg": 0, 2024-09-15T23:24:47.151 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 0, 2024-09-15T23:24:47.151 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 0, 2024-09-15T23:24:47.151 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 0, 2024-09-15T23:24:47.151 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 231322, 2024-09-15T23:24:47.151 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2024-09-15T23:24:47.151 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 0, 2024-09-15T23:24:47.151 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 0, 2024-09-15T23:24:47.151 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 0, 2024-09-15T23:24:47.152 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 0, 2024-09-15T23:24:47.152 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 131, 2024-09-15T23:24:47.152 INFO:teuthology.orchestra.run.smithi145.stdout: "segmjr": 20, 2024-09-15T23:24:47.152 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2024-09-15T23:24:47.152 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 0, 2024-09-15T23:24:47.152 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 208643605, 2024-09-15T23:24:47.152 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 406995118, 2024-09-15T23:24:47.152 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 406995006, 2024-09-15T23:24:47.152 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2024-09-15T23:24:47.153 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.153 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.153 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.153 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.153 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 231322 2024-09-15T23:24:47.153 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.153 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2024-09-15T23:24:47.153 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 7654, 2024-09-15T23:24:47.153 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 18329, 2024-09-15T23:24:47.153 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 10675, 2024-09-15T23:24:47.154 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 295, 2024-09-15T23:24:47.154 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 342, 2024-09-15T23:24:47.154 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 47, 2024-09-15T23:24:47.154 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 30849, 2024-09-15T23:24:47.154 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 31287, 2024-09-15T23:24:47.154 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 438, 2024-09-15T23:24:47.154 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 0, 2024-09-15T23:24:47.154 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 0, 2024-09-15T23:24:47.154 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 0, 2024-09-15T23:24:47.155 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 98544, 2024-09-15T23:24:47.155 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 215328 2024-09-15T23:24:47.155 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.155 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2024-09-15T23:24:47.155 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 0, 2024-09-15T23:24:47.155 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 0, 2024-09-15T23:24:47.155 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 0, 2024-09-15T23:24:47.155 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 0, 2024-09-15T23:24:47.155 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_peer_request": 0, 2024-09-15T23:24:47.155 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2024-09-15T23:24:47.155 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.155 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.156 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.156 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.156 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2024-09-15T23:24:47.156 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.156 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.156 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.156 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.157 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2024-09-15T23:24:47.157 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.157 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.157 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.157 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.157 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2024-09-15T23:24:47.157 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.158 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.158 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.158 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.158 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2024-09-15T23:24:47.158 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.158 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.158 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.159 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.159 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2024-09-15T23:24:47.159 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.159 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.159 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.159 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.159 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2024-09-15T23:24:47.159 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.159 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.159 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.159 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.159 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2024-09-15T23:24:47.159 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.160 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2024-09-15T23:24:47.161 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.161 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.161 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.161 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.161 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2024-09-15T23:24:47.162 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.162 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.162 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.162 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.162 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2024-09-15T23:24:47.162 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.162 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.162 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.162 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.162 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2024-09-15T23:24:47.162 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.162 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.162 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.163 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.163 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2024-09-15T23:24:47.163 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.163 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.163 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.163 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.163 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2024-09-15T23:24:47.163 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.163 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.163 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.163 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.163 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2024-09-15T23:24:47.163 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.164 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.164 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.164 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.164 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2024-09-15T23:24:47.164 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.164 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.164 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.164 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.164 INFO:teuthology.orchestra.run.smithi145.stdout: "req_snapdiff_latency": { 2024-09-15T23:24:47.164 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.164 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.164 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.164 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.165 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2024-09-15T23:24:47.165 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.165 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.165 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.165 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.165 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2024-09-15T23:24:47.165 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.165 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.165 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.165 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.165 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2024-09-15T23:24:47.165 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.165 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.166 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2024-09-15T23:24:47.167 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.168 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.168 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.168 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.168 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2024-09-15T23:24:47.168 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.168 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.168 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.168 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.168 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:24:47.168 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:24:47.168 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getvxattr_latency": { 2024-09-15T23:24:47.168 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.168 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.169 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.169 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:47.169 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.169 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2024-09-15T23:24:47.169 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2024-09-15T23:24:47.169 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 5, 2024-09-15T23:24:47.169 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 3, 2024-09-15T23:24:47.169 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 4, 2024-09-15T23:24:47.169 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2024-09-15T23:24:47.169 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 0, 2024-09-15T23:24:47.169 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 0, 2024-09-15T23:24:47.169 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 2652, 2024-09-15T23:24:47.169 INFO:teuthology.orchestra.run.smithi145.stdout: "mdthresh_evicted": 0 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:24:47.170 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:24:47.171 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-09-15T23:24:47.172 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:24:47.172 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:24:47.172 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:24:47.172 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-09-15T23:24:47.172 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-09-15T23:24:47.172 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-09-15T23:24:47.172 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:24:47.172 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:24:47.172 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:24:47.172 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:24:47.172 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 239431, 2024-09-15T23:24:47.172 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 78, 2024-09-15T23:24:47.172 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 8416, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 185, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-09-15T23:24:47.173 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 38267274, 2024-09-15T23:24:47.174 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 270375, 2024-09-15T23:24:47.174 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-09-15T23:24:47.174 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-09-15T23:24:47.174 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-09-15T23:24:47.174 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-09-15T23:24:47.174 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.174 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2024-09-15T23:24:47.174 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2024-09-15T23:24:47.174 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2024-09-15T23:24:47.174 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 2892, 2024-09-15T23:24:47.174 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 26, 2024-09-15T23:24:47.174 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 4, 2024-09-15T23:24:47.174 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 2892, 2024-09-15T23:24:47.175 INFO:teuthology.orchestra.run.smithi145.stdout: "op_latency": { 2024-09-15T23:24:47.175 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2892, 2024-09-15T23:24:47.175 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.943955289, 2024-09-15T23:24:47.175 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000672183 2024-09-15T23:24:47.175 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.175 INFO:teuthology.orchestra.run.smithi145.stdout: "op_inflight": 0, 2024-09-15T23:24:47.175 INFO:teuthology.orchestra.run.smithi145.stdout: "oplen_avg": { 2024-09-15T23:24:47.175 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2892, 2024-09-15T23:24:47.175 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2893 2024-09-15T23:24:47.175 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.175 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 2892, 2024-09-15T23:24:47.175 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 2892, 2024-09-15T23:24:47.175 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 0, 2024-09-15T23:24:47.176 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2024-09-15T23:24:47.176 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2024-09-15T23:24:47.176 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 1734, 2024-09-15T23:24:47.176 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 0, 2024-09-15T23:24:47.176 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 1155, 2024-09-15T23:24:47.176 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 0, 2024-09-15T23:24:47.176 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 0, 2024-09-15T23:24:47.176 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2024-09-15T23:24:47.176 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2024-09-15T23:24:47.176 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2024-09-15T23:24:47.176 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 0, 2024-09-15T23:24:47.176 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 2, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:24:47.177 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2024-09-15T23:24:47.178 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2024-09-15T23:24:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2024-09-15T23:24:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2024-09-15T23:24:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 94, 2024-09-15T23:24:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2024-09-15T23:24:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 13, 2024-09-15T23:24:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 11, 2024-09-15T23:24:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 11, 2024-09-15T23:24:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2024-09-15T23:24:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2024-09-15T23:24:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 0, 2024-09-15T23:24:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 2, 2024-09-15T23:24:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 0 2024-09-15T23:24:47.179 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2024-09-15T23:24:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 0, 2024-09-15T23:24:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:24:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2024-09-15T23:24:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2024-09-15T23:24:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: "osd-slow-ops": { 2024-09-15T23:24:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_ops_count": 0 2024-09-15T23:24:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2024-09-15T23:24:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2024-09-15T23:24:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T23:24:47.180 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 0, 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed_ops": 0, 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 0, 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 3125, 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 404945209, 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 3125, 2024-09-15T23:24:47.181 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 3125, 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 404945209, 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-15T23:24:47.182 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 2892, 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 402836752, 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 2892, 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 402836752, 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2024-09-15T23:24:47.183 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-15T23:24:47.184 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2024-09-15T23:24:47.184 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-15T23:24:47.184 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-15T23:24:47.184 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-15T23:24:47.184 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:47.184 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-15T23:24:47.184 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 2892, 2024-09-15T23:24:47.184 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 2892, 2024-09-15T23:24:47.184 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 2892, 2024-09-15T23:24:47.184 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 2892, 2024-09-15T23:24:47.184 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-15T23:24:47.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.184 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-15T23:24:47.185 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 0, 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 0, 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x562d5706ab40": { 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-15T23:24:47.187 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-15T23:24:47.187 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-15T23:24:47.187 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 0, 2024-09-15T23:24:47.187 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 0, 2024-09-15T23:24:47.187 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-15T23:24:47.187 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:47.187 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:47.187 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:47.187 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:47.187 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:47.187 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-15T23:24:48.000 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-15T23:24:48.000 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-15T23:24:48.000 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-15T23:24:48.000 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-09-15T23:24:48.000 DEBUG:tasks.check_counter:Getting stats from l 2024-09-15T23:24:48.000 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-15T23:24:48.243 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:24:48.781 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-15T23:24:48.781 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:24:48.781 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 0, 2024-09-15T23:24:48.781 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 2, 2024-09-15T23:24:48.781 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 0, 2024-09-15T23:24:48.781 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 0, 2024-09-15T23:24:48.781 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 4, 2024-09-15T23:24:48.781 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 0, 2024-09-15T23:24:48.781 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.000932859, 2024-09-15T23:24:48.782 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T23:24:48.782 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.000154035, 2024-09-15T23:24:48.782 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:48.782 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:48.782 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:48.782 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:48.782 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:48.782 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:48.782 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:48.782 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:48.782 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:48.782 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:48.782 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 6, 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 160, 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 3264, 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 185296, 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 5, 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 3, 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.012728475, 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.007193702, 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.003451938, 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:48.783 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:48.784 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 158, 2024-09-15T23:24:48.784 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.023877999, 2024-09-15T23:24:48.784 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000151126 2024-09-15T23:24:48.784 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:48.784 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:48.784 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:48.784 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:48.784 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:48.784 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:48.784 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-15T23:24:48.784 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 185296 2024-09-15T23:24:48.784 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:48.784 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 218, 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 207, 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 1585392, 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 127264, 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 2, 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 1, 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.042719835, 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.014614593, 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.042803145, 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 206, 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.011915895, 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000057844 2024-09-15T23:24:48.785 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:48.786 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:24:48.786 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:48.786 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:48.786 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:48.786 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:48.786 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1585392, 2024-09-15T23:24:48.786 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 127264 2024-09-15T23:24:48.786 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:48.786 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-09-15T23:24:48.787 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 0, 2024-09-15T23:24:48.787 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-09-15T23:24:48.787 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:48.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-09-15T23:24:48.787 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:24:48.787 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-09-15T23:24:48.787 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:24:48.787 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:24:48.787 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:24:48.787 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:24:48.787 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:24:48.787 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:24:48.787 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:24:48.788 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:24:48.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:24:48.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-09-15T23:24:48.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:24:48.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:24:48.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:24:48.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-09-15T23:24:48.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-09-15T23:24:48.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-09-15T23:24:48.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:24:48.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:24:48.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:24:48.789 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:24:48.789 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 148972, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 31, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 0, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 0, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-09-15T23:24:48.790 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 928, 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 2, 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 220, 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 1554631, 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-15T23:24:48.791 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 220, 2024-09-15T23:24:48.792 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-15T23:24:48.792 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-15T23:24:48.792 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 220, 2024-09-15T23:24:48.792 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 1554631, 2024-09-15T23:24:48.792 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-15T23:24:48.792 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-15T23:24:48.792 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-15T23:24:48.792 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-15T23:24:48.792 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:48.792 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-15T23:24:48.792 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-15T23:24:48.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:48 smithi145 ceph-mon[34901]: pgmap v325: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:48.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:48 smithi112 ceph-mon[34367]: pgmap v325: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:49.058 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:48 smithi002 ceph-mon[31019]: pgmap v325: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:49.476 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-15T23:24:49.476 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-15T23:24:49.476 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-15T23:24:49.476 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-15T23:24:49.476 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-15T23:24:49.487 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-15T23:24:49.487 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:24:49.487 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:49.510 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:24:49.510 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:49.570 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T23:24:49.880 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:24:50.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.368+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3519881857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff404100b30 msgr2=0x7ff404100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:50.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.368+0000 7ff40bbd8640 1 --2- 172.21.15.2:0/3519881857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff404100b30 0x7ff404100f10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff400009900 tx=0x7ff40002a470 comp rx=0 tx=0).stop 2024-09-15T23:24:50.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.368+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3519881857 shutdown_connections 2024-09-15T23:24:50.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.368+0000 7ff40bbd8640 1 --2- 172.21.15.2:0/3519881857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff404105f40 0x7ff4041063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.368+0000 7ff40bbd8640 1 --2- 172.21.15.2:0/3519881857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff404101450 0x7ff404105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.368+0000 7ff40bbd8640 1 --2- 172.21.15.2:0/3519881857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff404100b30 0x7ff404100f10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.368+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3519881857 >> 172.21.15.2:0/3519881857 conn(0x7ff4040fc7a0 msgr2=0x7ff4040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:50.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.369+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3519881857 shutdown_connections 2024-09-15T23:24:50.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.369+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3519881857 wait complete. 2024-09-15T23:24:50.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.369+0000 7ff40bbd8640 1 Processor -- start 2024-09-15T23:24:50.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.369+0000 7ff40bbd8640 1 -- start start 2024-09-15T23:24:50.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.369+0000 7ff40bbd8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff404100b30 0x7ff4041a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:50.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.369+0000 7ff40bbd8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff404101450 0x7ff4041a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:50.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.369+0000 7ff40bbd8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff404105f40 0x7ff40419e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:50.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.369+0000 7ff40bbd8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff404118480 con 0x7ff404100b30 2024-09-15T23:24:50.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.369+0000 7ff40bbd8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff404118300 con 0x7ff404101450 2024-09-15T23:24:50.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.369+0000 7ff40bbd8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff404118600 con 0x7ff404105f40 2024-09-15T23:24:50.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.369+0000 7ff409974640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff404100b30 0x7ff4041a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:50.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff409974640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff404100b30 0x7ff4041a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54602/0 (socket says 172.21.15.2:54602) 2024-09-15T23:24:50.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff409974640 1 -- 172.21.15.2:0/3361685851 learned_addr learned my addr 172.21.15.2:0/3361685851 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:24:50.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff40a175640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff404105f40 0x7ff40419e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff409173640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff404101450 0x7ff4041a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff409974640 1 -- 172.21.15.2:0/3361685851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff404105f40 msgr2=0x7ff40419e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff409974640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff404105f40 0x7ff40419e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff409974640 1 -- 172.21.15.2:0/3361685851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff404101450 msgr2=0x7ff4041a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff409974640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff404101450 0x7ff4041a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff409974640 1 -- 172.21.15.2:0/3361685851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40419efb0 con 0x7ff404100b30 2024-09-15T23:24:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff40a175640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff404105f40 0x7ff40419e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff409974640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff404100b30 0x7ff4041a4670 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff400006010 tx=0x7ff400004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff3f6ffd640 1 -- 172.21.15.2:0/3361685851 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40003f030 con 0x7ff404100b30 2024-09-15T23:24:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff3f6ffd640 1 -- 172.21.15.2:0/3361685851 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff4000035f0 con 0x7ff404100b30 2024-09-15T23:24:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3361685851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40419f240 con 0x7ff404100b30 2024-09-15T23:24:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff3f6ffd640 1 -- 172.21.15.2:0/3361685851 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff400035070 con 0x7ff404100b30 2024-09-15T23:24:50.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.370+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3361685851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4041ab420 con 0x7ff404100b30 2024-09-15T23:24:50.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.371+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3361685851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff40406b070 con 0x7ff404100b30 2024-09-15T23:24:50.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.373+0000 7ff3f6ffd640 1 -- 172.21.15.2:0/3361685851 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7ff400003b10 con 0x7ff404100b30 2024-09-15T23:24:50.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.373+0000 7ff3f6ffd640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7ff3f00a33b0 0x7ff3f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:50.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.373+0000 7ff3f6ffd640 1 -- 172.21.15.2:0/3361685851 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8600+0+0 (secure 0 0 0) 0x7ff4000f0bb0 con 0x7ff404100b30 2024-09-15T23:24:50.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.373+0000 7ff409173640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7ff3f00a33b0 0x7ff3f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:50.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.374+0000 7ff409173640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7ff3f00a33b0 0x7ff3f00a5870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8005fd0 tx=0x7ff3f8005f60 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:50.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.376+0000 7ff3f6ffd640 1 -- 172.21.15.2:0/3361685851 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff4000bd540 con 0x7ff404100b30 2024-09-15T23:24:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.562+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3361685851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff4041ab650 con 0x7ff404100b30 2024-09-15T23:24:50.564 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4076310741 2024-09-16T23:14:23.506414+0000 2024-09-15T23:24:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2564114882 2024-09-16T23:14:23.506414+0000 2024-09-15T23:24:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2564114882 2024-09-16T23:14:23.506414+0000 2024-09-15T23:24:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2652608868 2024-09-16T23:05:17.756048+0000 2024-09-15T23:24:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/236781836 2024-09-16T23:05:41.416672+0000 2024-09-15T23:24:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2652608868 2024-09-16T23:05:17.756048+0000 2024-09-15T23:24:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1891095221 2024-09-16T23:05:17.756048+0000 2024-09-15T23:24:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3802152324 2024-09-16T23:05:41.416672+0000 2024-09-15T23:24:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2404111366 2024-09-16T23:05:17.756048+0000 2024-09-15T23:24:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/938645794 2024-09-16T23:05:41.416672+0000 2024-09-15T23:24:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/938645794 2024-09-16T23:05:41.416672+0000 2024-09-15T23:24:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2473316249 2024-09-16T23:14:23.506414+0000 2024-09-15T23:24:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/896502743 2024-09-16T23:05:17.756048+0000 2024-09-15T23:24:50.565 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2956732837 2024-09-16T23:05:41.416672+0000 2024-09-15T23:24:50.566 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4081748544 2024-09-16T23:14:23.506414+0000 2024-09-15T23:24:50.566 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3363964546 2024-09-16T23:14:23.506414+0000 2024-09-15T23:24:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.563+0000 7ff3f6ffd640 1 -- 172.21.15.2:0/3361685851 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v94) ==== 81+0+926 (secure 0 0 0) 0x7ff4000bce40 con 0x7ff404100b30 2024-09-15T23:24:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:listed 16 entries 2024-09-15T23:24:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.565+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3361685851 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7ff3f00a33b0 msgr2=0x7ff3f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.565+0000 7ff40bbd8640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7ff3f00a33b0 0x7ff3f00a5870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8005fd0 tx=0x7ff3f8005f60 comp rx=0 tx=0).stop 2024-09-15T23:24:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.565+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3361685851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff404100b30 msgr2=0x7ff4041a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.565+0000 7ff40bbd8640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff404100b30 0x7ff4041a4670 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff400006010 tx=0x7ff400004270 comp rx=0 tx=0).stop 2024-09-15T23:24:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.565+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3361685851 shutdown_connections 2024-09-15T23:24:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.565+0000 7ff40bbd8640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7ff3f00a33b0 0x7ff3f00a5870 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.565+0000 7ff40bbd8640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff404105f40 0x7ff40419e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.565+0000 7ff40bbd8640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff404101450 0x7ff4041a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.565+0000 7ff40bbd8640 1 --2- 172.21.15.2:0/3361685851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff404100b30 0x7ff4041a4670 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.565+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3361685851 >> 172.21.15.2:0/3361685851 conn(0x7ff4040fc7a0 msgr2=0x7ff40410f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.565+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3361685851 shutdown_connections 2024-09-15T23:24:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:50.565+0000 7ff40bbd8640 1 -- 172.21.15.2:0/3361685851 wait complete. 2024-09-15T23:24:51.289 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:51 smithi002 ceph-mon[31019]: pgmap v326: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:24:51.289 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:51 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3361685851' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:24:51.321 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-15T23:24:51.321 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:51.340 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T23:24:51.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:51 smithi145 ceph-mon[34901]: pgmap v326: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:24:51.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:51 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3361685851' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:24:51.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:51 smithi112 ceph-mon[34367]: pgmap v326: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:24:51.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:51 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3361685851' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:24:51.638 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:24:52.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.116+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/1396314198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7f81036e0 msgr2=0x7fe7f8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.117+0000 7fe7fe2e7640 1 --2- 172.21.15.2:0/1396314198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7f81036e0 0x7fe7f8107b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec009930 tx=0x7fe7ec02a420 comp rx=0 tx=0).stop 2024-09-15T23:24:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.117+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/1396314198 shutdown_connections 2024-09-15T23:24:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.117+0000 7fe7fe2e7640 1 --2- 172.21.15.2:0/1396314198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7f81082a0 0x7fe7f810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.117+0000 7fe7fe2e7640 1 --2- 172.21.15.2:0/1396314198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7f81036e0 0x7fe7f8107b90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.117+0000 7fe7fe2e7640 1 --2- 172.21.15.2:0/1396314198 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7f8102d30 0x7fe7f8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.117+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/1396314198 >> 172.21.15.2:0/1396314198 conn(0x7fe7f80fc7d0 msgr2=0x7fe7f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.117+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/1396314198 shutdown_connections 2024-09-15T23:24:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.117+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/1396314198 wait complete. 2024-09-15T23:24:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.117+0000 7fe7fe2e7640 1 Processor -- start 2024-09-15T23:24:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.117+0000 7fe7fe2e7640 1 -- start start 2024-09-15T23:24:52.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fe2e7640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7f8102d30 0x7fe7f8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fe2e7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7f81036e0 0x7fe7f8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fe2e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7f81082a0 0x7fe7f819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fe2e7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f8111f50 con 0x7fe7f81082a0 2024-09-15T23:24:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fe2e7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f8111dd0 con 0x7fe7f81036e0 2024-09-15T23:24:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fe2e7640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f81120d0 con 0x7fe7f8102d30 2024-09-15T23:24:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fc884640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7f81082a0 0x7fe7f819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fc884640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7f81082a0 0x7fe7f819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54614/0 (socket says 172.21.15.2:54614) 2024-09-15T23:24:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fc884640 1 -- 172.21.15.2:0/4100053522 learned_addr learned my addr 172.21.15.2:0/4100053522 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:24:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7f7fff640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7f8102d30 0x7fe7f8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7f77fe640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7f81036e0 0x7fe7f8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fc884640 1 -- 172.21.15.2:0/4100053522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7f8102d30 msgr2=0x7fe7f8198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fc884640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7f8102d30 0x7fe7f8198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fc884640 1 -- 172.21.15.2:0/4100053522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7f81036e0 msgr2=0x7fe7f8198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fc884640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7f81036e0 0x7fe7f8198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.118+0000 7fe7fc884640 1 -- 172.21.15.2:0/4100053522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f819d4c0 con 0x7fe7f81082a0 2024-09-15T23:24:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.119+0000 7fe7fc884640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7f81082a0 0x7fe7f819cde0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000cad0 tx=0x7fe7f000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.119+0000 7fe7f57fa640 1 -- 172.21.15.2:0/4100053522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f000ae20 con 0x7fe7f81082a0 2024-09-15T23:24:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.119+0000 7fe7f57fa640 1 -- 172.21.15.2:0/4100053522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe7f0005020 con 0x7fe7f81082a0 2024-09-15T23:24:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.119+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/4100053522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f819d7b0 con 0x7fe7f81082a0 2024-09-15T23:24:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.119+0000 7fe7f57fa640 1 -- 172.21.15.2:0/4100053522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f000f6b0 con 0x7fe7f81082a0 2024-09-15T23:24:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.119+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/4100053522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f81a5090 con 0x7fe7f81082a0 2024-09-15T23:24:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.120+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/4100053522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f8103110 con 0x7fe7f81082a0 2024-09-15T23:24:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.121+0000 7fe7f57fa640 1 -- 172.21.15.2:0/4100053522 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7fe7f00051d0 con 0x7fe7f81082a0 2024-09-15T23:24:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.122+0000 7fe7f57fa640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fe7e00a33b0 0x7fe7e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.122+0000 7fe7f7fff640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fe7e00a33b0 0x7fe7e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.122+0000 7fe7f57fa640 1 -- 172.21.15.2:0/4100053522 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8600+0+0 (secure 0 0 0) 0x7fe7f00cfce0 con 0x7fe7f81082a0 2024-09-15T23:24:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.122+0000 7fe7f7fff640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fe7e00a33b0 0x7fe7e00a5870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8009bd0 tx=0x7fe7e8005f90 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:52.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.126+0000 7fe7f57fa640 1 -- 172.21.15.2:0/4100053522 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe7f0014030 con 0x7fe7f81082a0 2024-09-15T23:24:52.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.316+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/4100053522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe7f810a2b0 con 0x7fe7f81082a0 2024-09-15T23:24:52.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.316+0000 7fe7f57fa640 1 -- 172.21.15.2:0/4100053522 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v94) ==== 81+0+926 (secure 0 0 0) 0x7fe7f009c020 con 0x7fe7f81082a0 2024-09-15T23:24:52.318 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4076310741 2024-09-16T23:14:23.506414+0000 2024-09-15T23:24:52.318 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2564114882 2024-09-16T23:14:23.506414+0000 2024-09-15T23:24:52.318 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2564114882 2024-09-16T23:14:23.506414+0000 2024-09-15T23:24:52.318 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2652608868 2024-09-16T23:05:17.756048+0000 2024-09-15T23:24:52.318 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/236781836 2024-09-16T23:05:41.416672+0000 2024-09-15T23:24:52.318 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2652608868 2024-09-16T23:05:17.756048+0000 2024-09-15T23:24:52.318 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1891095221 2024-09-16T23:05:17.756048+0000 2024-09-15T23:24:52.318 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3802152324 2024-09-16T23:05:41.416672+0000 2024-09-15T23:24:52.318 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2404111366 2024-09-16T23:05:17.756048+0000 2024-09-15T23:24:52.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/938645794 2024-09-16T23:05:41.416672+0000 2024-09-15T23:24:52.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/938645794 2024-09-16T23:05:41.416672+0000 2024-09-15T23:24:52.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2473316249 2024-09-16T23:14:23.506414+0000 2024-09-15T23:24:52.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/896502743 2024-09-16T23:05:17.756048+0000 2024-09-15T23:24:52.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2956732837 2024-09-16T23:05:41.416672+0000 2024-09-15T23:24:52.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4081748544 2024-09-16T23:14:23.506414+0000 2024-09-15T23:24:52.319 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3363964546 2024-09-16T23:14:23.506414+0000 2024-09-15T23:24:52.320 INFO:teuthology.orchestra.run.smithi002.stderr:listed 16 entries 2024-09-15T23:24:52.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.318+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/4100053522 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fe7e00a33b0 msgr2=0x7fe7e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.318+0000 7fe7fe2e7640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fe7e00a33b0 0x7fe7e00a5870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8009bd0 tx=0x7fe7e8005f90 comp rx=0 tx=0).stop 2024-09-15T23:24:52.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.318+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/4100053522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7f81082a0 msgr2=0x7fe7f819cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.318+0000 7fe7fe2e7640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7f81082a0 0x7fe7f819cde0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000cad0 tx=0x7fe7f000cf90 comp rx=0 tx=0).stop 2024-09-15T23:24:52.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.318+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/4100053522 shutdown_connections 2024-09-15T23:24:52.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.318+0000 7fe7fe2e7640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fe7e00a33b0 0x7fe7e00a5870 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.318+0000 7fe7fe2e7640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7f81082a0 0x7fe7f819cde0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.318+0000 7fe7fe2e7640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe7f81036e0 0x7fe7f8198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.318+0000 7fe7fe2e7640 1 --2- 172.21.15.2:0/4100053522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe7f8102d30 0x7fe7f8198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.318+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/4100053522 >> 172.21.15.2:0/4100053522 conn(0x7fe7f80fc7d0 msgr2=0x7fe7f8105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:52.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.318+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/4100053522 shutdown_connections 2024-09-15T23:24:52.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:24:52.318+0000 7fe7fe2e7640 1 -- 172.21.15.2:0/4100053522 wait complete. 2024-09-15T23:24:52.979 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2024-09-15T23:24:52.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:52.979 DEBUG:teuthology.orchestra.run.smithi002:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:24:53.008 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:24:53.009 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[79014]: fuse finished with error 0 and tester_r 0 2024-09-15T23:24:53.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:53 smithi002 ceph-mon[31019]: pgmap v327: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:53.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:53 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/4100053522' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:24:53.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:53 smithi145 ceph-mon[34901]: pgmap v327: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:53.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:53 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/4100053522' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:24:53.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:53 smithi112 ceph-mon[34367]: pgmap v327: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:53.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:53 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/4100053522' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:24:55.431 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:55 smithi002 ceph-mon[31019]: pgmap v328: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:55.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:55 smithi145 ceph-mon[34901]: pgmap v328: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:55.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:55 smithi112 ceph-mon[34367]: pgmap v328: 97 pgs: 97 active+clean; 309 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:24:57.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:57 smithi145 ceph-mon[34901]: pgmap v329: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:24:57.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:57 smithi112 ceph-mon[34367]: pgmap v329: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:24:57.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:57 smithi002 ceph-mon[31019]: pgmap v329: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:24:59.111 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-09-15T23:24:59.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:59.111 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:24:59.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:59.132 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-15T23:24:59.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:24:59.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:59.192 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:24:59.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:59.266 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-15T23:24:59.361 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-15T23:24:59.371 INFO:tasks.cephadm:Teardown begin 2024-09-15T23:24:59.372 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:24:59.372 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:24:59.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:24:59 smithi145 ceph-mon[34901]: pgmap v330: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:24:59.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:24:59 smithi112 ceph-mon[34367]: pgmap v330: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:24:59.558 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:24:59 smithi002 ceph-mon[31019]: pgmap v330: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:24:59.635 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:25:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.129+0000 7f8882957640 1 -- 172.21.15.2:0/4007909421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f887c101bc0 msgr2=0x7f887c10d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.129+0000 7f8882957640 1 --2- 172.21.15.2:0/4007909421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f887c101bc0 0x7f887c10d910 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8874009ca0 tx=0x7f887402a8c0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.129+0000 7f8882957640 1 -- 172.21.15.2:0/4007909421 shutdown_connections 2024-09-15T23:25:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.129+0000 7f8882957640 1 --2- 172.21.15.2:0/4007909421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f887c101bc0 0x7f887c10d910 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.129+0000 7f8882957640 1 --2- 172.21.15.2:0/4007909421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f887c101240 0x7f887c101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.129+0000 7f8882957640 1 --2- 172.21.15.2:0/4007909421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f887c105a90 0x7f887c105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.129+0000 7f8882957640 1 -- 172.21.15.2:0/4007909421 >> 172.21.15.2:0/4007909421 conn(0x7f887c077210 msgr2=0x7f887c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.129+0000 7f8882957640 1 -- 172.21.15.2:0/4007909421 shutdown_connections 2024-09-15T23:25:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.129+0000 7f8882957640 1 -- 172.21.15.2:0/4007909421 wait complete. 2024-09-15T23:25:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.130+0000 7f8882957640 1 Processor -- start 2024-09-15T23:25:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.130+0000 7f8882957640 1 -- start start 2024-09-15T23:25:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8882957640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f887c101240 0x7f887c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8882957640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f887c101bc0 0x7f887c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8882957640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f887c105a90 0x7f887c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8882957640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f887c110e70 con 0x7f887c105a90 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8882957640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f887c110cf0 con 0x7f887c101240 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8882957640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f887c110ff0 con 0x7f887c101bc0 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8880ef4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f887c105a90 0x7f887c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8880ef4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f887c105a90 0x7f887c19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48476/0 (socket says 172.21.15.2:48476) 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8880ef4640 1 -- 172.21.15.2:0/1355426896 learned_addr learned my addr 172.21.15.2:0/1355426896 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f887bfff640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f887c101240 0x7f887c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f887b7fe640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f887c101bc0 0x7f887c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8880ef4640 1 -- 172.21.15.2:0/1355426896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f887c101bc0 msgr2=0x7f887c1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8880ef4640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f887c101bc0 0x7f887c1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8880ef4640 1 -- 172.21.15.2:0/1355426896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f887c101240 msgr2=0x7f887c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8880ef4640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f887c101240 0x7f887c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8880ef4640 1 -- 172.21.15.2:0/1355426896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887c19d350 con 0x7f887c105a90 2024-09-15T23:25:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8880ef4640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f887c105a90 0x7f887c19cc70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8874005e30 tx=0x7f8874033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f88797fa640 1 -- 172.21.15.2:0/1355426896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874003bf0 con 0x7f887c105a90 2024-09-15T23:25:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f8882957640 1 -- 172.21.15.2:0/1355426896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887c19d5e0 con 0x7f887c105a90 2024-09-15T23:25:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.131+0000 7f88797fa640 1 -- 172.21.15.2:0/1355426896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8874003d90 con 0x7f887c105a90 2024-09-15T23:25:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.132+0000 7f88797fa640 1 -- 172.21.15.2:0/1355426896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874030bc0 con 0x7f887c105a90 2024-09-15T23:25:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.132+0000 7f8882957640 1 -- 172.21.15.2:0/1355426896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f887c1a4f20 con 0x7f887c105a90 2024-09-15T23:25:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.133+0000 7f8882957640 1 -- 172.21.15.2:0/1355426896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f887c101680 con 0x7f887c105a90 2024-09-15T23:25:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.134+0000 7f88797fa640 1 -- 172.21.15.2:0/1355426896 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7f8874004040 con 0x7f887c105a90 2024-09-15T23:25:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.134+0000 7f88797fa640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f88640a33b0 0x7f88640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.134+0000 7f887bfff640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f88640a33b0 0x7f88640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.134+0000 7f88797fa640 1 -- 172.21.15.2:0/1355426896 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8600+0+0 (secure 0 0 0) 0x7f88740f1050 con 0x7f887c105a90 2024-09-15T23:25:00.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.135+0000 7f887bfff640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f88640a33b0 0x7f88640a5870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f886c0058c0 tx=0x7f886c00a250 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:00.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.139+0000 7f88797fa640 1 -- 172.21.15.2:0/1355426896 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f88740bdb80 con 0x7f887c105a90 2024-09-15T23:25:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.353+0000 7f8882957640 1 -- 172.21.15.2:0/1355426896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f887c109fc0 con 0x7f887c105a90 2024-09-15T23:25:00.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.354+0000 7f88797fa640 1 -- 172.21.15.2:0/1355426896 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11843 (secure 0 0 0) 0x7f88740bd480 con 0x7f887c105a90 2024-09-15T23:25:00.356 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:25:00.356 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"btime":"2024-09-15T23:12:51:758295+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1051460220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1051460220},{"type":"v1","addr":"172.21.15.2:6839","nonce":1051460220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/1583533983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":1583533983},{"type":"v1","addr":"172.21.15.2:6841","nonce":1583533983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/91315913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":91315913},{"type":"v1","addr":"172.21.15.145:6835","nonce":91315913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1066293931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":1066293931},{"type":"v1","addr":"172.21.15.145:6837","nonce":1066293931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/418078184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":418078184},{"type":"v1","addr":"172.21.15.112:6837","nonce":418078184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:12:42.434565+0000","modified":"2024-09-15T23:12:51.456432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3930825714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3930825714},{"type":"v1","addr":"172.21.15.145:6839","nonce":3930825714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/1380244119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1380244119},{"type":"v1","addr":"172.21.15.112:6839","nonce":1380244119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24464,"qdb_cluster":[24464]},"id":1}]} 2024-09-15T23:25:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-09-15T23:25:00.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.356+0000 7f8882957640 1 -- 172.21.15.2:0/1355426896 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f88640a33b0 msgr2=0x7f88640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.356+0000 7f8882957640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f88640a33b0 0x7f88640a5870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f886c0058c0 tx=0x7f886c00a250 comp rx=0 tx=0).stop 2024-09-15T23:25:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.356+0000 7f8882957640 1 -- 172.21.15.2:0/1355426896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f887c105a90 msgr2=0x7f887c19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.356+0000 7f8882957640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f887c105a90 0x7f887c19cc70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8874005e30 tx=0x7f8874033000 comp rx=0 tx=0).stop 2024-09-15T23:25:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.356+0000 7f8882957640 1 -- 172.21.15.2:0/1355426896 shutdown_connections 2024-09-15T23:25:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.356+0000 7f8882957640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f88640a33b0 0x7f88640a5870 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.356+0000 7f8882957640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f887c105a90 0x7f887c19cc70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.356+0000 7f8882957640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f887c101bc0 0x7f887c1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.356+0000 7f8882957640 1 --2- 172.21.15.2:0/1355426896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f887c101240 0x7f887c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.356+0000 7f8882957640 1 -- 172.21.15.2:0/1355426896 >> 172.21.15.2:0/1355426896 conn(0x7f887c077210 msgr2=0x7f887c1003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.356+0000 7f8882957640 1 -- 172.21.15.2:0/1355426896 shutdown_connections 2024-09-15T23:25:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:00.356+0000 7f8882957640 1 -- 172.21.15.2:0/1355426896 wait complete. 2024-09-15T23:25:01.102 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:25:01.366 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:25:01.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:01 smithi002 ceph-mon[31019]: pgmap v331: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:25:01.385 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:01 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1355426896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:25:01.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:01 smithi145 ceph-mon[34901]: pgmap v331: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:25:01.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:01 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1355426896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:25:01.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:01 smithi112 ceph-mon[34367]: pgmap v331: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:25:01.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:01 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1355426896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:25:01.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.847+0000 7fdabd5ee640 1 -- 172.21.15.2:0/108415328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdab8106a80 msgr2=0x7fdab8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.847+0000 7fdabd5ee640 1 --2- 172.21.15.2:0/108415328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdab8106a80 0x7fdab8106e60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009930 tx=0x7fdaa802a420 comp rx=0 tx=0).stop 2024-09-15T23:25:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.848+0000 7fdabd5ee640 1 -- 172.21.15.2:0/108415328 shutdown_connections 2024-09-15T23:25:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.848+0000 7fdabd5ee640 1 --2- 172.21.15.2:0/108415328 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdab8101420 0x7fdab810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.848+0000 7fdabd5ee640 1 --2- 172.21.15.2:0/108415328 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab8100a80 0x7fdab8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.848+0000 7fdabd5ee640 1 --2- 172.21.15.2:0/108415328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdab8106a80 0x7fdab8106e60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.848+0000 7fdabd5ee640 1 -- 172.21.15.2:0/108415328 >> 172.21.15.2:0/108415328 conn(0x7fdab80fc7a0 msgr2=0x7fdab80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.848+0000 7fdabd5ee640 1 -- 172.21.15.2:0/108415328 shutdown_connections 2024-09-15T23:25:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.848+0000 7fdabd5ee640 1 -- 172.21.15.2:0/108415328 wait complete. 2024-09-15T23:25:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.848+0000 7fdabd5ee640 1 Processor -- start 2024-09-15T23:25:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.848+0000 7fdabd5ee640 1 -- start start 2024-09-15T23:25:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdabd5ee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab8100a80 0x7fdab8197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdabd5ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdab8101420 0x7fdab8197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdabd5ee640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdab8106a80 0x7fdab819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdabd5ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdab8110d30 con 0x7fdab8101420 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdabd5ee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdab8110bb0 con 0x7fdab8100a80 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdabd5ee640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdab8110eb0 con 0x7fdab8106a80 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdaaffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdab8101420 0x7fdab8197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdaaffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdab8101420 0x7fdab8197770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48502/0 (socket says 172.21.15.2:48502) 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdaaffff640 1 -- 172.21.15.2:0/190513766 learned_addr learned my addr 172.21.15.2:0/190513766 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdab6ffd640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab8100a80 0x7fdab8197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdab77fe640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdab8106a80 0x7fdab819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdaaffff640 1 -- 172.21.15.2:0/190513766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdab8106a80 msgr2=0x7fdab819bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdaaffff640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdab8106a80 0x7fdab819bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdaaffff640 1 -- 172.21.15.2:0/190513766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab8100a80 msgr2=0x7fdab8197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdaaffff640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab8100a80 0x7fdab8197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdaaffff640 1 -- 172.21.15.2:0/190513766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab819c1e0 con 0x7fdab8101420 2024-09-15T23:25:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdab6ffd640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab8100a80 0x7fdab8197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:25:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdaaffff640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdab8101420 0x7fdab8197770 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000d950 tx=0x7fdaa000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdab4ff9640 1 -- 172.21.15.2:0/190513766 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0017070 con 0x7fdab8101420 2024-09-15T23:25:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdab4ff9640 1 -- 172.21.15.2:0/190513766 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdaa0009c30 con 0x7fdab8101420 2024-09-15T23:25:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.849+0000 7fdabd5ee640 1 -- 172.21.15.2:0/190513766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab819c4d0 con 0x7fdab8101420 2024-09-15T23:25:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.850+0000 7fdab4ff9640 1 -- 172.21.15.2:0/190513766 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa000f620 con 0x7fdab8101420 2024-09-15T23:25:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.850+0000 7fdabd5ee640 1 -- 172.21.15.2:0/190513766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab81a3db0 con 0x7fdab8101420 2024-09-15T23:25:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.851+0000 7fdaadffb640 1 -- 172.21.15.2:0/190513766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda9c005290 con 0x7fdab8101420 2024-09-15T23:25:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.852+0000 7fdab4ff9640 1 -- 172.21.15.2:0/190513766 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7fdaa00109a0 con 0x7fdab8101420 2024-09-15T23:25:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.852+0000 7fdab4ff9640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fdaa40a33b0 0x7fdaa40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.852+0000 7fdab6ffd640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fdaa40a33b0 0x7fdaa40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.853+0000 7fdab4ff9640 1 -- 172.21.15.2:0/190513766 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8600+0+0 (secure 0 0 0) 0x7fdaa00cfa70 con 0x7fdab8101420 2024-09-15T23:25:01.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.853+0000 7fdab6ffd640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fdaa40a33b0 0x7fdaa40a5870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8000c00 tx=0x7fdaa8009610 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:01.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:01.857+0000 7fdab4ff9640 1 -- 172.21.15.2:0/190513766 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdaa0009de0 con 0x7fdab8101420 2024-09-15T23:25:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.072+0000 7fdaadffb640 1 -- 172.21.15.2:0/190513766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda9c005850 con 0x7fdab8101420 2024-09-15T23:25:02.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.072+0000 7fdab4ff9640 1 -- 172.21.15.2:0/190513766 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11843 (secure 0 0 0) 0x7fdaa009c400 con 0x7fdab8101420 2024-09-15T23:25:02.074 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:25:02.074 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"btime":"2024-09-15T23:12:51:758295+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14523,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3895460397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3895460397},{"type":"v1","addr":"172.21.15.2:6835","nonce":3895460397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2892386790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":2892386790},{"type":"v1","addr":"172.21.15.2:6837","nonce":2892386790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/1051460220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":1051460220},{"type":"v1","addr":"172.21.15.2:6839","nonce":1051460220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/1583533983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":1583533983},{"type":"v1","addr":"172.21.15.2:6841","nonce":1583533983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/3192333396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":3192333396},{"type":"v1","addr":"172.21.15.145:6833","nonce":3192333396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/4192340343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4192340343},{"type":"v1","addr":"172.21.15.112:6833","nonce":4192340343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24410,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2358660924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2358660924},{"type":"v1","addr":"172.21.15.112:6835","nonce":2358660924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/91315913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":91315913},{"type":"v1","addr":"172.21.15.145:6835","nonce":91315913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/1066293931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":1066293931},{"type":"v1","addr":"172.21.15.145:6837","nonce":1066293931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/418078184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":418078184},{"type":"v1","addr":"172.21.15.112:6837","nonce":418078184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:12:42.434565+0000","modified":"2024-09-15T23:12:51.456432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6839/3930825714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3930825714},{"type":"v1","addr":"172.21.15.145:6839","nonce":3930825714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/1380244119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":1380244119},{"type":"v1","addr":"172.21.15.112:6839","nonce":1380244119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24464,"qdb_cluster":[24464]},"id":1}]} 2024-09-15T23:25:02.074 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-09-15T23:25:02.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.075+0000 7fdaadffb640 1 -- 172.21.15.2:0/190513766 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fdaa40a33b0 msgr2=0x7fdaa40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:02.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.075+0000 7fdaadffb640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fdaa40a33b0 0x7fdaa40a5870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8000c00 tx=0x7fdaa8009610 comp rx=0 tx=0).stop 2024-09-15T23:25:02.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.075+0000 7fdaadffb640 1 -- 172.21.15.2:0/190513766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdab8101420 msgr2=0x7fdab8197770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:02.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.075+0000 7fdaadffb640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdab8101420 0x7fdab8197770 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000d950 tx=0x7fdaa000de10 comp rx=0 tx=0).stop 2024-09-15T23:25:02.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.075+0000 7fdaadffb640 1 -- 172.21.15.2:0/190513766 shutdown_connections 2024-09-15T23:25:02.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.075+0000 7fdaadffb640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fdaa40a33b0 0x7fdaa40a5870 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:02.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.075+0000 7fdaadffb640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdab8106a80 0x7fdab819bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:02.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.075+0000 7fdaadffb640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdab8101420 0x7fdab8197770 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:02.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.075+0000 7fdaadffb640 1 --2- 172.21.15.2:0/190513766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab8100a80 0x7fdab8197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:02.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.075+0000 7fdaadffb640 1 -- 172.21.15.2:0/190513766 >> 172.21.15.2:0/190513766 conn(0x7fdab80fc7a0 msgr2=0x7fdab80fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:02.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.075+0000 7fdaadffb640 1 -- 172.21.15.2:0/190513766 shutdown_connections 2024-09-15T23:25:02.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:02.075+0000 7fdaadffb640 1 -- 172.21.15.2:0/190513766 wait complete. 2024-09-15T23:25:02.416 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:02 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/190513766' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:25:02.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:02 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/190513766' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:25:02.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:02 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/190513766' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:25:02.783 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:25:03.042 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:25:03.417 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:03 smithi002 ceph-mon[31019]: pgmap v332: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:25:03.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:03 smithi145 ceph-mon[34901]: pgmap v332: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:25:03.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:03 smithi112 ceph-mon[34367]: pgmap v332: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:25:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.647+0000 7f9e00594640 1 -- 172.21.15.2:0/2555914744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df810c170 msgr2=0x7f9df810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.647+0000 7f9e00594640 1 --2- 172.21.15.2:0/2555914744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df810c170 0x7f9df810e610 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009ca0 tx=0x7f9df002a950 comp rx=0 tx=0).stop 2024-09-15T23:25:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.647+0000 7f9e00594640 1 -- 172.21.15.2:0/2555914744 shutdown_connections 2024-09-15T23:25:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.647+0000 7f9e00594640 1 --2- 172.21.15.2:0/2555914744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df810c170 0x7f9df810e610 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.647+0000 7f9e00594640 1 --2- 172.21.15.2:0/2555914744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9df8103660 0x7f9df810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.647+0000 7f9e00594640 1 --2- 172.21.15.2:0/2555914744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9df8102d40 0x7f9df8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.647+0000 7f9e00594640 1 -- 172.21.15.2:0/2555914744 >> 172.21.15.2:0/2555914744 conn(0x7f9df80fc7a0 msgr2=0x7f9df80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.647+0000 7f9e00594640 1 -- 172.21.15.2:0/2555914744 shutdown_connections 2024-09-15T23:25:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.647+0000 7f9e00594640 1 -- 172.21.15.2:0/2555914744 wait complete. 2024-09-15T23:25:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9e00594640 1 Processor -- start 2024-09-15T23:25:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9e00594640 1 -- start start 2024-09-15T23:25:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9e00594640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df8102d40 0x7f9df8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9e00594640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9df8103660 0x7f9df81988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9e00594640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9df810c170 0x7f9df819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9e00594640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9df8111e60 con 0x7f9df8102d40 2024-09-15T23:25:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9e00594640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9df8111ce0 con 0x7f9df8103660 2024-09-15T23:25:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9e00594640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9df8111fe0 con 0x7f9df810c170 2024-09-15T23:25:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9dfe330640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df8102d40 0x7f9df8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9dfe330640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df8102d40 0x7f9df8198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48518/0 (socket says 172.21.15.2:48518) 2024-09-15T23:25:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9dfe330640 1 -- 172.21.15.2:0/283350215 learned_addr learned my addr 172.21.15.2:0/283350215 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:25:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9dfdb2f640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9df8103660 0x7f9df81988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9dfeb31640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9df810c170 0x7f9df819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.648+0000 7f9dfe330640 1 -- 172.21.15.2:0/283350215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9df810c170 msgr2=0x7f9df819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.649+0000 7f9dfe330640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9df810c170 0x7f9df819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.649+0000 7f9dfe330640 1 -- 172.21.15.2:0/283350215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9df8103660 msgr2=0x7f9df81988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.649+0000 7f9dfe330640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9df8103660 0x7f9df81988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.649+0000 7f9dfe330640 1 -- 172.21.15.2:0/283350215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df819d330 con 0x7f9df8102d40 2024-09-15T23:25:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.649+0000 7f9dfdb2f640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9df8103660 0x7f9df81988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:25:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.649+0000 7f9dfeb31640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9df810c170 0x7f9df819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:25:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.649+0000 7f9dfe330640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df8102d40 0x7f9df8198380 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9df400c890 tx=0x7f9df400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.649+0000 7f9def7fe640 1 -- 172.21.15.2:0/283350215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df4004220 con 0x7f9df8102d40 2024-09-15T23:25:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.649+0000 7f9e00594640 1 -- 172.21.15.2:0/283350215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df819d620 con 0x7f9df8102d40 2024-09-15T23:25:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.649+0000 7f9def7fe640 1 -- 172.21.15.2:0/283350215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9df40043c0 con 0x7f9df8102d40 2024-09-15T23:25:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.649+0000 7f9def7fe640 1 -- 172.21.15.2:0/283350215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df4004a00 con 0x7f9df8102d40 2024-09-15T23:25:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.649+0000 7f9e00594640 1 -- 172.21.15.2:0/283350215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df81a4f00 con 0x7f9df8102d40 2024-09-15T23:25:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.650+0000 7f9e00594640 1 -- 172.21.15.2:0/283350215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df8103120 con 0x7f9df8102d40 2024-09-15T23:25:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.651+0000 7f9def7fe640 1 -- 172.21.15.2:0/283350215 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7f9df4004ba0 con 0x7f9df8102d40 2024-09-15T23:25:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.652+0000 7f9def7fe640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f9de40a33b0 0x7f9de40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.652+0000 7f9def7fe640 1 -- 172.21.15.2:0/283350215 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8600+0+0 (secure 0 0 0) 0x7f9df40cfef0 con 0x7f9df8102d40 2024-09-15T23:25:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.652+0000 7f9dfdb2f640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f9de40a33b0 0x7f9de40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.653+0000 7f9dfdb2f640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f9de40a33b0 0x7f9de40a5870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9df80feda0 tx=0x7f9de8008040 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.655+0000 7f9def7fe640 1 -- 172.21.15.2:0/283350215 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9df4014030 con 0x7f9df8102d40 2024-09-15T23:25:03.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.833+0000 7f9e00594640 1 -- 172.21.15.2:0/283350215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9df81996e0 con 0x7f9df8102d40 2024-09-15T23:25:03.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.835+0000 7f9def7fe640 1 -- 172.21.15.2:0/283350215 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+23232 (secure 0 0 0) 0x7f9df409c880 con 0x7f9df8102d40 2024-09-15T23:25:03.836 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-15T23:25:03.836 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":94,"fsid":"cb7ab3ae-73b6-11ef-bceb-c7b262605968","created":"2024-09-15T23:04:45.101432+0000","modified":"2024-09-15T23:24:10.154697+0000","last_up_change":"2024-09-15T23:11:49.566858+0000","last_in_change":"2024-09-15T23:11:25.723093+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:07:57.919291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:38.100522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:40.716254+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"40ff4fd9-3904-4178-a9cb-51f4647be540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6803","nonce":280991401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6805","nonce":280991401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6809","nonce":280991401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":280991401},{"type":"v1","addr":"172.21.15.2:6807","nonce":280991401}]},"public_addr":"172.21.15.2:6803/280991401","cluster_addr":"172.21.15.2:6805/280991401","heartbeat_back_addr":"172.21.15.2:6809/280991401","heartbeat_front_addr":"172.21.15.2:6807/280991401","state":["exists","up"]},{"osd":1,"uuid":"af5e265d-fe45-4d9c-a34c-6f0b103d75d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6801","nonce":2649210970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6803","nonce":2649210970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6807","nonce":2649210970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":2649210970},{"type":"v1","addr":"172.21.15.112:6805","nonce":2649210970}]},"public_addr":"172.21.15.112:6801/2649210970","cluster_addr":"172.21.15.112:6803/2649210970","heartbeat_back_addr":"172.21.15.112:6807/2649210970","heartbeat_front_addr":"172.21.15.112:6805/2649210970","state":["exists","up"]},{"osd":2,"uuid":"8df9e644-fc51-4626-a1a7-6ac4448a5b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6801","nonce":3485615437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6803","nonce":3485615437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6807","nonce":3485615437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3485615437},{"type":"v1","addr":"172.21.15.145:6805","nonce":3485615437}]},"public_addr":"172.21.15.145:6801/3485615437","cluster_addr":"172.21.15.145:6803/3485615437","heartbeat_back_addr":"172.21.15.145:6807/3485615437","heartbeat_front_addr":"172.21.15.145:6805/3485615437","state":["exists","up"]},{"osd":3,"uuid":"dbab372a-8fdd-4b0c-bee3-16cd75b35ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6811","nonce":113061968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6813","nonce":113061968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6817","nonce":113061968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":113061968},{"type":"v1","addr":"172.21.15.2:6815","nonce":113061968}]},"public_addr":"172.21.15.2:6811/113061968","cluster_addr":"172.21.15.2:6813/113061968","heartbeat_back_addr":"172.21.15.2:6817/113061968","heartbeat_front_addr":"172.21.15.2:6815/113061968","state":["exists","up"]},{"osd":4,"uuid":"73bab8af-3973-4beb-a034-d00bcf0c572f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6809","nonce":2519162767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6811","nonce":2519162767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6815","nonce":2519162767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2519162767},{"type":"v1","addr":"172.21.15.112:6813","nonce":2519162767}]},"public_addr":"172.21.15.112:6809/2519162767","cluster_addr":"172.21.15.112:6811/2519162767","heartbeat_back_addr":"172.21.15.112:6815/2519162767","heartbeat_front_addr":"172.21.15.112:6813/2519162767","state":["exists","up"]},{"osd":5,"uuid":"2d163e61-5891-46c1-b1c2-39d50a3b6f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6809","nonce":712427242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6811","nonce":712427242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6815","nonce":712427242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":712427242},{"type":"v1","addr":"172.21.15.145:6813","nonce":712427242}]},"public_addr":"172.21.15.145:6809/712427242","cluster_addr":"172.21.15.145:6811/712427242","heartbeat_back_addr":"172.21.15.145:6815/712427242","heartbeat_front_addr":"172.21.15.145:6813/712427242","state":["exists","up"]},{"osd":6,"uuid":"bca02c96-10de-4953-96e9-42fc9ddf7c1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6819","nonce":2930673197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6821","nonce":2930673197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6825","nonce":2930673197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2930673197},{"type":"v1","addr":"172.21.15.2:6823","nonce":2930673197}]},"public_addr":"172.21.15.2:6819/2930673197","cluster_addr":"172.21.15.2:6821/2930673197","heartbeat_back_addr":"172.21.15.2:6825/2930673197","heartbeat_front_addr":"172.21.15.2:6823/2930673197","state":["exists","up"]},{"osd":7,"uuid":"4101ed8d-1ef8-4a65-a8bd-ec035cd19d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6817","nonce":830628191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6819","nonce":830628191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6823","nonce":830628191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":830628191},{"type":"v1","addr":"172.21.15.112:6821","nonce":830628191}]},"public_addr":"172.21.15.112:6817/830628191","cluster_addr":"172.21.15.112:6819/830628191","heartbeat_back_addr":"172.21.15.112:6823/830628191","heartbeat_front_addr":"172.21.15.112:6821/830628191","state":["exists","up"]},{"osd":8,"uuid":"2733f9dd-3872-4bec-9c22-bcdb64828ae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6817","nonce":3634470540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6819","nonce":3634470540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6823","nonce":3634470540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3634470540},{"type":"v1","addr":"172.21.15.145:6821","nonce":3634470540}]},"public_addr":"172.21.15.145:6817/3634470540","cluster_addr":"172.21.15.145:6819/3634470540","heartbeat_back_addr":"172.21.15.145:6823/3634470540","heartbeat_front_addr":"172.21.15.145:6821/3634470540","state":["exists","up"]},{"osd":9,"uuid":"bd1f4a4a-547c-43a9-859a-75b37b06905f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6827","nonce":1417377702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6829","nonce":1417377702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6833","nonce":1417377702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1417377702},{"type":"v1","addr":"172.21.15.2:6831","nonce":1417377702}]},"public_addr":"172.21.15.2:6827/1417377702","cluster_addr":"172.21.15.2:6829/1417377702","heartbeat_back_addr":"172.21.15.2:6833/1417377702","heartbeat_front_addr":"172.21.15.2:6831/1417377702","state":["exists","up"]},{"osd":10,"uuid":"f8b895e8-39f5-4753-9343-03f96da12246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6825","nonce":105615908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6827","nonce":105615908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6831","nonce":105615908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":105615908},{"type":"v1","addr":"172.21.15.112:6829","nonce":105615908}]},"public_addr":"172.21.15.112:6825/105615908","cluster_addr":"172.21.15.112:6827/105615908","heartbeat_back_addr":"172.21.15.112:6831/105615908","heartbeat_front_addr":"172.21.15.112:6829/105615908","state":["exists","up"]},{"osd":11,"uuid":"dc018bfc-bc13-4ef2-a712-5cd406a56cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6825","nonce":430484289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6827","nonce":430484289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6831","nonce":430484289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":430484289},{"type":"v1","addr":"172.21.15.145:6829","nonce":430484289}]},"public_addr":"172.21.15.145:6825/430484289","cluster_addr":"172.21.15.145:6827/430484289","heartbeat_back_addr":"172.21.15.145:6831/430484289","heartbeat_front_addr":"172.21.15.145:6829/430484289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:03.938207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:29.814740+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:07:54.853802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:20.802021+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:08:47.028090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:13.226130+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:09:39.003023+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:04.465156+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:29.321331+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:10:55.992585+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:21.623406+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:48.269840+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/4076310741":"2024-09-16T23:14:23.506414+0000","172.21.15.2:6801/2564114882":"2024-09-16T23:14:23.506414+0000","172.21.15.2:6800/2564114882":"2024-09-16T23:14:23.506414+0000","172.21.15.2:6801/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/236781836":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6800/2652608868":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/1891095221":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/3802152324":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/2404111366":"2024-09-16T23:05:17.756048+0000","172.21.15.2:6800/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:6801/938645794":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/2473316249":"2024-09-16T23:14:23.506414+0000","172.21.15.2:0/896502743":"2024-09-16T23:05:17.756048+0000","172.21.15.2:0/2956732837":"2024-09-16T23:05:41.416672+0000","172.21.15.2:0/4081748544":"2024-09-16T23:14:23.506414+0000","172.21.15.2:0/3363964546":"2024-09-16T23:14:23.506414+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:25:03.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.837+0000 7f9e00594640 1 -- 172.21.15.2:0/283350215 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f9de40a33b0 msgr2=0x7f9de40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:03.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.837+0000 7f9e00594640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f9de40a33b0 0x7f9de40a5870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9df80feda0 tx=0x7f9de8008040 comp rx=0 tx=0).stop 2024-09-15T23:25:03.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.837+0000 7f9e00594640 1 -- 172.21.15.2:0/283350215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df8102d40 msgr2=0x7f9df8198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:03.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.837+0000 7f9e00594640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df8102d40 0x7f9df8198380 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9df400c890 tx=0x7f9df400cd50 comp rx=0 tx=0).stop 2024-09-15T23:25:03.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.837+0000 7f9e00594640 1 -- 172.21.15.2:0/283350215 shutdown_connections 2024-09-15T23:25:03.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.837+0000 7f9e00594640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f9de40a33b0 0x7f9de40a5870 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:03.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.837+0000 7f9e00594640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9df810c170 0x7f9df819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:03.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.837+0000 7f9e00594640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9df8103660 0x7f9df81988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:03.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.837+0000 7f9e00594640 1 --2- 172.21.15.2:0/283350215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9df8102d40 0x7f9df8198380 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:03.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.837+0000 7f9e00594640 1 -- 172.21.15.2:0/283350215 >> 172.21.15.2:0/283350215 conn(0x7f9df80fc7a0 msgr2=0x7f9df80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:03.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.837+0000 7f9e00594640 1 -- 172.21.15.2:0/283350215 shutdown_connections 2024-09-15T23:25:03.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:03.837+0000 7f9e00594640 1 -- 172.21.15.2:0/283350215 wait complete. 2024-09-15T23:25:04.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:04 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/283350215' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:25:04.469 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:04 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/283350215' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:25:04.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:04 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/283350215' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:25:04.500 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-15T23:25:04.758 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:25:05.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.271+0000 7fc74cca8640 1 -- 172.21.15.2:0/1594612605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc748106f10 msgr2=0x7fc74810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:05.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.271+0000 7fc74cca8640 1 --2- 172.21.15.2:0/1594612605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc748106f10 0x7fc74810ea90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc740009ca0 tx=0x7fc74002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:25:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.272+0000 7fc74cca8640 1 -- 172.21.15.2:0/1594612605 shutdown_connections 2024-09-15T23:25:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.272+0000 7fc74cca8640 1 --2- 172.21.15.2:0/1594612605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc748106f10 0x7fc74810ea90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.272+0000 7fc74cca8640 1 --2- 172.21.15.2:0/1594612605 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc748102790 0x7fc7481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.272+0000 7fc74cca8640 1 --2- 172.21.15.2:0/1594612605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc748101de0 0x7fc7481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.272+0000 7fc74cca8640 1 -- 172.21.15.2:0/1594612605 >> 172.21.15.2:0/1594612605 conn(0x7fc7480fd8c0 msgr2=0x7fc7480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.272+0000 7fc74cca8640 1 -- 172.21.15.2:0/1594612605 shutdown_connections 2024-09-15T23:25:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.272+0000 7fc74cca8640 1 -- 172.21.15.2:0/1594612605 wait complete. 2024-09-15T23:25:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.272+0000 7fc74cca8640 1 Processor -- start 2024-09-15T23:25:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.272+0000 7fc74cca8640 1 -- start start 2024-09-15T23:25:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74cca8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc748101de0 0x7fc748198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74cca8640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc748102790 0x7fc748198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74cca8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc748106f10 0x7fc74819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74cca8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc748111e20 con 0x7fc748101de0 2024-09-15T23:25:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74cca8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc748111ca0 con 0x7fc748106f10 2024-09-15T23:25:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74cca8640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc748111fa0 con 0x7fc748102790 2024-09-15T23:25:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc748101de0 0x7fc748198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc748101de0 0x7fc748198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48544/0 (socket says 172.21.15.2:48544) 2024-09-15T23:25:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74659c640 1 -- 172.21.15.2:0/1955220061 learned_addr learned my addr 172.21.15.2:0/1955220061 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:25:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc746d9d640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc748106f10 0x7fc74819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc73ffff640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc748102790 0x7fc748198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74659c640 1 -- 172.21.15.2:0/1955220061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc748102790 msgr2=0x7fc748198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74659c640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc748102790 0x7fc748198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74659c640 1 -- 172.21.15.2:0/1955220061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc748106f10 msgr2=0x7fc74819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74659c640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc748106f10 0x7fc74819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74659c640 1 -- 172.21.15.2:0/1955220061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc74819d2d0 con 0x7fc748101de0 2024-09-15T23:25:05.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc74659c640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc748101de0 0x7fc748198320 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc73800d950 tx=0x7fc73800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:05.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.273+0000 7fc73f7fe640 1 -- 172.21.15.2:0/1955220061 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738017070 con 0x7fc748101de0 2024-09-15T23:25:05.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.274+0000 7fc73f7fe640 1 -- 172.21.15.2:0/1955220061 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc738009c30 con 0x7fc748101de0 2024-09-15T23:25:05.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.274+0000 7fc74cca8640 1 -- 172.21.15.2:0/1955220061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc74819d5c0 con 0x7fc748101de0 2024-09-15T23:25:05.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.274+0000 7fc73f7fe640 1 -- 172.21.15.2:0/1955220061 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73800f620 con 0x7fc748101de0 2024-09-15T23:25:05.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.274+0000 7fc74cca8640 1 -- 172.21.15.2:0/1955220061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7481a4ea0 con 0x7fc748101de0 2024-09-15T23:25:05.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.275+0000 7fc74cca8640 1 -- 172.21.15.2:0/1955220061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7481021c0 con 0x7fc748101de0 2024-09-15T23:25:05.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.276+0000 7fc73f7fe640 1 -- 172.21.15.2:0/1955220061 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7fc7380109a0 con 0x7fc748101de0 2024-09-15T23:25:05.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.276+0000 7fc73f7fe640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fc7340a3430 0x7fc7340a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:05.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.277+0000 7fc73ffff640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fc7340a3430 0x7fc7340a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:05.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.277+0000 7fc73f7fe640 1 -- 172.21.15.2:0/1955220061 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8600+0+0 (secure 0 0 0) 0x7fc7380cf930 con 0x7fc748101de0 2024-09-15T23:25:05.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.277+0000 7fc73ffff640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fc7340a3430 0x7fc7340a58f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc730005fd0 tx=0x7fc73000b510 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:05.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.281+0000 7fc73f7fe640 1 -- 172.21.15.2:0/1955220061 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc738009de0 con 0x7fc748101de0 2024-09-15T23:25:05.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:05 smithi145 ceph-mon[34901]: pgmap v333: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:25:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.493+0000 7fc74cca8640 1 -- 172.21.15.2:0/1955220061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc74810a1b0 con 0x7fc748101de0 2024-09-15T23:25:05.495 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:05 smithi002 ceph-mon[31019]: pgmap v333: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:25:05.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:05 smithi112 ceph-mon[34367]: pgmap v333: 97 pgs: 97 active+clean; 309 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:25:05.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.496+0000 7fc73f7fe640 1 -- 172.21.15.2:0/1955220061 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) ==== 161+0+0 (secure 0 0 0) 0x7fc73809c2c0 con 0x7fc748101de0 2024-09-15T23:25:05.497 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:25:05.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.499+0000 7fc74cca8640 1 -- 172.21.15.2:0/1955220061 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fc7340a3430 msgr2=0x7fc7340a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.499+0000 7fc74cca8640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fc7340a3430 0x7fc7340a58f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc730005fd0 tx=0x7fc73000b510 comp rx=0 tx=0).stop 2024-09-15T23:25:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.499+0000 7fc74cca8640 1 -- 172.21.15.2:0/1955220061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc748101de0 msgr2=0x7fc748198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.499+0000 7fc74cca8640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc748101de0 0x7fc748198320 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc73800d950 tx=0x7fc73800de10 comp rx=0 tx=0).stop 2024-09-15T23:25:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.499+0000 7fc74cca8640 1 -- 172.21.15.2:0/1955220061 shutdown_connections 2024-09-15T23:25:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.499+0000 7fc74cca8640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fc7340a3430 0x7fc7340a58f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.499+0000 7fc74cca8640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc748106f10 0x7fc74819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.499+0000 7fc74cca8640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc748102790 0x7fc748198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.499+0000 7fc74cca8640 1 --2- 172.21.15.2:0/1955220061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc748101de0 0x7fc748198320 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.499+0000 7fc74cca8640 1 -- 172.21.15.2:0/1955220061 >> 172.21.15.2:0/1955220061 conn(0x7fc7480fd8c0 msgr2=0x7fc7480feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.499+0000 7fc74cca8640 1 -- 172.21.15.2:0/1955220061 shutdown_connections 2024-09-15T23:25:05.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:05.499+0000 7fc74cca8640 1 -- 172.21.15.2:0/1955220061 wait complete. 2024-09-15T23:25:05.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:05 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a[31015]: 2024-09-15T23:25:05.494+0000 7f4612ee3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:25:05.958 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:25:05 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-i[64874]: ignoring --setuser ceph since I am not root 2024-09-15T23:25:05.958 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:25:05 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-i[64874]: ignoring --setgroup ceph since I am not root 2024-09-15T23:25:05.959 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:25:05 smithi145 ceph-mds[64878]: -- 172.21.15.145:0/3804223689 <== mon.1 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556f959a9860 con 0x556f95987000 2024-09-15T23:25:05.959 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:25:05 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-i[64874]: starting mds.i at 2024-09-15T23:25:05.996 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:25:05 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b[64564]: ignoring --setuser ceph since I am not root 2024-09-15T23:25:05.996 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:25:05 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b[64564]: ignoring --setgroup ceph since I am not root 2024-09-15T23:25:05.997 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:25:05 smithi112 ceph-mds[64568]: -- 172.21.15.112:0/2861839239 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e086f6f860 con 0x55e086f4d000 2024-09-15T23:25:05.997 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:25:05 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b[64564]: starting mds.b at 2024-09-15T23:25:06.157 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:25:06.415 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:25:06.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:06 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1955220061' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T23:25:06.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:06 smithi145 ceph-mon[34901]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T23:25:06.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:06 smithi145 ceph-mon[34901]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:25:06.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:06 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1955220061' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T23:25:06.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:06 smithi145 ceph-mon[34901]: osdmap e95: 12 total, 12 up, 12 in 2024-09-15T23:25:06.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:06 smithi145 ceph-mon[34901]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-15T23:25:06.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:06 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1955220061' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T23:25:06.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:06 smithi112 ceph-mon[34367]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T23:25:06.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:06 smithi112 ceph-mon[34367]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:25:06.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:06 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1955220061' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T23:25:06.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:06 smithi112 ceph-mon[34367]: osdmap e95: 12 total, 12 up, 12 in 2024-09-15T23:25:06.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:06 smithi112 ceph-mon[34367]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-15T23:25:06.535 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:06 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1955220061' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T23:25:06.536 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:06 smithi002 ceph-mon[31019]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T23:25:06.536 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:06 smithi002 ceph-mon[31019]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:25:06.536 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:06 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1955220061' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T23:25:06.536 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:06 smithi002 ceph-mon[31019]: osdmap e95: 12 total, 12 up, 12 in 2024-09-15T23:25:06.536 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:06 smithi002 ceph-mon[31019]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-15T23:25:06.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.939+0000 7f7c75f94640 1 -- 172.21.15.2:0/2750114547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c70100a60 msgr2=0x7f7c70100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:06.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.939+0000 7f7c75f94640 1 --2- 172.21.15.2:0/2750114547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c70100a60 0x7f7c70100ec0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009930 tx=0x7f7c6402a420 comp rx=0 tx=0).stop 2024-09-15T23:25:06.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.940+0000 7f7c75f94640 1 -- 172.21.15.2:0/2750114547 shutdown_connections 2024-09-15T23:25:06.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.940+0000 7f7c75f94640 1 --2- 172.21.15.2:0/2750114547 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c70101400 0x7f7c7010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:06.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.940+0000 7f7c75f94640 1 --2- 172.21.15.2:0/2750114547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c70100a60 0x7f7c70100ec0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:06.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.940+0000 7f7c75f94640 1 --2- 172.21.15.2:0/2750114547 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c70106a60 0x7f7c70106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:06.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.940+0000 7f7c75f94640 1 -- 172.21.15.2:0/2750114547 >> 172.21.15.2:0/2750114547 conn(0x7f7c700fc780 msgr2=0x7f7c700feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:06.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.940+0000 7f7c75f94640 1 -- 172.21.15.2:0/2750114547 shutdown_connections 2024-09-15T23:25:06.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.940+0000 7f7c75f94640 1 -- 172.21.15.2:0/2750114547 wait complete. 2024-09-15T23:25:06.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.940+0000 7f7c75f94640 1 Processor -- start 2024-09-15T23:25:06.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.940+0000 7f7c75f94640 1 -- start start 2024-09-15T23:25:06.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c75f94640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c70100a60 0x7f7c70199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:06.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c75f94640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c70101400 0x7f7c701997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:06.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c75f94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c70106a60 0x7f7c701a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:06.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c75f94640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c70110d10 con 0x7f7c70106a60 2024-09-15T23:25:06.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c75f94640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7c70110b90 con 0x7f7c70100a60 2024-09-15T23:25:06.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c75f94640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7c70110e90 con 0x7f7c70101400 2024-09-15T23:25:06.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c6ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c70106a60 0x7f7c701a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:06.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c6ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c70106a60 0x7f7c701a42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60738/0 (socket says 172.21.15.2:60738) 2024-09-15T23:25:06.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c6ffff640 1 -- 172.21.15.2:0/1772857099 learned_addr learned my addr 172.21.15.2:0/1772857099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:25:06.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c6f7fe640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c70100a60 0x7f7c70199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:06.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c6effd640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c70101400 0x7f7c701997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:06.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c6ffff640 1 -- 172.21.15.2:0/1772857099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c70101400 msgr2=0x7f7c701997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:06.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c6ffff640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c70101400 0x7f7c701997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:06.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c6ffff640 1 -- 172.21.15.2:0/1772857099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c70100a60 msgr2=0x7f7c70199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:06.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c6ffff640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c70100a60 0x7f7c70199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:06.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c6ffff640 1 -- 172.21.15.2:0/1772857099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c701a4830 con 0x7f7c70106a60 2024-09-15T23:25:06.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.941+0000 7f7c6ffff640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c70106a60 0x7f7c701a42f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009fd0 tx=0x7f7c6800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:06.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.942+0000 7f7c6cff9640 1 -- 172.21.15.2:0/1772857099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c68017070 con 0x7f7c70106a60 2024-09-15T23:25:06.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.942+0000 7f7c6cff9640 1 -- 172.21.15.2:0/1772857099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c68003e20 con 0x7f7c70106a60 2024-09-15T23:25:06.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.942+0000 7f7c75f94640 1 -- 172.21.15.2:0/1772857099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c701a4a00 con 0x7f7c70106a60 2024-09-15T23:25:06.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.942+0000 7f7c6cff9640 1 -- 172.21.15.2:0/1772857099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c68010460 con 0x7f7c70106a60 2024-09-15T23:25:06.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.942+0000 7f7c75f94640 1 -- 172.21.15.2:0/1772857099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c701a4ec0 con 0x7f7c70106a60 2024-09-15T23:25:06.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.943+0000 7f7c75f94640 1 -- 172.21.15.2:0/1772857099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c70100ec0 con 0x7f7c70106a60 2024-09-15T23:25:06.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.944+0000 7f7c6cff9640 1 -- 172.21.15.2:0/1772857099 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7f7c68003970 con 0x7f7c70106a60 2024-09-15T23:25:06.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.945+0000 7f7c6cff9640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f7c580a3430 0x7f7c580a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:06.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.945+0000 7f7c6f7fe640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f7c580a3430 0x7f7c580a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:06.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.945+0000 7f7c6cff9640 1 -- 172.21.15.2:0/1772857099 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8642+0+0 (secure 0 0 0) 0x7f7c680cfb80 con 0x7f7c70106a60 2024-09-15T23:25:06.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.945+0000 7f7c6f7fe640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f7c580a3430 0x7f7c580a58f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c60005fd0 tx=0x7f7c6000b390 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:06.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:06.949+0000 7f7c6cff9640 1 -- 172.21.15.2:0/1772857099 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c6809c4e0 con 0x7f7c70106a60 2024-09-15T23:25:07.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.161+0000 7f7c75f94640 1 -- 172.21.15.2:0/1772857099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7c70108fd0 con 0x7f7c70106a60 2024-09-15T23:25:07.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:07 smithi145 ceph-mon[34901]: pgmap v335: 97 pgs: 97 active+clean; 309 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T23:25:07.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:07 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.145:6838/443244057,v1:172.21.15.145:6839/443244057] up:boot 2024-09-15T23:25:07.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:07 smithi145 ceph-mon[34901]: mds.? [v2:172.21.15.112:6838/2326092599,v1:172.21.15.112:6839/2326092599] up:boot 2024-09-15T23:25:07.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:07 smithi145 ceph-mon[34901]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-15T23:25:07.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:07 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:25:07.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:07 smithi145 ceph-mon[34901]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:25:07.458 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:07 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1772857099' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:25:07.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:07 smithi112 ceph-mon[34367]: pgmap v335: 97 pgs: 97 active+clean; 309 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T23:25:07.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:07 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.145:6838/443244057,v1:172.21.15.145:6839/443244057] up:boot 2024-09-15T23:25:07.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:07 smithi112 ceph-mon[34367]: mds.? [v2:172.21.15.112:6838/2326092599,v1:172.21.15.112:6839/2326092599] up:boot 2024-09-15T23:25:07.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:07 smithi112 ceph-mon[34367]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-15T23:25:07.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:07 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:25:07.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:07 smithi112 ceph-mon[34367]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:25:07.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:07 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1772857099' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:25:07.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.502+0000 7f7c6cff9640 1 -- 172.21.15.2:0/1772857099 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f7c6809bde0 con 0x7f7c70106a60 2024-09-15T23:25:07.503 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:07 smithi002 ceph-mon[31019]: pgmap v335: 97 pgs: 97 active+clean; 309 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T23:25:07.503 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:07 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.145:6838/443244057,v1:172.21.15.145:6839/443244057] up:boot 2024-09-15T23:25:07.504 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:07 smithi002 ceph-mon[31019]: mds.? [v2:172.21.15.112:6838/2326092599,v1:172.21.15.112:6839/2326092599] up:boot 2024-09-15T23:25:07.504 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:07 smithi002 ceph-mon[31019]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-15T23:25:07.504 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:07 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:25:07.504 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:07 smithi002 ceph-mon[31019]: from='mgr.15054 172.21.15.2:0/605191979' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:25:07.504 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:07 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1772857099' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:25:07.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.504+0000 7f7c75f94640 1 -- 172.21.15.2:0/1772857099 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f7c580a3430 msgr2=0x7f7c580a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:07.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.504+0000 7f7c75f94640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f7c580a3430 0x7f7c580a58f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c60005fd0 tx=0x7f7c6000b390 comp rx=0 tx=0).stop 2024-09-15T23:25:07.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.505+0000 7f7c75f94640 1 -- 172.21.15.2:0/1772857099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c70106a60 msgr2=0x7f7c701a42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:07.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.505+0000 7f7c75f94640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c70106a60 0x7f7c701a42f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7c68009fd0 tx=0x7f7c6800b260 comp rx=0 tx=0).stop 2024-09-15T23:25:07.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.505+0000 7f7c75f94640 1 -- 172.21.15.2:0/1772857099 shutdown_connections 2024-09-15T23:25:07.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.505+0000 7f7c75f94640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f7c580a3430 0x7f7c580a58f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:07.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.505+0000 7f7c75f94640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c70106a60 0x7f7c701a42f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:07.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.505+0000 7f7c75f94640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c70101400 0x7f7c701997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:07.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.505+0000 7f7c75f94640 1 --2- 172.21.15.2:0/1772857099 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c70100a60 0x7f7c70199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:07.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.505+0000 7f7c75f94640 1 -- 172.21.15.2:0/1772857099 >> 172.21.15.2:0/1772857099 conn(0x7f7c700fc780 msgr2=0x7f7c700fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:07.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.505+0000 7f7c75f94640 1 -- 172.21.15.2:0/1772857099 shutdown_connections 2024-09-15T23:25:07.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:07.505+0000 7f7c75f94640 1 -- 172.21.15.2:0/1772857099 wait complete. 2024-09-15T23:25:08.163 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:25:08.426 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:25:08.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:08 smithi145 ceph-mon[34901]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T23:25:08.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:08 smithi145 ceph-mon[34901]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T23:25:08.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:08 smithi145 ceph-mon[34901]: Cluster is now healthy 2024-09-15T23:25:08.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:08 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/1772857099' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:25:08.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:08 smithi145 ceph-mon[34901]: fsmap 12 up:standby 2024-09-15T23:25:08.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:08 smithi112 ceph-mon[34367]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T23:25:08.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:08 smithi112 ceph-mon[34367]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T23:25:08.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:08 smithi112 ceph-mon[34367]: Cluster is now healthy 2024-09-15T23:25:08.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:08 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/1772857099' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:25:08.497 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:08 smithi112 ceph-mon[34367]: fsmap 12 up:standby 2024-09-15T23:25:08.547 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:08 smithi002 ceph-mon[31019]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T23:25:08.547 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:08 smithi002 ceph-mon[31019]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T23:25:08.547 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:08 smithi002 ceph-mon[31019]: Cluster is now healthy 2024-09-15T23:25:08.547 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:08 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/1772857099' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:25:08.547 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:08 smithi002 ceph-mon[31019]: fsmap 12 up:standby 2024-09-15T23:25:09.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.000+0000 7f9a6fe28640 1 -- 172.21.15.2:0/2441176365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a68101de0 msgr2=0x7f9a681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.000+0000 7f9a6fe28640 1 --2- 172.21.15.2:0/2441176365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a68101de0 0x7f9a681021c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009900 tx=0x7f9a6402a3f0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.000+0000 7f9a6fe28640 1 -- 172.21.15.2:0/2441176365 shutdown_connections 2024-09-15T23:25:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.000+0000 7f9a6fe28640 1 --2- 172.21.15.2:0/2441176365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a68106f10 0x7f9a6810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.000+0000 7f9a6fe28640 1 --2- 172.21.15.2:0/2441176365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a68102790 0x7f9a681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.000+0000 7f9a6fe28640 1 --2- 172.21.15.2:0/2441176365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a68101de0 0x7f9a681021c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.000+0000 7f9a6fe28640 1 -- 172.21.15.2:0/2441176365 >> 172.21.15.2:0/2441176365 conn(0x7f9a680fd8c0 msgr2=0x7f9a680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.000+0000 7f9a6fe28640 1 -- 172.21.15.2:0/2441176365 shutdown_connections 2024-09-15T23:25:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.000+0000 7f9a6fe28640 1 -- 172.21.15.2:0/2441176365 wait complete. 2024-09-15T23:25:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.001+0000 7f9a6fe28640 1 Processor -- start 2024-09-15T23:25:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.001+0000 7f9a6fe28640 1 -- start start 2024-09-15T23:25:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.001+0000 7f9a6fe28640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a68101de0 0x7f9a68198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.001+0000 7f9a6fe28640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a68102790 0x7f9a68198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.001+0000 7f9a6fe28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a68106f10 0x7f9a6819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.001+0000 7f9a6fe28640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9a68111de0 con 0x7f9a68106f10 2024-09-15T23:25:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.001+0000 7f9a6fe28640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9a68111c60 con 0x7f9a68102790 2024-09-15T23:25:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.001+0000 7f9a6fe28640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9a68111f60 con 0x7f9a68101de0 2024-09-15T23:25:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.001+0000 7f9a6e3c5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a68106f10 0x7f9a6819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.001+0000 7f9a6e3c5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a68106f10 0x7f9a6819cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60756/0 (socket says 172.21.15.2:60756) 2024-09-15T23:25:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.001+0000 7f9a6e3c5640 1 -- 172.21.15.2:0/3267370129 learned_addr learned my addr 172.21.15.2:0/3267370129 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:25:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.001+0000 7f9a6dbc4640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a68101de0 0x7f9a68198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.002+0000 7f9a6d3c3640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a68102790 0x7f9a68198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.002+0000 7f9a6e3c5640 1 -- 172.21.15.2:0/3267370129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a68101de0 msgr2=0x7f9a68198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.002+0000 7f9a6e3c5640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a68101de0 0x7f9a68198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.002+0000 7f9a6e3c5640 1 -- 172.21.15.2:0/3267370129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a68102790 msgr2=0x7f9a68198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.002+0000 7f9a6e3c5640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a68102790 0x7f9a68198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.002+0000 7f9a6e3c5640 1 -- 172.21.15.2:0/3267370129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6819d1f0 con 0x7f9a68106f10 2024-09-15T23:25:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.002+0000 7f9a6e3c5640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a68106f10 0x7f9a6819cb10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000cce0 tx=0x7f9a6000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.002+0000 7f9a5effd640 1 -- 172.21.15.2:0/3267370129 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000f450 con 0x7f9a68106f10 2024-09-15T23:25:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.002+0000 7f9a5effd640 1 -- 172.21.15.2:0/3267370129 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9a6000faa0 con 0x7f9a68106f10 2024-09-15T23:25:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.002+0000 7f9a5effd640 1 -- 172.21.15.2:0/3267370129 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60018b70 con 0x7f9a68106f10 2024-09-15T23:25:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.002+0000 7f9a6fe28640 1 -- 172.21.15.2:0/3267370129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6819d4e0 con 0x7f9a68106f10 2024-09-15T23:25:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.002+0000 7f9a6fe28640 1 -- 172.21.15.2:0/3267370129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a681a4dc0 con 0x7f9a68106f10 2024-09-15T23:25:09.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.003+0000 7f9a6fe28640 1 -- 172.21.15.2:0/3267370129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a681021c0 con 0x7f9a68106f10 2024-09-15T23:25:09.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.004+0000 7f9a5effd640 1 -- 172.21.15.2:0/3267370129 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7f9a60018d10 con 0x7f9a68106f10 2024-09-15T23:25:09.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.005+0000 7f9a5effd640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f9a540a33b0 0x7f9a540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:09.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.005+0000 7f9a6dbc4640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f9a540a33b0 0x7f9a540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:09.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.005+0000 7f9a5effd640 1 -- 172.21.15.2:0/3267370129 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8642+0+0 (secure 0 0 0) 0x7f9a600d0280 con 0x7f9a68106f10 2024-09-15T23:25:09.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.006+0000 7f9a6dbc4640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f9a540a33b0 0x7f9a540a5870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9a64031440 tx=0x7f9a640095f0 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:09.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.009+0000 7f9a5effd640 1 -- 172.21.15.2:0/3267370129 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a60014030 con 0x7f9a68106f10 2024-09-15T23:25:09.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.185+0000 7f9a6fe28640 1 -- 172.21.15.2:0/3267370129 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9a6802d7c0 con 0x7f9a68106f10 2024-09-15T23:25:09.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:09 smithi145 ceph-mon[34901]: pgmap v336: 97 pgs: 97 active+clean; 309 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T23:25:09.457 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:09 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3267370129' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:25:09.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:09 smithi112 ceph-mon[34367]: pgmap v336: 97 pgs: 97 active+clean; 309 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T23:25:09.496 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:09 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3267370129' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:25:09.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.505+0000 7f9a5effd640 1 -- 172.21.15.2:0/3267370129 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) ==== 181+0+0 (secure 0 0 0) 0x7f9a6009cb80 con 0x7f9a68106f10 2024-09-15T23:25:09.506 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:25:09.506 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:09 smithi002 ceph-mon[31019]: pgmap v336: 97 pgs: 97 active+clean; 309 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T23:25:09.506 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:09 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3267370129' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:25:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.507+0000 7f9a6fe28640 1 -- 172.21.15.2:0/3267370129 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f9a540a33b0 msgr2=0x7f9a540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.507+0000 7f9a6fe28640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f9a540a33b0 0x7f9a540a5870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9a64031440 tx=0x7f9a640095f0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.507+0000 7f9a6fe28640 1 -- 172.21.15.2:0/3267370129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a68106f10 msgr2=0x7f9a6819cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:09.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.507+0000 7f9a6fe28640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a68106f10 0x7f9a6819cb10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000cce0 tx=0x7f9a6000a620 comp rx=0 tx=0).stop 2024-09-15T23:25:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.507+0000 7f9a6fe28640 1 -- 172.21.15.2:0/3267370129 shutdown_connections 2024-09-15T23:25:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.507+0000 7f9a6fe28640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7f9a540a33b0 0x7f9a540a5870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.507+0000 7f9a6fe28640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a68106f10 0x7f9a6819cb10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.507+0000 7f9a6fe28640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a68102790 0x7f9a68198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.507+0000 7f9a6fe28640 1 --2- 172.21.15.2:0/3267370129 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a68101de0 0x7f9a68198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.507+0000 7f9a6fe28640 1 -- 172.21.15.2:0/3267370129 >> 172.21.15.2:0/3267370129 conn(0x7f9a680fd8c0 msgr2=0x7f9a680febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.507+0000 7f9a6fe28640 1 -- 172.21.15.2:0/3267370129 shutdown_connections 2024-09-15T23:25:09.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:09.507+0000 7f9a6fe28640 1 -- 172.21.15.2:0/3267370129 wait complete. 2024-09-15T23:25:10.167 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:25:10.425 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:25:10.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:10 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/3267370129' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:25:10.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:10 smithi002 ceph-mon[31019]: osdmap e96: 12 total, 12 up, 12 in 2024-09-15T23:25:10.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:10 smithi002 ceph-mon[31019]: pgmap v338: 65 pgs: 65 active+clean; 115 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:25:10.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:10 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/3267370129' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:25:10.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:10 smithi145 ceph-mon[34901]: osdmap e96: 12 total, 12 up, 12 in 2024-09-15T23:25:10.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:10 smithi145 ceph-mon[34901]: pgmap v338: 65 pgs: 65 active+clean; 115 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:25:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.957+0000 7fe14a699640 1 -- 172.21.15.2:0/1292043988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe144106f10 msgr2=0x7fe14410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.957+0000 7fe14a699640 1 --2- 172.21.15.2:0/1292043988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe144106f10 0x7fe14410ea90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009ca0 tx=0x7fe13c02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:25:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.957+0000 7fe14a699640 1 -- 172.21.15.2:0/1292043988 shutdown_connections 2024-09-15T23:25:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.957+0000 7fe14a699640 1 --2- 172.21.15.2:0/1292043988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe144106f10 0x7fe14410ea90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.957+0000 7fe14a699640 1 --2- 172.21.15.2:0/1292043988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe144102790 0x7fe1441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.957+0000 7fe14a699640 1 --2- 172.21.15.2:0/1292043988 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe144101de0 0x7fe1441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.957+0000 7fe14a699640 1 -- 172.21.15.2:0/1292043988 >> 172.21.15.2:0/1292043988 conn(0x7fe1440fd8c0 msgr2=0x7fe1440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.957+0000 7fe14a699640 1 -- 172.21.15.2:0/1292043988 shutdown_connections 2024-09-15T23:25:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.957+0000 7fe14a699640 1 -- 172.21.15.2:0/1292043988 wait complete. 2024-09-15T23:25:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.958+0000 7fe14a699640 1 Processor -- start 2024-09-15T23:25:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.958+0000 7fe14a699640 1 -- start start 2024-09-15T23:25:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.958+0000 7fe14a699640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe144101de0 0x7fe1440744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.958+0000 7fe14a699640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe144102790 0x7fe144074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.958+0000 7fe14a699640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe144106f10 0x7fe144074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.958+0000 7fe14a699640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe144111e40 con 0x7fe144101de0 2024-09-15T23:25:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.958+0000 7fe14a699640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe144111cc0 con 0x7fe144106f10 2024-09-15T23:25:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.958+0000 7fe14a699640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe144111fc0 con 0x7fe144102790 2024-09-15T23:25:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.958+0000 7fe143fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe144101de0 0x7fe1440744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.958+0000 7fe143fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe144101de0 0x7fe1440744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60770/0 (socket says 172.21.15.2:60770) 2024-09-15T23:25:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.958+0000 7fe143fff640 1 -- 172.21.15.2:0/567840066 learned_addr learned my addr 172.21.15.2:0/567840066 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-15T23:25:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe148c36640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe144106f10 0x7fe144074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:10.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe1437fe640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe144102790 0x7fe144074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe143fff640 1 -- 172.21.15.2:0/567840066 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe144102790 msgr2=0x7fe144074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe143fff640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe144102790 0x7fe144074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe143fff640 1 -- 172.21.15.2:0/567840066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe144106f10 msgr2=0x7fe144074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe143fff640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe144106f10 0x7fe144074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe143fff640 1 -- 172.21.15.2:0/567840066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1441a67e0 con 0x7fe144101de0 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe148c36640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe144106f10 0x7fe144074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe143fff640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe144101de0 0x7fe1440744f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b4a0 tx=0x7fe13400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe1417fa640 1 -- 172.21.15.2:0/567840066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134014070 con 0x7fe144101de0 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe1417fa640 1 -- 172.21.15.2:0/567840066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe134010ac0 con 0x7fe144101de0 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe14a699640 1 -- 172.21.15.2:0/567840066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1441a6ad0 con 0x7fe144101de0 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe1417fa640 1 -- 172.21.15.2:0/567840066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134017c30 con 0x7fe144101de0 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.959+0000 7fe14a699640 1 -- 172.21.15.2:0/567840066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1441a6fc0 con 0x7fe144101de0 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.960+0000 7fe14a699640 1 -- 172.21.15.2:0/567840066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1441021c0 con 0x7fe144101de0 2024-09-15T23:25:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.961+0000 7fe1417fa640 1 -- 172.21.15.2:0/567840066 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 138485+0+0 (secure 0 0 0) 0x7fe134017070 con 0x7fe144101de0 2024-09-15T23:25:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.962+0000 7fe1417fa640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fe12c0a33b0 0x7fe12c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.962+0000 7fe1437fe640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fe12c0a33b0 0x7fe12c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.963+0000 7fe1417fa640 1 -- 172.21.15.2:0/567840066 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8059+0+0 (secure 0 0 0) 0x7fe1340cf320 con 0x7fe144101de0 2024-09-15T23:25:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.963+0000 7fe1437fe640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fe12c0a33b0 0x7fe12c0a5870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe138005e10 tx=0x7fe138005da0 comp rx=0 tx=0).ready entity=mgr.15054 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:10.966+0000 7fe1417fa640 1 -- 172.21.15.2:0/567840066 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe13409bf90 con 0x7fe144101de0 2024-09-15T23:25:10.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:10 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/3267370129' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:25:10.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:10 smithi112 ceph-mon[34367]: osdmap e96: 12 total, 12 up, 12 in 2024-09-15T23:25:10.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:10 smithi112 ceph-mon[34367]: pgmap v338: 65 pgs: 65 active+clean; 115 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:25:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.142+0000 7fe14a699640 1 -- 172.21.15.2:0/567840066 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe144075a20 con 0x7fe144101de0 2024-09-15T23:25:11.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.516+0000 7fe1417fa640 1 -- 172.21.15.2:0/567840066 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) ==== 169+0+0 (secure 0 0 0) 0x7fe144075a20 con 0x7fe144101de0 2024-09-15T23:25:11.518 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-09-15T23:25:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.519+0000 7fe14a699640 1 -- 172.21.15.2:0/567840066 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fe12c0a33b0 msgr2=0x7fe12c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.519+0000 7fe14a699640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fe12c0a33b0 0x7fe12c0a5870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe138005e10 tx=0x7fe138005da0 comp rx=0 tx=0).stop 2024-09-15T23:25:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.520+0000 7fe14a699640 1 -- 172.21.15.2:0/567840066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe144101de0 msgr2=0x7fe1440744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.520+0000 7fe14a699640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe144101de0 0x7fe1440744f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b4a0 tx=0x7fe13400b960 comp rx=0 tx=0).stop 2024-09-15T23:25:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.520+0000 7fe14a699640 1 -- 172.21.15.2:0/567840066 shutdown_connections 2024-09-15T23:25:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.520+0000 7fe14a699640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.2:6800/1306494062,v1:172.21.15.2:6801/1306494062] conn(0x7fe12c0a33b0 0x7fe12c0a5870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.520+0000 7fe14a699640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe144106f10 0x7fe144074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.520+0000 7fe14a699640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe144102790 0x7fe144074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.520+0000 7fe14a699640 1 --2- 172.21.15.2:0/567840066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe144101de0 0x7fe1440744f0 secure :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b4a0 tx=0x7fe13400b960 comp rx=0 tx=0).stop 2024-09-15T23:25:11.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.520+0000 7fe14a699640 1 -- 172.21.15.2:0/567840066 >> 172.21.15.2:0/567840066 conn(0x7fe1440fd8c0 msgr2=0x7fe1440fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:11.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.521+0000 7fe14a699640 1 -- 172.21.15.2:0/567840066 shutdown_connections 2024-09-15T23:25:11.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-15T23:25:11.521+0000 7fe14a699640 1 -- 172.21.15.2:0/567840066 wait complete. 2024-09-15T23:25:11.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:11 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/567840066' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:25:11.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:11 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/567840066' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:25:11.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:11 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/567840066' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:25:12.168 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:25:12.197 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:25:12.226 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:25:12.262 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-15T23:25:12.262 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T23:25:12.279 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T23:25:12.294 DEBUG:teuthology.orchestra.run.smithi145:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T23:25:12.319 INFO:tasks.cephadm:Stopping all daemons... 2024-09-15T23:25:12.319 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-15T23:25:12.319 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.a 2024-09-15T23:25:12.486 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:12 smithi002 systemd[1]: Stopping Ceph mon.a for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:25:12.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:12 smithi002 ceph-mon[31019]: from='client.? 172.21.15.2:0/567840066' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:25:12.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:12 smithi002 ceph-mon[31019]: osdmap e97: 12 total, 12 up, 12 in 2024-09-15T23:25:12.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:12 smithi002 ceph-mon[31019]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:25:12.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:12 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a[31015]: 2024-09-15T23:25:12.641+0000 7f46186ee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:25:12.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:12 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a[31015]: 2024-09-15T23:25:12.641+0000 7f46186ee640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-15T23:25:12.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:12 smithi002 podman[424598]: 2024-09-15 23:25:12.67399284 +0000 UTC m=+0.149339331 container died 0ce84f8b0ca9570d654bc99e38872ba993ecc29927864f3da17fcdc7bf11b068 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T23:25:12.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:12 smithi145 ceph-mon[34901]: from='client.? 172.21.15.2:0/567840066' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:25:12.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:12 smithi145 ceph-mon[34901]: osdmap e97: 12 total, 12 up, 12 in 2024-09-15T23:25:12.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:12 smithi145 ceph-mon[34901]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:25:12.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:12 smithi112 ceph-mon[34367]: from='client.? 172.21.15.2:0/567840066' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:25:12.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:12 smithi112 ceph-mon[34367]: osdmap e97: 12 total, 12 up, 12 in 2024-09-15T23:25:12.996 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:12 smithi112 ceph-mon[34367]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:25:13.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:13 smithi002 podman[424598]: 2024-09-15 23:25:13.032007446 +0000 UTC m=+0.507353922 container cleanup 0ce84f8b0ca9570d654bc99e38872ba993ecc29927864f3da17fcdc7bf11b068 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:25:13.308 INFO:journalctl@ceph.mon.a.smithi002.stdout:Sep 15 23:25:13 smithi002 bash[424598]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-a 2024-09-15T23:25:13.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.a.service' 2024-09-15T23:25:13.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:25:13.506 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-15T23:25:13.506 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-15T23:25:13.506 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.b 2024-09-15T23:25:13.823 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:13 smithi112 systemd[1]: Stopping Ceph mon.b for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:25:14.246 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:13 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-b[34363]: 2024-09-15T23:25:13.822+0000 7f544fb32640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:25:14.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:13 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-b[34363]: 2024-09-15T23:25:13.822+0000 7f544fb32640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-15T23:25:14.247 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:13 smithi112 podman[69584]: 2024-09-15 23:25:13.996443517 +0000 UTC m=+0.293212242 container died 13d6f16dcb23b0f06d6ae763c7aa63a508f62bc0e7b2d006aa9ceed37b35235d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-15T23:25:14.694 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:14 smithi112 podman[69584]: 2024-09-15 23:25:14.41445932 +0000 UTC m=+0.711228037 container cleanup 13d6f16dcb23b0f06d6ae763c7aa63a508f62bc0e7b2d006aa9ceed37b35235d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:25:14.695 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:14 smithi112 bash[69584]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-b 2024-09-15T23:25:14.969 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 15 23:25:14 smithi112 podman[69595]: 2024-09-15 23:25:14.694335933 +0000 UTC m=+0.699250130 container remove 13d6f16dcb23b0f06d6ae763c7aa63a508f62bc0e7b2d006aa9ceed37b35235d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-b, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-15T23:25:14.984 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.b.service' 2024-09-15T23:25:15.029 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:25:15.030 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-15T23:25:15.030 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-15T23:25:15.030 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.c 2024-09-15T23:25:15.334 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:15 smithi145 systemd[1]: Stopping Ceph mon.c for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:25:15.627 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:15 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-c[34897]: 2024-09-15T23:25:15.333+0000 7f90f49ff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:25:15.627 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:15 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-c[34897]: 2024-09-15T23:25:15.333+0000 7f90f49ff640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-15T23:25:15.627 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:15 smithi145 podman[70350]: 2024-09-15 23:25:15.364544858 +0000 UTC m=+0.134347964 container died 8a6e68471bbdc00d8b091e57896b657906cd5ee8d4010256b5a46f5f6bb4d354 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_CLEAN=True) 2024-09-15T23:25:15.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:15 smithi145 podman[70350]: 2024-09-15 23:25:15.709115996 +0000 UTC m=+0.478919097 container cleanup 8a6e68471bbdc00d8b091e57896b657906cd5ee8d4010256b5a46f5f6bb4d354 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, org.label-schema.vendor=CentOS) 2024-09-15T23:25:15.957 INFO:journalctl@ceph.mon.c.smithi145.stdout:Sep 15 23:25:15 smithi145 bash[70350]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mon-c 2024-09-15T23:25:16.190 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mon.c.service' 2024-09-15T23:25:16.239 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:25:16.239 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-15T23:25:16.239 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-15T23:25:16.239 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.x 2024-09-15T23:25:16.558 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:25:16 smithi002 systemd[1]: Stopping Ceph mgr.x for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:25:16.888 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:25:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x[31246]: 2024-09-15T23:25:16.561+0000 7f8239930640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:25:16.888 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:25:16 smithi002 podman[424732]: 2024-09-15 23:25:16.59277795 +0000 UTC m=+0.163872723 container died 318dcf0efa63269f097bab95021d58816409df7b2ea40fd13e5c89aa0d7ab118 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-15T23:25:17.247 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:25:16 smithi002 podman[424732]: 2024-09-15 23:25:16.978577627 +0000 UTC m=+0.549672397 container cleanup 318dcf0efa63269f097bab95021d58816409df7b2ea40fd13e5c89aa0d7ab118 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-15T23:25:17.247 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Sep 15 23:25:16 smithi002 bash[424732]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-x 2024-09-15T23:25:17.416 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-15T23:25:17.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:25:17.455 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-15T23:25:17.455 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-15T23:25:17.456 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.y 2024-09-15T23:25:17.746 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:25:17 smithi112 systemd[1]: Stopping Ceph mgr.y for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:25:18.129 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:25:17 smithi112 podman[69704]: 2024-09-15 23:25:17.814616712 +0000 UTC m=+0.157726030 container died 657b3f07186c9b200e2638be90094b2da08d3601bb8b10ff0fb8bd6787f265f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:25:18.455 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:25:18 smithi112 podman[69704]: 2024-09-15 23:25:18.228134041 +0000 UTC m=+0.571243356 container cleanup 657b3f07186c9b200e2638be90094b2da08d3601bb8b10ff0fb8bd6787f265f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e) 2024-09-15T23:25:18.455 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 15 23:25:18 smithi112 bash[69704]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-y 2024-09-15T23:25:18.610 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-15T23:25:18.647 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:25:18.647 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-15T23:25:18.647 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-15T23:25:18.647 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.z 2024-09-15T23:25:18.957 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:25:18 smithi145 systemd[1]: Stopping Ceph mgr.z for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:25:19.299 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:25:18 smithi145 podman[70471]: 2024-09-15 23:25:18.978434556 +0000 UTC m=+0.145309913 container died 443e6d5a71de7cf0ff9a2f911a63d89177c25abb7a64444b0db62dc56139143e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e) 2024-09-15T23:25:19.707 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:25:19 smithi145 podman[70471]: 2024-09-15 23:25:19.398172727 +0000 UTC m=+0.565048073 container cleanup 443e6d5a71de7cf0ff9a2f911a63d89177c25abb7a64444b0db62dc56139143e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-15T23:25:19.707 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:25:19 smithi145 bash[70471]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z 2024-09-15T23:25:20.053 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:25:19 smithi145 podman[70483]: 2024-09-15 23:25:19.791772621 +0000 UTC m=+0.817580571 container remove 443e6d5a71de7cf0ff9a2f911a63d89177c25abb7a64444b0db62dc56139143e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mgr-z, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-15T23:25:20.054 INFO:journalctl@ceph.mgr.z.smithi145.stdout:Sep 15 23:25:19 smithi145 systemd[1]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-15T23:25:20.077 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-15T23:25:20.111 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:25:20.112 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-15T23:25:20.112 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-15T23:25:20.112 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.0 2024-09-15T23:25:20.425 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:20 smithi002 systemd[1]: Stopping Ceph osd.0 for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:25:20.808 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:20 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0[42558]: 2024-09-15T23:25:20.424+0000 7f1294ed8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:25:20.808 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:20 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0[42558]: 2024-09-15T23:25:20.424+0000 7f1294ed8640 -1 osd.0 97 *** Got signal Terminated *** 2024-09-15T23:25:20.808 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:20 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0[42558]: 2024-09-15T23:25:20.424+0000 7f1294ed8640 -1 osd.0 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:25:26.058 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:25 smithi002 podman[424853]: 2024-09-15 23:25:25.80254074 +0000 UTC m=+5.490553802 container died 7c17064c85c4c7a71d54e08e44210d7df14e44810c43851da257866986de0f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:25:26.558 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:26 smithi002 podman[424853]: 2024-09-15 23:25:26.308480926 +0000 UTC m=+5.996493990 container cleanup 7c17064c85c4c7a71d54e08e44210d7df14e44810c43851da257866986de0f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-15T23:25:26.558 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:26 smithi002 bash[424853]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0 2024-09-15T23:25:26.824 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:26 smithi002 podman[424871]: 2024-09-15 23:25:26.559887548 +0000 UTC m=+0.753870454 container remove 7c17064c85c4c7a71d54e08e44210d7df14e44810c43851da257866986de0f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-15T23:25:27.107 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:26 smithi002 podman[424958]: 2024-09-15 23:25:26.832146095 +0000 UTC m=+0.018184220 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:25:27.108 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:26 smithi002 podman[424958]: 2024-09-15 23:25:26.977651999 +0000 UTC m=+0.163690113 container create 7b73f08f8daff9787099aa737e06f427832e41249cc35142f1e3b3c7a5278994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-15T23:25:27.443 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:27 smithi002 podman[424958]: 2024-09-15 23:25:27.238717799 +0000 UTC m=+0.424755914 container init 7b73f08f8daff9787099aa737e06f427832e41249cc35142f1e3b3c7a5278994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:25:27.444 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:27 smithi002 podman[424958]: 2024-09-15 23:25:27.242301441 +0000 UTC m=+0.428339558 container start 7b73f08f8daff9787099aa737e06f427832e41249cc35142f1e3b3c7a5278994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:25:27.444 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:27 smithi002 podman[424958]: 2024-09-15 23:25:27.338562425 +0000 UTC m=+0.524600551 container attach 7b73f08f8daff9787099aa737e06f427832e41249cc35142f1e3b3c7a5278994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-15T23:25:27.734 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 15 23:25:27 smithi002 podman[424958]: 2024-09-15 23:25:27.443533459 +0000 UTC m=+0.629571576 container died 7b73f08f8daff9787099aa737e06f427832e41249cc35142f1e3b3c7a5278994 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-15T23:25:28.064 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.0.service' 2024-09-15T23:25:28.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:25:28.107 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-15T23:25:28.107 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-15T23:25:28.108 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.1 2024-09-15T23:25:28.425 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:28 smithi112 systemd[1]: Stopping Ceph osd.1 for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:25:28.748 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:28 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1[38827]: 2024-09-15T23:25:28.423+0000 7f09ad516640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:25:28.748 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:28 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1[38827]: 2024-09-15T23:25:28.423+0000 7f09ad516640 -1 osd.1 97 *** Got signal Terminated *** 2024-09-15T23:25:28.748 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:28 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1[38827]: 2024-09-15T23:25:28.423+0000 7f09ad516640 -1 osd.1 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:25:34.246 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:33 smithi112 podman[69840]: 2024-09-15 23:25:33.915765909 +0000 UTC m=+5.597352494 container died 843111b734e1bbbe05b154a501b2c2dcd1e56cd06cd520ff14d1a67336d42c49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-15T23:25:34.685 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:34 smithi112 podman[69840]: 2024-09-15 23:25:34.424789054 +0000 UTC m=+6.106375642 container cleanup 843111b734e1bbbe05b154a501b2c2dcd1e56cd06cd520ff14d1a67336d42c49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-15T23:25:34.685 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:34 smithi112 bash[69840]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1 2024-09-15T23:25:34.996 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:34 smithi112 podman[69855]: 2024-09-15 23:25:34.684744017 +0000 UTC m=+0.767977630 container remove 843111b734e1bbbe05b154a501b2c2dcd1e56cd06cd520ff14d1a67336d42c49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-8921c8e) 2024-09-15T23:25:35.380 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:35 smithi112 podman[69943]: 2024-09-15 23:25:34.993779201 +0000 UTC m=+0.015579360 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:25:35.380 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:35 smithi112 podman[69943]: 2024-09-15 23:25:35.110522578 +0000 UTC m=+0.132322739 container create eca99fd4b203086b791e7801428fd7f7c97a6bfda32d32746707eb83905cb756 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:25:35.747 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:35 smithi112 podman[69943]: 2024-09-15 23:25:35.37980824 +0000 UTC m=+0.401608404 container init eca99fd4b203086b791e7801428fd7f7c97a6bfda32d32746707eb83905cb756 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-15T23:25:35.747 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:35 smithi112 podman[69943]: 2024-09-15 23:25:35.383174395 +0000 UTC m=+0.404974564 container start eca99fd4b203086b791e7801428fd7f7c97a6bfda32d32746707eb83905cb756 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:25:35.747 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:35 smithi112 podman[69943]: 2024-09-15 23:25:35.496802125 +0000 UTC m=+0.518602294 container attach eca99fd4b203086b791e7801428fd7f7c97a6bfda32d32746707eb83905cb756 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-15T23:25:35.747 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 15 23:25:35 smithi112 podman[69943]: 2024-09-15 23:25:35.576711912 +0000 UTC m=+0.598512073 container died eca99fd4b203086b791e7801428fd7f7c97a6bfda32d32746707eb83905cb756 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-15T23:25:36.290 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.1.service' 2024-09-15T23:25:36.336 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:25:36.336 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-15T23:25:36.337 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-15T23:25:36.337 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.2 2024-09-15T23:25:36.671 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:36 smithi145 systemd[1]: Stopping Ceph osd.2 for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:25:36.957 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:36 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2[39857]: 2024-09-15T23:25:36.669+0000 7f1e310e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:25:36.957 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:36 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2[39857]: 2024-09-15T23:25:36.669+0000 7f1e310e6640 -1 osd.2 97 *** Got signal Terminated *** 2024-09-15T23:25:36.957 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:36 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2[39857]: 2024-09-15T23:25:36.669+0000 7f1e310e6640 -1 osd.2 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:25:42.313 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:42 smithi145 podman[70608]: 2024-09-15 23:25:42.045036606 +0000 UTC m=+5.511777050 container died d6594fa4735f77c2b348054f8dfb861b5336ae84a40cc28c5c26946d421c33b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:25:42.621 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:42 smithi145 podman[70608]: 2024-09-15 23:25:42.410714112 +0000 UTC m=+5.877454552 container cleanup d6594fa4735f77c2b348054f8dfb861b5336ae84a40cc28c5c26946d421c33b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:25:42.621 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:42 smithi145 bash[70608]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2 2024-09-15T23:25:42.957 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:42 smithi145 podman[70625]: 2024-09-15 23:25:42.620602429 +0000 UTC m=+0.570142339 container remove d6594fa4735f77c2b348054f8dfb861b5336ae84a40cc28c5c26946d421c33b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-15T23:25:43.349 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:43 smithi145 podman[70716]: 2024-09-15 23:25:42.929567381 +0000 UTC m=+0.015894975 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:25:43.349 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:43 smithi145 podman[70716]: 2024-09-15 23:25:43.063286909 +0000 UTC m=+0.149614505 container create 5ae503db5746f0871b4a8f420093c6c55189944bb0de9ef72467387957a1a0ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-15T23:25:43.350 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:43 smithi145 podman[70716]: 2024-09-15 23:25:43.349320132 +0000 UTC m=+0.435647722 container init 5ae503db5746f0871b4a8f420093c6c55189944bb0de9ef72467387957a1a0ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:25:43.707 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:43 smithi145 podman[70716]: 2024-09-15 23:25:43.352989191 +0000 UTC m=+0.439316786 container start 5ae503db5746f0871b4a8f420093c6c55189944bb0de9ef72467387957a1a0ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-15T23:25:43.707 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:43 smithi145 podman[70716]: 2024-09-15 23:25:43.449551739 +0000 UTC m=+0.535879328 container attach 5ae503db5746f0871b4a8f420093c6c55189944bb0de9ef72467387957a1a0ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-15T23:25:43.707 INFO:journalctl@ceph.osd.2.smithi145.stdout:Sep 15 23:25:43 smithi145 podman[70716]: 2024-09-15 23:25:43.542024337 +0000 UTC m=+0.628351927 container died 5ae503db5746f0871b4a8f420093c6c55189944bb0de9ef72467387957a1a0ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e) 2024-09-15T23:25:44.263 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.2.service' 2024-09-15T23:25:44.303 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:25:44.303 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-15T23:25:44.303 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-15T23:25:44.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.3 2024-09-15T23:25:44.637 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:44 smithi002 systemd[1]: Stopping Ceph osd.3 for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:25:45.019 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3[49300]: 2024-09-15T23:25:44.635+0000 7f7114e38640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:25:45.019 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3[49300]: 2024-09-15T23:25:44.635+0000 7f7114e38640 -1 osd.3 97 *** Got signal Terminated *** 2024-09-15T23:25:45.019 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:44 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3[49300]: 2024-09-15T23:25:44.635+0000 7f7114e38640 -1 osd.3 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:25:47.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:46 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:46.736+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:25:47.247 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:46 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:46.780+0000 7f0976a60640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:20.140315+0000 front 2024-09-15T23:25:20.140326+0000 (oldest deadline 2024-09-15T23:25:46.540761+0000) 2024-09-15T23:25:47.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:47 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:47.424+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:25:48.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:47 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:47.709+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:25:48.059 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:47 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:47.691+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:25:48.246 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:47 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:47.790+0000 7f0976a60640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:20.140315+0000 front 2024-09-15T23:25:20.140326+0000 (oldest deadline 2024-09-15T23:25:46.540761+0000) 2024-09-15T23:25:48.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:48 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:48.395+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:25:49.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:48 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:48.734+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:25:49.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:48 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:48.739+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:25:49.246 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:48 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:48.836+0000 7f0976a60640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:20.140315+0000 front 2024-09-15T23:25:20.140326+0000 (oldest deadline 2024-09-15T23:25:46.540761+0000) 2024-09-15T23:25:49.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:49 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:49.035+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:25:49.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:49 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:49.404+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:25:49.998 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:49 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:49.707+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:25:49.999 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:49 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:49.718+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:25:50.246 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:49 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:49.849+0000 7f0976a60640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:20.140315+0000 front 2024-09-15T23:25:20.140326+0000 (oldest deadline 2024-09-15T23:25:46.540761+0000) 2024-09-15T23:25:50.308 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:49 smithi002 podman[425061]: 2024-09-15 23:25:49.99762112 +0000 UTC m=+5.493659569 container died 5a16018da3217a7031cab52854f924ba447bed918392c9c5bab1497ad4c3a355 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:25:50.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:50 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:50.043+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:25:50.654 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:50 smithi002 podman[425061]: 2024-09-15 23:25:50.411243737 +0000 UTC m=+5.907282190 container cleanup 5a16018da3217a7031cab52854f924ba447bed918392c9c5bab1497ad4c3a355 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e) 2024-09-15T23:25:50.654 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:50 smithi002 bash[425061]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3 2024-09-15T23:25:50.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:50 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:50.402+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:25:50.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:50 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:50.625+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:25:50.978 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:50 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:50.730+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:25:50.979 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:50 smithi002 podman[425090]: 2024-09-15 23:25:50.654465852 +0000 UTC m=+0.649255045 container remove 5a16018da3217a7031cab52854f924ba447bed918392c9c5bab1497ad4c3a355 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-15T23:25:50.979 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:50 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:50.732+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:25:51.246 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:50 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:50.856+0000 7f0976a60640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:20.140315+0000 front 2024-09-15T23:25:20.140326+0000 (oldest deadline 2024-09-15T23:25:46.540761+0000) 2024-09-15T23:25:51.308 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:50 smithi002 podman[425179]: 2024-09-15 23:25:50.881075795 +0000 UTC m=+0.016263522 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:25:51.308 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:51 smithi002 podman[425179]: 2024-09-15 23:25:51.005677326 +0000 UTC m=+0.140865098 container create 7540dc09dc87ddaee75c26560c1b3b48d9182c4e69cf02c774c2e1298686a041 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-15T23:25:51.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:51 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:51.082+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:25:51.700 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:51 smithi002 podman[425179]: 2024-09-15 23:25:51.309744783 +0000 UTC m=+0.444932511 container init 7540dc09dc87ddaee75c26560c1b3b48d9182c4e69cf02c774c2e1298686a041 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e) 2024-09-15T23:25:51.700 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:51 smithi002 podman[425179]: 2024-09-15 23:25:51.313472998 +0000 UTC m=+0.448660731 container start 7540dc09dc87ddaee75c26560c1b3b48d9182c4e69cf02c774c2e1298686a041 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-15T23:25:51.701 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:51 smithi002 podman[425179]: 2024-09-15 23:25:51.408612876 +0000 UTC m=+0.543800603 container attach 7540dc09dc87ddaee75c26560c1b3b48d9182c4e69cf02c774c2e1298686a041 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-15T23:25:51.701 INFO:journalctl@ceph.osd.3.smithi002.stdout:Sep 15 23:25:51 smithi002 podman[425179]: 2024-09-15 23:25:51.503426947 +0000 UTC m=+0.638614674 container died 7540dc09dc87ddaee75c26560c1b3b48d9182c4e69cf02c774c2e1298686a041 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-15T23:25:51.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:51 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:51.421+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:25:51.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:51 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:51.606+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:25:52.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:51 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:51.698+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:25:52.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:51 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:51.719+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:25:52.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.3.service' 2024-09-15T23:25:52.247 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:51 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:51.819+0000 7f0976a60640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:20.140315+0000 front 2024-09-15T23:25:20.140326+0000 (oldest deadline 2024-09-15T23:25:46.540761+0000) 2024-09-15T23:25:52.261 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:25:52.261 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-15T23:25:52.261 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-15T23:25:52.261 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.4 2024-09-15T23:25:52.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:52 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:52.042+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:25:52.588 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:52 smithi112 systemd[1]: Stopping Ceph osd.4 for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:25:52.588 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:52 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:52.453+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:25:52.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:52 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:52.614+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:25:52.996 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:52 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:52.586+0000 7f097a44a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:25:52.996 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:52 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:52.586+0000 7f097a44a640 -1 osd.4 97 *** Got signal Terminated *** 2024-09-15T23:25:52.996 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:52 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:52.586+0000 7f097a44a640 -1 osd.4 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:25:52.996 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:52 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:52.829+0000 7f0976a60640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:20.140315+0000 front 2024-09-15T23:25:20.140326+0000 (oldest deadline 2024-09-15T23:25:46.540761+0000) 2024-09-15T23:25:53.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:52 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:52.737+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:25:53.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:52 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:52.725+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:25:53.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:53 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:52.998+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:25:53.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:53 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:53.452+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:25:53.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:53 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:53.601+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:25:54.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:53 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:53.692+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:25:54.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:53 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:53.698+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:25:54.246 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:53 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:53.815+0000 7f0976a60640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:20.140315+0000 front 2024-09-15T23:25:20.140326+0000 (oldest deadline 2024-09-15T23:25:46.540761+0000) 2024-09-15T23:25:54.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:54 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:54.013+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:25:54.748 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:54 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:54.457+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:25:54.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:25:54 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:25:54.572+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:25:54.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:54 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:54.642+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:25:55.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:54 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:54.697+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:25:55.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:54 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:54.698+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:25:55.246 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:54 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:54.844+0000 7f0976a60640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:20.140315+0000 front 2024-09-15T23:25:20.140326+0000 (oldest deadline 2024-09-15T23:25:46.540761+0000) 2024-09-15T23:25:55.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:54 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:54.995+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:25:55.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:55 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:55.424+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:25:55.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:55 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:55.424+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:25:55.964 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:25:55 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:25:55.545+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:25:55.964 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:55 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:55.627+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:25:55.964 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:55 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:55.627+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:25:56.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:55 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:55.667+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:25:56.059 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:55 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:55.663+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:25:56.246 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:55 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:55.827+0000 7f0976a60640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:20.140315+0000 front 2024-09-15T23:25:20.140326+0000 (oldest deadline 2024-09-15T23:25:46.540761+0000) 2024-09-15T23:25:56.247 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:25:56 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:25:56.052+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:25:56.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:56 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:56.017+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:25:56.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:56 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:56.017+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.344931+0000 front 2024-09-15T23:25:30.344917+0000 (oldest deadline 2024-09-15T23:25:55.644801+0000) 2024-09-15T23:25:56.728 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:25:56 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:25:56.521+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:25:56.728 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:56 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:56.581+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:25:56.728 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:56 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:56.581+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:25:56.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:56 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:56.458+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:25:56.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:56 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:56.458+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:25:57.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:56 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:56.680+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:25:57.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:56 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:56.623+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:25:57.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:56 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:56.623+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:25:57.246 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:56 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4[45712]: 2024-09-15T23:25:56.797+0000 7f0976a60640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:20.140315+0000 front 2024-09-15T23:25:20.140326+0000 (oldest deadline 2024-09-15T23:25:46.540761+0000) 2024-09-15T23:25:57.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:25:57 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:25:57.004+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:25:57.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:57 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:57.052+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:25:57.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:57 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:57.052+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.344931+0000 front 2024-09-15T23:25:30.344917+0000 (oldest deadline 2024-09-15T23:25:55.644801+0000) 2024-09-15T23:25:57.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:57 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:57.438+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:25:57.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:57 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:57.438+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:25:57.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:25:57 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:25:57.544+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:25:57.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:57 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:57.578+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:25:57.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:57 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:57.578+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:25:58.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:57 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:57.671+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:25:58.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:57 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:57.671+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:25:58.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:57 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:57.652+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:25:58.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:57 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:57.652+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:25:58.355 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:58 smithi112 podman[70047]: 2024-09-15 23:25:58.077777595 +0000 UTC m=+5.619425940 container died cbe747376844bc00ed9fcb3b8065a0d0a30606ef9332030bc5ea0cd42d92e8bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2) 2024-09-15T23:25:58.355 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:25:58 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:25:58.033+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:25:58.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:58 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:58.017+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:25:58.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:58 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:58.017+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.344931+0000 front 2024-09-15T23:25:30.344917+0000 (oldest deadline 2024-09-15T23:25:55.644801+0000) 2024-09-15T23:25:58.722 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:58 smithi112 podman[70047]: 2024-09-15 23:25:58.453270064 +0000 UTC m=+5.994918405 container cleanup cbe747376844bc00ed9fcb3b8065a0d0a30606ef9332030bc5ea0cd42d92e8bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD) 2024-09-15T23:25:58.722 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:58 smithi112 bash[70047]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4 2024-09-15T23:25:58.722 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:58 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:58.421+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:25:58.722 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:58 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:58.421+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:25:58.959 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:25:58 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:25:58.569+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:25:58.959 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:58 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:58.608+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:25:58.959 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:58 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:58.608+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:25:58.997 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:58 smithi112 podman[70062]: 2024-09-15 23:25:58.721599394 +0000 UTC m=+0.644641249 container remove cbe747376844bc00ed9fcb3b8065a0d0a30606ef9332030bc5ea0cd42d92e8bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-15T23:25:59.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:58 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:58.625+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:25:59.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:58 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:58.625+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:25:59.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:58 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:58.641+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:25:59.059 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:58 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:58.641+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:25:59.342 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:59 smithi112 podman[70151]: 2024-09-15 23:25:58.969539728 +0000 UTC m=+0.015875027 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:25:59.342 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:59 smithi112 podman[70151]: 2024-09-15 23:25:59.08923384 +0000 UTC m=+0.135569185 container create 6bd1266d1cf94125faf21b2f30f5fa5c98407d34c15e5380f5b8dbd5bb87ad2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-15T23:25:59.342 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:25:59 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:25:59.069+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:25:59.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:59 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:59.000+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:25:59.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:59 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:59.000+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.344931+0000 front 2024-09-15T23:25:30.344917+0000 (oldest deadline 2024-09-15T23:25:55.644801+0000) 2024-09-15T23:25:59.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:59 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:59.447+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:25:59.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:25:59 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:25:59.447+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:25:59.747 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:59 smithi112 podman[70151]: 2024-09-15 23:25:59.341713813 +0000 UTC m=+0.388049112 container init 6bd1266d1cf94125faf21b2f30f5fa5c98407d34c15e5380f5b8dbd5bb87ad2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e) 2024-09-15T23:25:59.747 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:59 smithi112 podman[70151]: 2024-09-15 23:25:59.345190052 +0000 UTC m=+0.391525351 container start 6bd1266d1cf94125faf21b2f30f5fa5c98407d34c15e5380f5b8dbd5bb87ad2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-15T23:25:59.747 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:59 smithi112 podman[70151]: 2024-09-15 23:25:59.450044285 +0000 UTC m=+0.496379600 container attach 6bd1266d1cf94125faf21b2f30f5fa5c98407d34c15e5380f5b8dbd5bb87ad2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-15T23:25:59.747 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 15 23:25:59 smithi112 podman[70151]: 2024-09-15 23:25:59.530126727 +0000 UTC m=+0.576462035 container died 6bd1266d1cf94125faf21b2f30f5fa5c98407d34c15e5380f5b8dbd5bb87ad2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-15T23:25:59.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:25:59 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:25:59.561+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:25:59.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:59 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:59.654+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:25:59.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:25:59 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:25:59.654+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:00.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:59 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:59.643+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:00.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:25:59 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:25:59.643+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:00.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:59 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:59.592+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:00.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:25:59 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:25:59.592+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:00.162 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:00 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:00.098+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:00.188 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.4.service' 2024-09-15T23:26:00.229 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:26:00.229 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-15T23:26:00.229 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-15T23:26:00.229 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.5 2024-09-15T23:26:00.258 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:59 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:59.985+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:26:00.258 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:25:59 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:25:59.985+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.344931+0000 front 2024-09-15T23:25:30.344917+0000 (oldest deadline 2024-09-15T23:25:55.644801+0000) 2024-09-15T23:26:00.515 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:00 smithi145 systemd[1]: Stopping Ceph osd.5 for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:26:00.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:00 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:00.487+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:00.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:00 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:00.487+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:00.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:00 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:00.533+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:00.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:00 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:00.629+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:00.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:00 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:00.629+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:00.958 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:00 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:00.513+0000 7fe5cc77a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:26:00.958 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:00 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:00.513+0000 7fe5cc77a640 -1 osd.5 97 *** Got signal Terminated *** 2024-09-15T23:26:00.958 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:00 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:00.513+0000 7fe5cc77a640 -1 osd.5 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:26:01.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:00 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:00.614+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:01.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:00 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:00.614+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:01.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:00 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:00.614+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:01.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:00 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:00.614+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:01.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:01 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:01.033+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:26:01.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:01 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:01.033+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.344931+0000 front 2024-09-15T23:25:30.344917+0000 (oldest deadline 2024-09-15T23:25:55.644801+0000) 2024-09-15T23:26:01.496 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:01 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:01.072+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:01.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:01 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:01.648+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:01.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:01 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:01.648+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:01.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:01 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:01.508+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:01.996 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:01 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:01.504+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:01.996 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:01 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:01.504+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:02.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:01 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:01.598+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:02.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:01 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:01.598+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:02.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:01 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:01.642+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:02.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:01 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:01.642+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:02.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:02 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:02.005+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:26:02.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:02 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:02.005+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.344931+0000 front 2024-09-15T23:25:30.344917+0000 (oldest deadline 2024-09-15T23:25:55.644801+0000) 2024-09-15T23:26:02.496 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:02 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:02.039+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:02.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:02 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:02.673+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:02.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:02 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:02.673+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:02.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:02 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:02.551+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:02.809 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:02 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:02.551+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:02.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:02 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:02.460+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:02.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:02 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:02.671+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:02.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:02 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:02.671+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:02.994 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:02 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:02.531+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:02.994 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:02 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:02.531+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:03.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:02 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:02.993+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:03.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:02 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:02.979+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:26:03.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:02 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:02.979+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.344931+0000 front 2024-09-15T23:25:30.344917+0000 (oldest deadline 2024-09-15T23:25:55.644801+0000) 2024-09-15T23:26:03.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:03 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:03.490+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:03.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:03 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:03.490+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:03.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:03 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:03.490+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:03.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:03 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:03.683+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:03.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:03 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:03.683+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:03.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:03 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:03.520+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:03.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:03 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:03.520+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:03.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:03 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:03.520+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.830074+0000 front 2024-09-15T23:25:39.830033+0000 (oldest deadline 2024-09-15T23:26:02.730111+0000) 2024-09-15T23:26:03.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:03 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:03.510+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:03.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:03 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:03.715+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:03.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:03 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:03.715+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:03.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:03 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:03.715+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:04.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:03 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:03.950+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:04.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:03 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:03.999+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:26:04.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:03 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:03.999+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.344931+0000 front 2024-09-15T23:25:30.344917+0000 (oldest deadline 2024-09-15T23:25:55.644801+0000) 2024-09-15T23:26:04.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:03 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:03.999+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:37.945642+0000 front 2024-09-15T23:25:37.945669+0000 (oldest deadline 2024-09-15T23:26:03.845845+0000) 2024-09-15T23:26:04.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:04 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:04.488+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:04.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:04 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:04.488+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:04.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:04 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:04.488+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:04.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:04 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:04.656+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:04.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:04 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:04.656+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:04.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:04 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:04.543+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:04.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:04 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:04.543+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:04.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:04 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:04.543+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.830074+0000 front 2024-09-15T23:25:39.830033+0000 (oldest deadline 2024-09-15T23:26:02.730111+0000) 2024-09-15T23:26:04.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:04 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:04.542+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:04.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:04 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:04.542+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:04.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:04 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:04.753+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:04.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:04 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:04.753+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:04.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:04 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:04.753+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:05.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:04 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:04.910+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:05.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:04 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:04.983+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:23.344205+0000 front 2024-09-15T23:25:23.344183+0000 (oldest deadline 2024-09-15T23:25:48.644024+0000) 2024-09-15T23:26:05.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:04 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:04.983+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.344931+0000 front 2024-09-15T23:25:30.344917+0000 (oldest deadline 2024-09-15T23:25:55.644801+0000) 2024-09-15T23:26:05.457 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:04 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5[46574]: 2024-09-15T23:26:04.983+0000 7fe5c4d88640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:37.945642+0000 front 2024-09-15T23:25:37.945669+0000 (oldest deadline 2024-09-15T23:26:03.845845+0000) 2024-09-15T23:26:05.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:05 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:05.492+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:05.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:05 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:05.492+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:05.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:05 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:05.492+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.830074+0000 front 2024-09-15T23:25:39.830033+0000 (oldest deadline 2024-09-15T23:26:02.730111+0000) 2024-09-15T23:26:05.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:05 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:05.692+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:05.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:05 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:05.692+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:05.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:05 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:05.692+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:05.869 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:05 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:05.526+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:05.869 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:05 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:05.526+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:05.869 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:05 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:05.526+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:05.929 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:05 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:05.756+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:05.929 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:05 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:05.756+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:05.929 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:05 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:05.756+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:05.929 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:05 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:05.555+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:05.929 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:05 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:05.555+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:06.207 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:05 smithi145 podman[70845]: 2024-09-15 23:26:05.927330258 +0000 UTC m=+5.499153501 container stop 161fe6a9e782fc50d63de165779119d841d2b8f7fff0f0c3213c55fd5fb53ca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:26:06.207 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:05 smithi145 podman[70845]: 2024-09-15 23:26:05.954523567 +0000 UTC m=+5.526346808 container died 161fe6a9e782fc50d63de165779119d841d2b8f7fff0f0c3213c55fd5fb53ca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-15T23:26:06.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:05 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:05.869+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:06.565 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:06 smithi145 podman[70845]: 2024-09-15 23:26:06.389419823 +0000 UTC m=+5.961243055 container cleanup 161fe6a9e782fc50d63de165779119d841d2b8f7fff0f0c3213c55fd5fb53ca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, ceph=True) 2024-09-15T23:26:06.565 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:06 smithi145 bash[70845]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5 2024-09-15T23:26:06.565 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:06 smithi145 podman[70862]: 2024-09-15 23:26:06.532246729 +0000 UTC m=+0.597620484 container remove 161fe6a9e782fc50d63de165779119d841d2b8f7fff0f0c3213c55fd5fb53ca9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:26:06.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:06 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:06.487+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:06.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:06 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:06.487+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:06.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:06 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:06.487+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:06.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:06 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:06.730+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:06.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:06 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:06.730+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:06.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:06 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:06.730+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:06.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:06 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:06.510+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:06.809 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:06 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:06.510+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:06.809 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:06 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:06.510+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.830074+0000 front 2024-09-15T23:25:39.830033+0000 (oldest deadline 2024-09-15T23:26:02.730111+0000) 2024-09-15T23:26:06.931 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:06 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:06.564+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:06.931 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:06 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:06.564+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:06.931 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:06 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:06.713+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:06.932 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:06 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:06.713+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:06.932 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:06 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:06.713+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:07.191 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:06 smithi145 podman[70949]: 2024-09-15 23:26:06.833527245 +0000 UTC m=+0.015421317 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:26:07.191 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:06 smithi145 podman[70949]: 2024-09-15 23:26:06.958127639 +0000 UTC m=+0.140021698 container create 510dad692bdb64587c8393a784391b4f9c05e9eb1d25ae9900e53faed87930e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:26:07.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:06 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:06.918+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:07.247 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:06 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:06.918+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:07.460 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:07 smithi145 podman[70949]: 2024-09-15 23:26:07.231163644 +0000 UTC m=+0.413057713 container init 510dad692bdb64587c8393a784391b4f9c05e9eb1d25ae9900e53faed87930e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e) 2024-09-15T23:26:07.460 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:07 smithi145 podman[70949]: 2024-09-15 23:26:07.23471553 +0000 UTC m=+0.416609600 container start 510dad692bdb64587c8393a784391b4f9c05e9eb1d25ae9900e53faed87930e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-15T23:26:07.461 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:07 smithi145 podman[70949]: 2024-09-15 23:26:07.369096724 +0000 UTC m=+0.550990793 container attach 510dad692bdb64587c8393a784391b4f9c05e9eb1d25ae9900e53faed87930e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-15T23:26:07.461 INFO:journalctl@ceph.osd.5.smithi145.stdout:Sep 15 23:26:07 smithi145 podman[70949]: 2024-09-15 23:26:07.429049375 +0000 UTC m=+0.610943440 container died 510dad692bdb64587c8393a784391b4f9c05e9eb1d25ae9900e53faed87930e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-15T23:26:07.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:07 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:07.476+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:07.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:07 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:07.476+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:07.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:07 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:07.476+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:07.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:07 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:07.474+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:07.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:07 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:07.474+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:07.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:07 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:07.474+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.830074+0000 front 2024-09-15T23:25:39.830033+0000 (oldest deadline 2024-09-15T23:26:02.730111+0000) 2024-09-15T23:26:07.809 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:07 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:07.708+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:07.809 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:07 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:07.708+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:07.809 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:07 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:07.708+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:07.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:07 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:07.572+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:07.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:07 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:07.572+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:07.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:07 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:07.670+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:07.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:07 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:07.670+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:07.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:07 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:07.670+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:08.156 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.5.service' 2024-09-15T23:26:08.236 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:26:08.236 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-15T23:26:08.236 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-15T23:26:08.236 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.6 2024-09-15T23:26:08.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:07 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:07.906+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:08.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:07 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:07.906+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:08.558 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:08 smithi002 systemd[1]: Stopping Ceph osd.6 for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:26:08.559 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:08 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:08.450+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:08.559 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:08 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:08.450+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:08.559 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:08 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:08.450+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.830074+0000 front 2024-09-15T23:25:39.830033+0000 (oldest deadline 2024-09-15T23:26:02.730111+0000) 2024-09-15T23:26:08.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:08 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:08.451+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:08.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:08 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:08.451+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:08.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:08 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:08.451+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:08.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:08 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:08.571+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:08.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:08 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:08.571+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:08.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:08 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:08.694+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:08.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:08 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:08.694+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:08.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:08 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:08.694+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:09.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:08 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:08.682+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:09.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:08 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:08.682+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:09.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:08 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:08.682+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:09.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:08 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:08.564+0000 7f2dc33c5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:26:09.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:08 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:08.564+0000 7f2dc33c5640 -1 osd.6 97 *** Got signal Terminated *** 2024-09-15T23:26:09.058 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:08 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:08.564+0000 7f2dc33c5640 -1 osd.6 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:26:09.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:08 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:08.870+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:09.247 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:08 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:08.870+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:09.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:09 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:09.439+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:09.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:09 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:09.439+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:09.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:09 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:09.439+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:09.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:09 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:09.685+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:09.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:09 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:09.685+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:09.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:09 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:09.685+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:09.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:09 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:09.463+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:09.809 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:09 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:09.463+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:09.809 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:09 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:09.463+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.830074+0000 front 2024-09-15T23:25:39.830033+0000 (oldest deadline 2024-09-15T23:26:02.730111+0000) 2024-09-15T23:26:09.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:09 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:09.554+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:09.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:09 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:09.554+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:09.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:09 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:09.721+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:09.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:09 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:09.721+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:09.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:09 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:09.721+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:10.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:09 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:09.835+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:10.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:09 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:09.835+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:10.707 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:10 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:10.437+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:10.708 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:10 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:10.437+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:10.708 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:10 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:10.437+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.830074+0000 front 2024-09-15T23:25:39.830033+0000 (oldest deadline 2024-09-15T23:26:02.730111+0000) 2024-09-15T23:26:10.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:10 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:10.479+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:10.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:10 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:10.479+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:10.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:10 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:10.479+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:10.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:10 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:10.586+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:10.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:10 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:10.586+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:10.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:10 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:10.766+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:10.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:10 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:10.766+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:10.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:10 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:10.766+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:11.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:10 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:10.706+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:11.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:10 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:10.706+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:11.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:10 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:10.706+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:11.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:10 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:10.857+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:11.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:10 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:10.857+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:11.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:11 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:11.475+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:11.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:11 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:11.475+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:11.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:11 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:11.475+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:11.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:11 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:11.475+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:11.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:11 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:11.671+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:11.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:11 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:11.671+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:11.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:11 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:11.671+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:11.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:11 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:11.434+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:11.809 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:11 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:11.434+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:11.809 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:11 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:11.434+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.830074+0000 front 2024-09-15T23:25:39.830033+0000 (oldest deadline 2024-09-15T23:26:02.730111+0000) 2024-09-15T23:26:11.809 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:11 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:11.434+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.632473+0000 front 2024-09-15T23:25:49.632443+0000 (oldest deadline 2024-09-15T23:26:11.332386+0000) 2024-09-15T23:26:11.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:11 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:11.739+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:11.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:11 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:11.739+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:11.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:11 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:11.739+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:11.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:11 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:11.582+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:11.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:11 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:11.582+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:11.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:11 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:11.582+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:12.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:11 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:11.835+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:12.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:11 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:11.835+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:12.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:12 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:12.492+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:12.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:12 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:12.492+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:12.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:12 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:12.492+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:12.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:12 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:12.492+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:12.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:12 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:12.627+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:12.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:12 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:12.627+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:12.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:12 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:12.627+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:12.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:12 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:12.443+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:12.809 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:12 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:12.443+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:12.809 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:12 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:12.443+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.830074+0000 front 2024-09-15T23:25:39.830033+0000 (oldest deadline 2024-09-15T23:26:02.730111+0000) 2024-09-15T23:26:12.809 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:12 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:12.443+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.632473+0000 front 2024-09-15T23:25:49.632443+0000 (oldest deadline 2024-09-15T23:26:11.332386+0000) 2024-09-15T23:26:12.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:12 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:12.537+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:12.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:12 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:12.537+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:12.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:12 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:12.537+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:12.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:12 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:12.696+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:12.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:12 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:12.696+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:12.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:12 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:12.696+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:13.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:12 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:12.870+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:13.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:12 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:12.870+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:13.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:13.473+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:21.127162+0000 front 2024-09-15T23:25:21.127193+0000 (oldest deadline 2024-09-15T23:25:45.827302+0000) 2024-09-15T23:26:13.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:13.473+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:31.629101+0000 front 2024-09-15T23:25:31.628705+0000 (oldest deadline 2024-09-15T23:25:56.928835+0000) 2024-09-15T23:26:13.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:13.473+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.830074+0000 front 2024-09-15T23:25:39.830033+0000 (oldest deadline 2024-09-15T23:26:02.730111+0000) 2024-09-15T23:26:13.808 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6[55786]: 2024-09-15T23:26:13.473+0000 7f2dbf9db640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.632473+0000 front 2024-09-15T23:25:49.632443+0000 (oldest deadline 2024-09-15T23:26:11.332386+0000) 2024-09-15T23:26:13.809 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:13.633+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:13.809 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:13.633+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:13.809 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:13.633+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:13.809 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:13 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:13.633+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:13.853 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:13 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:13.539+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:13.854 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:13 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:13.539+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:13.854 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:13 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:13.539+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:13.854 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:13 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:13.539+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:13.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:13 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:13.524+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:13.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:13 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:13.524+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:13.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:13 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:13.524+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:13.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:13 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:13.728+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:13.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:13 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:13.728+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:13.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:13 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:13.728+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:14.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:13 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:13.852+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:14.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:13 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:13.852+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:14.274 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:13 smithi002 podman[425281]: 2024-09-15 23:26:13.97233939 +0000 UTC m=+5.537262947 container died f356ae99537634aa2fda3e376b81f1dd3b781c42a68eb028f86e2a73083fd5b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-15T23:26:14.558 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:14 smithi002 podman[425281]: 2024-09-15 23:26:14.364510678 +0000 UTC m=+5.929434234 container cleanup f356ae99537634aa2fda3e376b81f1dd3b781c42a68eb028f86e2a73083fd5b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:26:14.558 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:14 smithi002 bash[425281]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6 2024-09-15T23:26:14.888 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:14 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:14.543+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:14.888 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:14 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:14.543+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:14.888 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:14 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:14.543+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:14.888 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:14 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:14.543+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:14.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:14 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:14.546+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:14.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:14 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:14.546+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:14.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:14 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:14.546+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:14.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:14 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:14.705+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:14.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:14 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:14.705+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:14.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:14 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:14.705+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:14.992 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:14 smithi002 podman[425297]: 2024-09-15 23:26:14.632810701 +0000 UTC m=+0.654961764 container remove f356ae99537634aa2fda3e376b81f1dd3b781c42a68eb028f86e2a73083fd5b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2) 2024-09-15T23:26:14.993 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:14 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:14.602+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:14.993 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:14 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:14.602+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:14.993 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:14 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:14.602+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:14.993 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:14 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:14.602+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:15.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:14 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:14.887+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:15.247 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:14 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:14.887+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:15.261 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:14 smithi002 podman[425384]: 2024-09-15 23:26:14.895331215 +0000 UTC m=+0.016746856 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:26:15.261 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:15 smithi002 podman[425384]: 2024-09-15 23:26:15.034049766 +0000 UTC m=+0.155465409 container create 0e06284440cd95e5c367d1ce87f147c2c99a5b6149a915c172042b608c89a575 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-15T23:26:15.262 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:15 smithi002 podman[425384]: 2024-09-15 23:26:15.261541827 +0000 UTC m=+0.382957467 container init 0e06284440cd95e5c367d1ce87f147c2c99a5b6149a915c172042b608c89a575 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=squid-8921c8e) 2024-09-15T23:26:15.558 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:15 smithi002 podman[425384]: 2024-09-15 23:26:15.264945934 +0000 UTC m=+0.386361575 container start 0e06284440cd95e5c367d1ce87f147c2c99a5b6149a915c172042b608c89a575 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:26:15.558 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:15 smithi002 podman[425384]: 2024-09-15 23:26:15.378165651 +0000 UTC m=+0.499581300 container attach 0e06284440cd95e5c367d1ce87f147c2c99a5b6149a915c172042b608c89a575 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-15T23:26:15.558 INFO:journalctl@ceph.osd.6.smithi002.stdout:Sep 15 23:26:15 smithi002 podman[425384]: 2024-09-15 23:26:15.45467714 +0000 UTC m=+0.576092780 container died 0e06284440cd95e5c367d1ce87f147c2c99a5b6149a915c172042b608c89a575 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:26:15.932 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:15 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:15.567+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:15.932 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:15 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:15.567+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:15.932 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:15 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:15.567+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:15.932 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:15 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:15.567+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:15.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:15 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:15.535+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:15.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:15 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:15.535+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:15.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:15 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:15.535+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:15.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:15 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:15.671+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:15.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:15 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:15.671+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:15.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:15 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:15.671+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:16.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:15 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:15.630+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:16.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:15 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:15.630+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:16.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:15 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:15.630+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:16.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:15 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:15.630+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:16.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.6.service' 2024-09-15T23:26:16.234 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:26:16.234 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-15T23:26:16.235 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-15T23:26:16.235 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.7 2024-09-15T23:26:16.248 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:15 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:15.930+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:16.249 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:15 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:15.930+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:16.249 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:15 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:15.930+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:46.893258+0000 front 2024-09-15T23:25:46.893353+0000 (oldest deadline 2024-09-15T23:26:15.093591+0000) 2024-09-15T23:26:16.548 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:16 smithi112 systemd[1]: Stopping Ceph osd.7 for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:26:16.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:16.627+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:16.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:16.627+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:16.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:16.627+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:16.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:16 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:16.627+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:16.906 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:16 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:16.586+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:16.907 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:16 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:16.586+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:16.907 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:16 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:16.586+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:16.907 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:16 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:16.586+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:16.907 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:16 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:16.547+0000 7febed3e5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:26:16.907 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:16 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:16.547+0000 7febed3e5640 -1 osd.7 97 *** Got signal Terminated *** 2024-09-15T23:26:16.907 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:16 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:16.547+0000 7febed3e5640 -1 osd.7 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:26:16.907 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:16 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:16.905+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:16.907 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:16 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:16.905+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:16.907 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:16 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:16.905+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:46.893258+0000 front 2024-09-15T23:25:46.893353+0000 (oldest deadline 2024-09-15T23:26:15.093591+0000) 2024-09-15T23:26:16.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:16 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:16.714+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:16.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:16 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:16.714+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:16.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:16 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:16.714+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:16.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:16 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:16.523+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:16.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:16 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:16.523+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:16.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:16 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:16.523+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:17.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:17 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:17.667+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:17.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:17 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:17.667+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:17.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:17 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:17.667+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:17.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:17 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:17.667+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:17.879 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:17 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:17.586+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:17.879 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:17 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:17.586+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:17.879 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:17 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:17.586+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:17.879 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:17 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:17.586+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:17.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:17 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:17.678+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:17.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:17 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:17.678+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:17.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:17 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:17.678+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:17.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:17 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:17.474+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:17.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:17 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:17.474+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:17.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:17 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:17.474+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:18.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:17 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:17.878+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:18.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:17 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:17.878+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:18.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:17 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:17.878+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:46.893258+0000 front 2024-09-15T23:25:46.893353+0000 (oldest deadline 2024-09-15T23:26:15.093591+0000) 2024-09-15T23:26:18.887 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:18.553+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:18.887 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:18.553+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:18.887 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:18.553+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:18.888 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:18.553+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:18.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:18 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:18.707+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:18.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:18 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:18.707+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:18.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:18 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:18.707+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:18.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:18 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:18.487+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:18.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:18 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:18.487+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:18.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:18 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:18.487+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:19.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:18 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:18.680+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:19.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:18 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:18.680+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:19.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:18 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:18.680+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:19.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:18 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:18.680+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:19.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:18.886+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:19.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:18.886+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:19.247 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:18.886+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:46.893258+0000 front 2024-09-15T23:25:46.893353+0000 (oldest deadline 2024-09-15T23:26:15.093591+0000) 2024-09-15T23:26:19.929 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:19 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:19.534+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:19.929 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:19 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:19.534+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:19.929 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:19 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:19.534+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:19.929 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:19 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:19.534+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:19.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:19 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:19.686+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:19.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:19 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:19.686+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:19.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:19 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:19.686+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:19.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:19 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:19.521+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:19.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:19 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:19.521+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:19.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:19 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:19.521+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:20.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:19 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:19.636+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:20.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:19 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:19.636+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:20.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:19 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:19.636+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:20.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:19 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:19.636+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:20.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:19 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:19.927+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:20.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:19 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:19.927+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:20.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:19 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:19.927+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:46.893258+0000 front 2024-09-15T23:25:46.893353+0000 (oldest deadline 2024-09-15T23:26:15.093591+0000) 2024-09-15T23:26:20.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:20 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:20.715+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:20.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:20 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:20.715+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:20.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:20 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:20.715+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:20.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:20 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:20.552+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:20.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:20 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:20.552+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:20.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:20 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:20.552+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:20.971 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:20 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:20.539+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:20.971 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:20 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:20.539+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:20.971 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:20 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:20.539+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:20.971 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:20 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:20.539+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:20.971 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:20 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:20.539+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:21.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:20 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:20.678+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:21.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:20 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:20.678+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:21.059 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:20 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:20.678+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:21.059 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:20 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:20.678+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:21.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:20 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:20.969+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:32.191622+0000 front 2024-09-15T23:25:32.191596+0000 (oldest deadline 2024-09-15T23:25:55.091722+0000) 2024-09-15T23:26:21.246 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:20 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:20.970+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:40.992726+0000 front 2024-09-15T23:25:40.992903+0000 (oldest deadline 2024-09-15T23:26:06.892668+0000) 2024-09-15T23:26:21.247 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:20 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:20.970+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:46.893258+0000 front 2024-09-15T23:25:46.893353+0000 (oldest deadline 2024-09-15T23:26:15.093591+0000) 2024-09-15T23:26:21.247 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:20 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7[52470]: 2024-09-15T23:26:20.970+0000 7febe59f3640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.594415+0000 front 2024-09-15T23:25:55.594381+0000 (oldest deadline 2024-09-15T23:26:20.294459+0000) 2024-09-15T23:26:21.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:21.553+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:21.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:21.553+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:21.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:21.553+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:21.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:21.760+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:21.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:21.760+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:21.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:21.760+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:21.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:21 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:21.760+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:21.996 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:21.532+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:21.996 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:21.532+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:21.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:21.532+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:21.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:21.532+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:21.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:21.532+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:22.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:21.696+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:22.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:21.696+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:22.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:21.696+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:22.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:21 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:21.696+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:22.357 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:22 smithi112 podman[70254]: 2024-09-15 23:26:22.060332317 +0000 UTC m=+5.636727700 container died 3df392ba05418e846eb3158db124b3b26cc02b3345ffc549a3be876dfa534774 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-15T23:26:22.733 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:22 smithi112 podman[70254]: 2024-09-15 23:26:22.456520603 +0000 UTC m=+6.032915989 container cleanup 3df392ba05418e846eb3158db124b3b26cc02b3345ffc549a3be876dfa534774 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-15T23:26:22.733 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:22 smithi112 bash[70254]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7 2024-09-15T23:26:22.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:22 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:22.491+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:22.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:22 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:22.491+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:22.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:22 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:22.491+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:22.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:22 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:22.491+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:22.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:22 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:22.491+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:22.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:22.583+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:22.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:22.583+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:22.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:22.583+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:22.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:22.583+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:57.129219+0000 front 2024-09-15T23:25:57.129228+0000 (oldest deadline 2024-09-15T23:26:22.429020+0000) 2024-09-15T23:26:22.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:22.713+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:22.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:22.713+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:22.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:22.713+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:22.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:22 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:22.713+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:22.996 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:22 smithi112 podman[70271]: 2024-09-15 23:26:22.732551757 +0000 UTC m=+0.663922704 container remove 3df392ba05418e846eb3158db124b3b26cc02b3345ffc549a3be876dfa534774 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-15T23:26:23.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:22.652+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:23.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:22.652+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:23.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:22.652+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:23.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:22 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:22.652+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:23.412 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:23 smithi112 podman[70366]: 2024-09-15 23:26:22.985487169 +0000 UTC m=+0.015880056 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:26:23.412 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:23 smithi112 podman[70366]: 2024-09-15 23:26:23.108304407 +0000 UTC m=+0.138697287 container create fcde4ff0671bc741b0623c5e907a72cc1bd193169cb0d3cffa9307ee673b2686 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True) 2024-09-15T23:26:23.413 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:23 smithi112 podman[70366]: 2024-09-15 23:26:23.319756528 +0000 UTC m=+0.350149418 container init fcde4ff0671bc741b0623c5e907a72cc1bd193169cb0d3cffa9307ee673b2686 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-15T23:26:23.413 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:23 smithi112 podman[70366]: 2024-09-15 23:26:23.322945188 +0000 UTC m=+0.353338068 container start fcde4ff0671bc741b0623c5e907a72cc1bd193169cb0d3cffa9307ee673b2686 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-15T23:26:23.746 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:23 smithi112 podman[70366]: 2024-09-15 23:26:23.4110618 +0000 UTC m=+0.441454684 container attach fcde4ff0671bc741b0623c5e907a72cc1bd193169cb0d3cffa9307ee673b2686 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:26:24.047 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 15 23:26:23 smithi112 podman[70366]: 2024-09-15 23:26:23.520945796 +0000 UTC m=+0.551338676 container died fcde4ff0671bc741b0623c5e907a72cc1bd193169cb0d3cffa9307ee673b2686 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-15T23:26:24.047 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:23 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:23.463+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:24.047 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:23 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:23.463+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:24.047 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:23 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:23.463+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:24.047 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:23 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:23.463+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:24.047 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:23 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:23.463+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:24.048 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:23 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:23.597+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:24.048 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:23 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:23.597+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:24.048 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:23 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:23.597+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:24.048 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:23 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:23.597+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:57.129219+0000 front 2024-09-15T23:25:57.129228+0000 (oldest deadline 2024-09-15T23:26:22.429020+0000) 2024-09-15T23:26:24.048 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:23 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:23.747+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:24.049 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:23 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:23.747+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:24.049 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:23 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:23.747+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:24.049 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:23 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:23.747+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:24.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:23.644+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:24.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:23.644+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:24.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:23.644+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:24.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:23 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:23.644+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:24.219 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.7.service' 2024-09-15T23:26:24.300 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:26:24.300 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-15T23:26:24.300 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-15T23:26:24.301 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.8 2024-09-15T23:26:24.600 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:24 smithi145 systemd[1]: Stopping Ceph osd.8 for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:26:24.600 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:24 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:24.573+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:24.600 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:24 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:24.573+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:24.600 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:24 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:24.573+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:24.600 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:24 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:24.573+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:57.129219+0000 front 2024-09-15T23:25:57.129228+0000 (oldest deadline 2024-09-15T23:26:22.429020+0000) 2024-09-15T23:26:24.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:24 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:24.496+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:24.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:24 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:24.496+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:24.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:24 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:24.496+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:24.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:24 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:24.496+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:24.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:24 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:24.496+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:24.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:24 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:24.598+0000 7fcfdabe2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:26:24.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:24 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:24.598+0000 7fcfdabe2640 -1 osd.8 97 *** Got signal Terminated *** 2024-09-15T23:26:24.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:24 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:24.598+0000 7fcfdabe2640 -1 osd.8 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:26:24.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:24 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:24.765+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:24.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:24 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:24.765+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:24.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:24 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:24.765+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:24.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:24 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:24.765+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:25.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:24 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:24.617+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:25.059 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:24 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:24.617+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:25.059 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:24 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:24.617+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:25.059 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:24 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:24.617+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:25.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:25 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:25.482+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:25.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:25 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:25.482+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:25.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:25 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:25.482+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:25.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:25 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:25.482+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:25.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:25 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:25.482+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:25.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:25 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:25.608+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:25.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:25 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:25.608+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:25.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:25 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:25.608+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:25.957 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:25 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:25.608+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:57.129219+0000 front 2024-09-15T23:25:57.129228+0000 (oldest deadline 2024-09-15T23:26:22.429020+0000) 2024-09-15T23:26:25.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:25 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:25.733+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:25.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:25 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:25.733+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:25.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:25 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:25.733+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:25.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:25 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:25.733+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:26.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:25.586+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:26.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:25.586+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:26.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:25.586+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:26.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:25 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:25.586+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:26.859 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:26 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:26.580+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:26.859 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:26 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:26.580+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:26.859 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:26 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:26.580+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:26.859 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:26 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:26.580+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:57.129219+0000 front 2024-09-15T23:25:57.129228+0000 (oldest deadline 2024-09-15T23:26:22.429020+0000) 2024-09-15T23:26:26.859 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:26 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:26.697+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:26.859 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:26 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:26.697+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:26.859 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:26 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:26.697+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:26.859 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:26 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:26.697+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:26.947 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:26 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:26.582+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:26.947 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:26 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:26.582+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:26.947 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:26 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:26.582+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:26.947 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:26 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:26.582+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:26.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:26 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:26.526+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:26.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:26 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:26.526+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:26.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:26 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:26.526+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:26.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:26 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:26.526+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:26.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:26 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:26.526+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:26.998 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:26 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:26.526+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:27.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:27 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:27.569+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:27.809 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:27 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:27.569+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:27.809 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:27 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:27.569+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:27.809 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:27 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:27.569+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:27.878 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:27 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:27.591+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:27.878 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:27 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:27.591+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:27.878 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:27 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:27.591+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:27.878 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:27 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:27.591+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:57.129219+0000 front 2024-09-15T23:25:57.129228+0000 (oldest deadline 2024-09-15T23:26:22.429020+0000) 2024-09-15T23:26:27.879 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:27 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:27.670+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:27.879 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:27 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:27.670+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:27.879 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:27 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:27.670+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:27.879 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:27 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:27.670+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:27.879 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:27 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:27.670+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:27.898 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:27 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:27.562+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:27.898 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:27 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:27.562+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:27.898 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:27 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:27.562+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:27.898 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:27 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:27.562+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:27.898 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:27 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:27.562+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:27.898 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:27 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:27.562+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:28.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:28 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:28.609+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:28.024864+0000 front 2024-09-15T23:25:28.024822+0000 (oldest deadline 2024-09-15T23:25:53.924810+0000) 2024-09-15T23:26:28.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:28 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:28.609+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.026704+0000 front 2024-09-15T23:25:39.026830+0000 (oldest deadline 2024-09-15T23:26:03.726860+0000) 2024-09-15T23:26:28.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:28 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:28.609+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:45.427693+0000 front 2024-09-15T23:25:45.427736+0000 (oldest deadline 2024-09-15T23:26:10.727715+0000) 2024-09-15T23:26:28.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:28 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:28.609+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:57.129219+0000 front 2024-09-15T23:25:57.129228+0000 (oldest deadline 2024-09-15T23:26:22.429020+0000) 2024-09-15T23:26:28.958 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:28 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8[53068]: 2024-09-15T23:26:28.609+0000 7fcfd31f0640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:02.429393+0000 front 2024-09-15T23:26:02.429443+0000 (oldest deadline 2024-09-15T23:26:27.729501+0000) 2024-09-15T23:26:28.959 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:28 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:28.675+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:28.959 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:28 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:28.675+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:28.959 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:28 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:28.675+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:28.959 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:28 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:28.675+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:28.959 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:28 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:28.675+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:28.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:28 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:28.519+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:28.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:28 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:28.519+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:28.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:28 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:28.519+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:28.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:28 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:28.519+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:28.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:28 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:28.519+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:28.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:28 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:28.519+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:29.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:28 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:28.599+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:29.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:28 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:28.599+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:29.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:28 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:28.599+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:29.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:28 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:28.599+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:29.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:29 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:29.485+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:29.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:29 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:29.485+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:29.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:29 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:29.485+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:29.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:29 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:29.485+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:29.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:29 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:29.485+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:29.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:29 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:29.485+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:29.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:29 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:29.633+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:29.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:29 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:29.633+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:29.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:29 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:29.633+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:29.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:29 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:29.633+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:29.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:29 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:29.633+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:30.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:29 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:29.567+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:30.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:29 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:29.567+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:30.059 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:29 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:29.567+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:30.059 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:29 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:29.567+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:30.417 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:30 smithi145 podman[71053]: 2024-09-15 23:26:30.127724915 +0000 UTC m=+5.632069334 container died db5dfc19f85a1ab93b24bfc3663a8d9b15fb6f8ebbfda4eee77fde7d23af7588 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-15T23:26:30.707 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:30 smithi145 podman[71053]: 2024-09-15 23:26:30.524769107 +0000 UTC m=+6.029113524 container cleanup db5dfc19f85a1ab93b24bfc3663a8d9b15fb6f8ebbfda4eee77fde7d23af7588 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-15T23:26:30.708 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:30 smithi145 bash[71053]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8 2024-09-15T23:26:30.708 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:30 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:30.642+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:30.708 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:30 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:30.642+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:30.708 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:30 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:30.642+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:30.708 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:30 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:30.642+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:30.708 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:30 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:30.642+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:30.996 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:30 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:30.524+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:30.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:30 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:30.524+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:30.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:30 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:30.525+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:30.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:30 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:30.525+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:30.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:30 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:30.525+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:30.997 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:30 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:30.525+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:31.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:30 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:30.584+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:31.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:30 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:30.584+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:31.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:30 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:30.584+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:31.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:30 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:30.584+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:31.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:30 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:30.584+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:05.192867+0000 front 2024-09-15T23:26:05.192885+0000 (oldest deadline 2024-09-15T23:26:29.892659+0000) 2024-09-15T23:26:31.177 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:30 smithi145 podman[71082]: 2024-09-15 23:26:30.842929119 +0000 UTC m=+0.707704164 container remove db5dfc19f85a1ab93b24bfc3663a8d9b15fb6f8ebbfda4eee77fde7d23af7588 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-15T23:26:31.437 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:31 smithi145 podman[71167]: 2024-09-15 23:26:31.177021119 +0000 UTC m=+0.101911930 container create 78f17c0408eb73dbebe16443b35fbf5407bab1494e222c7399e3ecf960635789 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-15T23:26:31.438 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:31 smithi145 podman[71167]: 2024-09-15 23:26:31.09070962 +0000 UTC m=+0.015600435 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:26:31.438 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:31 smithi145 podman[71167]: 2024-09-15 23:26:31.437630347 +0000 UTC m=+0.362521158 container init 78f17c0408eb73dbebe16443b35fbf5407bab1494e222c7399e3ecf960635789 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-15T23:26:31.707 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:31 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:31.623+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:31.707 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:31 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:31.623+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:31.707 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:31 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:31.623+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:31.708 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:31 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:31.623+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:31.708 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:31 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:31.623+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:31.708 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:31 smithi145 podman[71167]: 2024-09-15 23:26:31.441244742 +0000 UTC m=+0.366135561 container start 78f17c0408eb73dbebe16443b35fbf5407bab1494e222c7399e3ecf960635789 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, RELEASE=squid-8921c8e, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-15T23:26:31.708 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:31 smithi145 podman[71167]: 2024-09-15 23:26:31.520919981 +0000 UTC m=+0.445810800 container attach 78f17c0408eb73dbebe16443b35fbf5407bab1494e222c7399e3ecf960635789 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-15T23:26:31.708 INFO:journalctl@ceph.osd.8.smithi145.stdout:Sep 15 23:26:31 smithi145 podman[71167]: 2024-09-15 23:26:31.625245359 +0000 UTC m=+0.550136170 container died 78f17c0408eb73dbebe16443b35fbf5407bab1494e222c7399e3ecf960635789 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-15T23:26:31.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:31 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:31.481+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:31.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:31 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:31.481+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:31.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:31 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:31.481+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:31.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:31 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:31.481+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:31.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:31 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:31.481+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:31.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:31 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:31.481+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:32.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:31 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:31.568+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:32.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:31 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:31.568+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:32.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:31 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:31.568+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:32.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:31 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:31.568+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:32.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:31 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:31.568+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:05.192867+0000 front 2024-09-15T23:26:05.192885+0000 (oldest deadline 2024-09-15T23:26:29.892659+0000) 2024-09-15T23:26:32.263 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.8.service' 2024-09-15T23:26:32.301 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:26:32.302 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-15T23:26:32.302 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-15T23:26:32.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.9 2024-09-15T23:26:32.644 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:32 smithi002 systemd[1]: Stopping Ceph osd.9 for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:26:32.644 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:32 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:32.546+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:32.644 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:32 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:32.546+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:32.644 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:32 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:32.546+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:32.644 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:32 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:32.546+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:32.645 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:32 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:32.546+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:05.192867+0000 front 2024-09-15T23:26:05.192885+0000 (oldest deadline 2024-09-15T23:26:29.892659+0000) 2024-09-15T23:26:32.645 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:32 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:32.642+0000 7f513cba5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:26:32.645 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:32 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:32.642+0000 7f513cba5640 -1 osd.9 97 *** Got signal Terminated *** 2024-09-15T23:26:32.645 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:32 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:32.642+0000 7f513cba5640 -1 osd.9 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:26:32.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:32 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:32.451+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:32.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:32 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:32.451+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:32.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:32 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:32.451+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:32.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:32 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:32.451+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:32.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:32 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:32.451+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:32.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:32 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:32.451+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:32.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:32 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:32.639+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:32.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:32 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:32.639+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:32.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:32 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:32.639+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:32.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:32 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:32.639+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:32.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:32 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:32.639+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:33.647 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:33 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:33.644+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:33.647 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:33 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:33.644+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:33.647 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:33 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:33.644+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:33.647 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:33 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:33.644+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:33.647 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:33 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:33.644+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:33.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:33 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:33.425+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:33.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:33 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:33.425+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:33.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:33 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:33.425+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:33.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:33 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:33.425+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:33.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:33 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:33.425+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:33.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:33 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:33.425+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:34.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:33 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:33.562+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:34.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:33 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:33.562+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:34.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:33 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:33.562+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:34.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:33 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:33.562+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:34.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:33 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:33.562+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:05.192867+0000 front 2024-09-15T23:26:05.192885+0000 (oldest deadline 2024-09-15T23:26:29.892659+0000) 2024-09-15T23:26:34.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:34 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:34.441+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:34.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:34 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:34.441+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:34.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:34 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:34.441+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:34.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:34 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:34.441+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:34.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:34 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:34.441+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:34.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:34 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:34.441+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:34.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:34 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:34.615+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:34.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:34 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:34.615+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:34.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:34 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:34.615+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:34.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:34 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:34.615+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:34.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:34 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:34.615+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:35.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:34 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:34.559+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:35.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:34 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:34.559+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:35.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:34 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:34.559+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:35.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:34 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:34.559+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:35.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:34 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:34.559+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:05.192867+0000 front 2024-09-15T23:26:05.192885+0000 (oldest deadline 2024-09-15T23:26:29.892659+0000) 2024-09-15T23:26:35.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:34 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:34.559+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:09.893033+0000 front 2024-09-15T23:26:09.893055+0000 (oldest deadline 2024-09-15T23:26:33.993108+0000) 2024-09-15T23:26:35.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:35 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:35.427+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:35.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:35 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:35.427+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:35.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:35 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:35.427+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:35.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:35 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:35.427+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:35.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:35 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:35.427+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:35.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:35 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:35.427+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:35.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:35 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:35.427+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:10.667744+0000 front 2024-09-15T23:26:10.667809+0000 (oldest deadline 2024-09-15T23:26:35.367543+0000) 2024-09-15T23:26:35.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:35 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:35.554+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:35.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:35 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:35.554+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:35.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:35 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:35.554+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:35.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:35 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:35.554+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:35.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:35 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:35.554+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:05.192867+0000 front 2024-09-15T23:26:05.192885+0000 (oldest deadline 2024-09-15T23:26:29.892659+0000) 2024-09-15T23:26:35.808 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:35 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:35.554+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:09.893033+0000 front 2024-09-15T23:26:09.893055+0000 (oldest deadline 2024-09-15T23:26:33.993108+0000) 2024-09-15T23:26:35.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:35 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:35.652+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:35.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:35 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:35.652+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:35.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:35 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:35.652+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:35.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:35 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:35.652+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:35.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:35 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:35.652+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:36.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:36 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:36.410+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:36.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:36 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:36.410+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:36.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:36 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:36.410+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:36.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:36 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:36.410+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:36.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:36 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:36.410+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:36.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:36 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:36.410+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:36.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:36 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:36.410+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:10.667744+0000 front 2024-09-15T23:26:10.667809+0000 (oldest deadline 2024-09-15T23:26:35.367543+0000) 2024-09-15T23:26:36.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:36 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:36.669+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:36.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:36 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:36.669+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:36.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:36 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:36.669+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:36.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:36 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:36.669+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:36.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:36 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:36.669+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:36.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:36 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:36.669+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:37.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:36 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:36.572+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:37.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:36 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:36.572+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:37.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:36 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:36.572+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:37.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:36 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:36.572+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:37.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:36 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:36.572+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:05.192867+0000 front 2024-09-15T23:26:05.192885+0000 (oldest deadline 2024-09-15T23:26:29.892659+0000) 2024-09-15T23:26:37.058 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:36 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:36.572+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:09.893033+0000 front 2024-09-15T23:26:09.893055+0000 (oldest deadline 2024-09-15T23:26:33.993108+0000) 2024-09-15T23:26:37.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:37 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:37.382+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:37.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:37 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:37.382+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:37.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:37 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:37.382+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:37.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:37 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:37.382+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:37.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:37 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:37.382+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:37.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:37 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:37.382+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:37.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:37 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:37.382+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:10.667744+0000 front 2024-09-15T23:26:10.667809+0000 (oldest deadline 2024-09-15T23:26:35.367543+0000) 2024-09-15T23:26:37.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:37 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:37.641+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:37.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:37 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:37.641+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:37.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:37 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:37.641+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:37.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:37 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:37.641+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:37.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:37 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:37.641+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:37.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:37 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:37.641+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:38.055 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:37 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:37.570+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.087668+0000 front 2024-09-15T23:25:24.087920+0000 (oldest deadline 2024-09-15T23:25:47.587887+0000) 2024-09-15T23:26:38.056 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:37 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:37.570+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.489089+0000 front 2024-09-15T23:25:30.489153+0000 (oldest deadline 2024-09-15T23:25:56.389129+0000) 2024-09-15T23:26:38.056 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:37 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:37.570+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:41.090448+0000 front 2024-09-15T23:25:41.090223+0000 (oldest deadline 2024-09-15T23:26:05.190282+0000) 2024-09-15T23:26:38.056 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:37 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:37.570+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:48.691209+0000 front 2024-09-15T23:25:48.691232+0000 (oldest deadline 2024-09-15T23:26:13.391225+0000) 2024-09-15T23:26:38.056 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:37 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:37.570+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:05.192867+0000 front 2024-09-15T23:26:05.192885+0000 (oldest deadline 2024-09-15T23:26:29.892659+0000) 2024-09-15T23:26:38.056 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:37 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9[62457]: 2024-09-15T23:26:37.570+0000 7f51391bb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:09.893033+0000 front 2024-09-15T23:26:09.893055+0000 (oldest deadline 2024-09-15T23:26:33.993108+0000) 2024-09-15T23:26:38.308 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:38 smithi002 podman[425498]: 2024-09-15 23:26:38.055032703 +0000 UTC m=+5.543040644 container died 0fa6a83017bbe7a436438bee76b09c210a189b19cf87848b462f5afc3c2ce92d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:26:38.668 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:38 smithi002 podman[425498]: 2024-09-15 23:26:38.408803539 +0000 UTC m=+5.896811479 container cleanup 0fa6a83017bbe7a436438bee76b09c210a189b19cf87848b462f5afc3c2ce92d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-09-15T23:26:38.669 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:38 smithi002 bash[425498]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9 2024-09-15T23:26:38.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:38 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:38.343+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:38.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:38 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:38.343+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:38.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:38 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:38.343+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:38.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:38 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:38.343+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:38.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:38 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:38.343+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:38.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:38 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:38.343+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:38.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:38 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:38.343+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:10.667744+0000 front 2024-09-15T23:26:10.667809+0000 (oldest deadline 2024-09-15T23:26:35.367543+0000) 2024-09-15T23:26:38.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:38.659+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:38.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:38.659+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:38.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:38.659+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:38.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:38.659+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:38.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:38.659+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:38.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:38.659+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:38.991 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:38 smithi002 podman[425515]: 2024-09-15 23:26:38.668394343 +0000 UTC m=+0.607798524 container remove 0fa6a83017bbe7a436438bee76b09c210a189b19cf87848b462f5afc3c2ce92d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-15T23:26:39.280 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:38 smithi002 podman[425602]: 2024-09-15 23:26:38.89421755 +0000 UTC m=+0.016235904 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:26:39.280 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:38 smithi002 podman[425602]: 2024-09-15 23:26:38.993968394 +0000 UTC m=+0.115986730 container create c88cb31c8fa20a2a1d285325382132f7768493e89f801aa250f104fe270f0177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-15T23:26:39.280 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:39 smithi002 podman[425602]: 2024-09-15 23:26:39.212915947 +0000 UTC m=+0.334934292 container init c88cb31c8fa20a2a1d285325382132f7768493e89f801aa250f104fe270f0177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-15T23:26:39.280 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:39 smithi002 podman[425602]: 2024-09-15 23:26:39.216360181 +0000 UTC m=+0.338378524 container start c88cb31c8fa20a2a1d285325382132f7768493e89f801aa250f104fe270f0177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_CLEAN=True) 2024-09-15T23:26:39.280 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:39 smithi002 podman[425602]: 2024-09-15 23:26:39.279583548 +0000 UTC m=+0.401601901 container attach c88cb31c8fa20a2a1d285325382132f7768493e89f801aa250f104fe270f0177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:26:39.558 INFO:journalctl@ceph.osd.9.smithi002.stdout:Sep 15 23:26:39 smithi002 podman[425602]: 2024-09-15 23:26:39.410133958 +0000 UTC m=+0.532152295 container died c88cb31c8fa20a2a1d285325382132f7768493e89f801aa250f104fe270f0177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-8921c8e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:26:39.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:39 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:39.304+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:39.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:39 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:39.304+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:39.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:39 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:39.304+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:39.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:39 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:39.304+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:39.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:39 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:39.304+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:39.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:39 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:39.304+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:39.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:39 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:39.304+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:10.667744+0000 front 2024-09-15T23:26:10.667809+0000 (oldest deadline 2024-09-15T23:26:35.367543+0000) 2024-09-15T23:26:39.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:39 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:39.677+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:39.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:39 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:39.677+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:39.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:39 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:39.677+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:39.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:39 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:39.677+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:39.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:39 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:39.677+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:39.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:39 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:39.677+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:39.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.9.service' 2024-09-15T23:26:40.037 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:26:40.038 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-15T23:26:40.038 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-15T23:26:40.038 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.10 2024-09-15T23:26:40.333 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:40 smithi112 systemd[1]: Stopping Ceph osd.10 for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:26:40.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:40.332+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:40.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:40.332+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:40.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:40.332+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:40.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:40.332+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:40.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:40.332+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:40.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:40.332+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:40.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:40.332+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:10.667744+0000 front 2024-09-15T23:26:10.667809+0000 (oldest deadline 2024-09-15T23:26:35.367543+0000) 2024-09-15T23:26:40.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:40.333+0000 7f0d65713640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:26:40.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:40.333+0000 7f0d65713640 -1 osd.10 97 *** Got signal Terminated *** 2024-09-15T23:26:40.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:40 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:40.333+0000 7f0d65713640 -1 osd.10 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:26:40.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:40 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:40.691+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:40.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:40 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:40.691+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:40.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:40 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:40.691+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:40.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:40 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:40.691+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:40.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:40 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:40.691+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:40.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:40 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:40.691+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:41.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:41 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:41.348+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:41.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:41 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:41.348+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:41.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:41 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:41.348+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:41.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:41 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:41.348+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:41.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:41 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:41.348+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:41.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:41 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:41.348+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:41.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:41 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:41.348+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:10.667744+0000 front 2024-09-15T23:26:10.667809+0000 (oldest deadline 2024-09-15T23:26:35.367543+0000) 2024-09-15T23:26:41.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:41.682+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:41.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:41.682+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:41.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:41.682+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:41.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:41.682+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:41.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:41.682+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:41.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:41 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:41.682+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:42.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:42 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:42.310+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:42.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:42 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:42.310+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:42.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:42 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:42.310+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:42.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:42 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:42.310+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:42.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:42 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:42.310+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:42.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:42 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:42.310+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:42.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:42 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:42.310+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:10.667744+0000 front 2024-09-15T23:26:10.667809+0000 (oldest deadline 2024-09-15T23:26:35.367543+0000) 2024-09-15T23:26:42.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:42 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:42.672+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:42.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:42 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:42.672+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:42.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:42 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:42.672+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:42.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:42 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:42.672+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:42.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:42 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:42.672+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:42.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:42 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:42.672+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:43.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:43.360+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:43.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:43.360+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:43.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:43.360+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:43.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:43.360+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:43.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:43.360+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:43.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:43.360+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:43.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:43 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:43.360+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:10.667744+0000 front 2024-09-15T23:26:10.667809+0000 (oldest deadline 2024-09-15T23:26:35.367543+0000) 2024-09-15T23:26:43.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:43 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:43.673+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:43.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:43 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:43.673+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:43.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:43 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:43.673+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:43.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:43 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:43.673+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:43.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:43 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:43.673+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:43.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:43 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:43.673+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:44.746 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:44 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:44.312+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:44.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:44 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:44.312+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:44.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:44 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:44.312+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:44.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:44 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:44.312+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:44.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:44 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:44.312+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:44.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:44 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:44.312+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:44.748 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:44 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:44.312+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:10.667744+0000 front 2024-09-15T23:26:10.667809+0000 (oldest deadline 2024-09-15T23:26:35.367543+0000) 2024-09-15T23:26:45.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:44 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:44.708+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:45.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:44 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:44.708+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:45.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:44 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:44.708+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:45.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:44 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:44.708+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:45.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:44 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:44.708+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:45.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:44 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:44.708+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:45.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:45 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:45.288+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.260132+0000 front 2024-09-15T23:25:24.260220+0000 (oldest deadline 2024-09-15T23:25:47.160159+0000) 2024-09-15T23:26:45.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:45 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:45.288+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:29.461200+0000 front 2024-09-15T23:25:29.461155+0000 (oldest deadline 2024-09-15T23:25:55.361276+0000) 2024-09-15T23:26:45.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:45 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:45.288+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:38.862135+0000 front 2024-09-15T23:25:38.862369+0000 (oldest deadline 2024-09-15T23:26:02.862619+0000) 2024-09-15T23:26:45.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:45 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:45.288+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-09-15T23:25:49.263973+0000 front 2024-09-15T23:25:49.263925+0000 (oldest deadline 2024-09-15T23:26:10.864440+0000) 2024-09-15T23:26:45.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:45 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:45.288+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:56.765266+0000 front 2024-09-15T23:25:56.765310+0000 (oldest deadline 2024-09-15T23:26:19.665332+0000) 2024-09-15T23:26:45.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:45 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:45.288+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:04.867015+0000 front 2024-09-15T23:26:04.866989+0000 (oldest deadline 2024-09-15T23:26:25.966746+0000) 2024-09-15T23:26:45.747 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:45 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10[59389]: 2024-09-15T23:26:45.288+0000 7f0d61d29640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:10.667744+0000 front 2024-09-15T23:26:10.667809+0000 (oldest deadline 2024-09-15T23:26:35.367543+0000) 2024-09-15T23:26:46.086 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:45 smithi112 podman[70479]: 2024-09-15 23:26:45.797245885 +0000 UTC m=+5.565278781 container died a9968e37e79b3490e1f39af0f74a8527a959f4692c193d41cc74c3ec8cd9f4a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:26:46.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:45 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:45.720+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:46.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:45 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:45.720+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:46.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:45 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:45.720+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:46.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:45 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:45.720+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:46.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:45 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:45.720+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:46.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:45 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:45.720+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:46.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:45 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:45.720+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-15T23:26:18.111177+0000 front 2024-09-15T23:26:18.111135+0000 (oldest deadline 2024-09-15T23:26:45.111595+0000) 2024-09-15T23:26:46.496 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:46 smithi112 podman[70479]: 2024-09-15 23:26:46.183532456 +0000 UTC m=+5.951565352 container cleanup a9968e37e79b3490e1f39af0f74a8527a959f4692c193d41cc74c3ec8cd9f4a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-15T23:26:46.496 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:46 smithi112 bash[70479]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10 2024-09-15T23:26:46.955 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:46 smithi112 podman[70493]: 2024-09-15 23:26:46.551213212 +0000 UTC m=+0.745529050 container remove a9968e37e79b3490e1f39af0f74a8527a959f4692c193d41cc74c3ec8cd9f4a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-09-15T23:26:47.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:46 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:46.727+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:47.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:46 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:46.727+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:47.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:46 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:46.727+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:47.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:46 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:46.727+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:47.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:46 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:46.727+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:47.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:46 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:46.727+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:47.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:46 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:46.727+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-15T23:26:18.111177+0000 front 2024-09-15T23:26:18.111135+0000 (oldest deadline 2024-09-15T23:26:45.111595+0000) 2024-09-15T23:26:47.238 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:46 smithi112 podman[70586]: 2024-09-15 23:26:46.857877484 +0000 UTC m=+0.016225485 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:26:47.238 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:46 smithi112 podman[70586]: 2024-09-15 23:26:46.968587393 +0000 UTC m=+0.126935385 container create 410e0a635604346a802e1436ce45e3cae0f4b118f2e38d68cd193c09b1331ab3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-15T23:26:47.238 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:47 smithi112 podman[70586]: 2024-09-15 23:26:47.237593396 +0000 UTC m=+0.395941402 container init 410e0a635604346a802e1436ce45e3cae0f4b118f2e38d68cd193c09b1331ab3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-15T23:26:47.496 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:47 smithi112 podman[70586]: 2024-09-15 23:26:47.2411378 +0000 UTC m=+0.399485792 container start 410e0a635604346a802e1436ce45e3cae0f4b118f2e38d68cd193c09b1331ab3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2) 2024-09-15T23:26:47.497 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:47 smithi112 podman[70586]: 2024-09-15 23:26:47.337554593 +0000 UTC m=+0.495902586 container attach 410e0a635604346a802e1436ce45e3cae0f4b118f2e38d68cd193c09b1331ab3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-15T23:26:47.497 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 15 23:26:47 smithi112 podman[70586]: 2024-09-15 23:26:47.427969502 +0000 UTC m=+0.586317495 container died 410e0a635604346a802e1436ce45e3cae0f4b118f2e38d68cd193c09b1331ab3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-15T23:26:47.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:47 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:47.700+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:47.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:47 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:47.700+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:47.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:47 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:47.700+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:47.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:47 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:47.700+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:47.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:47 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:47.700+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:47.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:47 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:47.700+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:47.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:47 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:47.700+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-15T23:26:18.111177+0000 front 2024-09-15T23:26:18.111135+0000 (oldest deadline 2024-09-15T23:26:45.111595+0000) 2024-09-15T23:26:47.995 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.10.service' 2024-09-15T23:26:48.037 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:26:48.037 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-15T23:26:48.038 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-15T23:26:48.038 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.11 2024-09-15T23:26:48.351 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:48 smithi145 systemd[1]: Stopping Ceph osd.11 for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:26:48.707 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:48 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:48.350+0000 7f9a8e136640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:26:48.707 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:48 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:48.350+0000 7f9a8e136640 -1 osd.11 97 *** Got signal Terminated *** 2024-09-15T23:26:48.707 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:48 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:48.350+0000 7f9a8e136640 -1 osd.11 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:26:49.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:48 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:48.745+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:49.319 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:48 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:48.745+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:49.320 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:48 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:48.745+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:49.320 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:48 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:48.745+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:49.320 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:48 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:48.745+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:49.320 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:48 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:48.745+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:49.320 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:48 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:48.745+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-15T23:26:18.111177+0000 front 2024-09-15T23:26:18.111135+0000 (oldest deadline 2024-09-15T23:26:45.111595+0000) 2024-09-15T23:26:50.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:49 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:49.721+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:50.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:49 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:49.721+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:50.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:49 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:49.721+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:50.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:49 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:49.721+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:50.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:49 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:49.721+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:50.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:49 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:49.721+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:50.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:49 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:49.721+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-15T23:26:18.111177+0000 front 2024-09-15T23:26:18.111135+0000 (oldest deadline 2024-09-15T23:26:45.111595+0000) 2024-09-15T23:26:50.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:50 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:50.696+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:50.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:50 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:50.696+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:50.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:50 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:50.696+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:50.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:50 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:50.696+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:50.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:50 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:50.696+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:50.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:50 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:50.696+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:50.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:50 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:50.696+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-15T23:26:18.111177+0000 front 2024-09-15T23:26:18.111135+0000 (oldest deadline 2024-09-15T23:26:45.111595+0000) 2024-09-15T23:26:50.958 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:50 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:50.696+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6820 osd.8 since back 2024-09-15T23:26:28.612183+0000 front 2024-09-15T23:26:28.612230+0000 (oldest deadline 2024-09-15T23:26:50.312283+0000) 2024-09-15T23:26:52.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:51 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:51.734+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:52.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:51 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:51.734+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:52.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:51 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:51.734+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:52.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:51 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:51.734+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:52.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:51 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:51.734+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:52.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:51 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:51.734+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:52.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:51 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:51.734+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-15T23:26:18.111177+0000 front 2024-09-15T23:26:18.111135+0000 (oldest deadline 2024-09-15T23:26:45.111595+0000) 2024-09-15T23:26:52.209 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:51 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:51.734+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6820 osd.8 since back 2024-09-15T23:26:28.612183+0000 front 2024-09-15T23:26:28.612230+0000 (oldest deadline 2024-09-15T23:26:50.312283+0000) 2024-09-15T23:26:53.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:52 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:52.748+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-15T23:25:24.702765+0000 front 2024-09-15T23:25:24.702655+0000 (oldest deadline 2024-09-15T23:25:50.602604+0000) 2024-09-15T23:26:53.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:52 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:52.748+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-15T23:25:30.603314+0000 front 2024-09-15T23:25:30.603373+0000 (oldest deadline 2024-09-15T23:25:55.303305+0000) 2024-09-15T23:26:53.207 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:52 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:52.748+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6804 osd.2 since back 2024-09-15T23:25:39.905084+0000 front 2024-09-15T23:25:39.904992+0000 (oldest deadline 2024-09-15T23:26:02.805127+0000) 2024-09-15T23:26:53.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:52 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:52.748+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-15T23:25:55.007597+0000 front 2024-09-15T23:25:55.007680+0000 (oldest deadline 2024-09-15T23:26:20.907576+0000) 2024-09-15T23:26:53.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:52 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:52.748+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6812 osd.5 since back 2024-09-15T23:26:03.208306+0000 front 2024-09-15T23:26:03.208346+0000 (oldest deadline 2024-09-15T23:26:26.708326+0000) 2024-09-15T23:26:53.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:52 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:52.748+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-09-15T23:26:12.910290+0000 front 2024-09-15T23:26:12.910204+0000 (oldest deadline 2024-09-15T23:26:35.810171+0000) 2024-09-15T23:26:53.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:52 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:52.748+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-15T23:26:18.111177+0000 front 2024-09-15T23:26:18.111135+0000 (oldest deadline 2024-09-15T23:26:45.111595+0000) 2024-09-15T23:26:53.208 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:52 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11[59596]: 2024-09-15T23:26:52.748+0000 7f9a8a74c640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.145:6820 osd.8 since back 2024-09-15T23:26:28.612183+0000 front 2024-09-15T23:26:28.612230+0000 (oldest deadline 2024-09-15T23:26:50.312283+0000) 2024-09-15T23:26:54.092 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:53 smithi145 podman[71269]: 2024-09-15 23:26:53.823690803 +0000 UTC m=+5.591460932 container died f592d785689589347ab95bc0cf23c9bea1beae516f60d2a28906b8187c4438e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-15T23:26:54.092 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:54 smithi145 podman[71269]: 2024-09-15 23:26:54.091763289 +0000 UTC m=+5.859533405 container cleanup f592d785689589347ab95bc0cf23c9bea1beae516f60d2a28906b8187c4438e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-15T23:26:54.359 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:54 smithi145 bash[71269]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11 2024-09-15T23:26:54.700 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:54 smithi145 podman[71287]: 2024-09-15 23:26:54.359539075 +0000 UTC m=+0.530712204 container remove f592d785689589347ab95bc0cf23c9bea1beae516f60d2a28906b8187c4438e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-15T23:26:54.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:54 smithi145 podman[71372]: 2024-09-15 23:26:54.603352117 +0000 UTC m=+0.016094821 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:26:54.957 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:54 smithi145 podman[71372]: 2024-09-15 23:26:54.726801278 +0000 UTC m=+0.139543969 container create c5876e0d12c4ad0b5cb07dc173a741bcb2c3068270bc20774d7215959a8c670b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:26:55.457 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:54 smithi145 podman[71372]: 2024-09-15 23:26:54.987858549 +0000 UTC m=+0.400601240 container init c5876e0d12c4ad0b5cb07dc173a741bcb2c3068270bc20774d7215959a8c670b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-15T23:26:55.457 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:54 smithi145 podman[71372]: 2024-09-15 23:26:54.991132172 +0000 UTC m=+0.403874874 container start c5876e0d12c4ad0b5cb07dc173a741bcb2c3068270bc20774d7215959a8c670b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11-deactivate, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-09-15T23:26:55.458 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:55 smithi145 podman[71372]: 2024-09-15 23:26:55.071226304 +0000 UTC m=+0.483969014 container attach c5876e0d12c4ad0b5cb07dc173a741bcb2c3068270bc20774d7215959a8c670b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-15T23:26:55.458 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:55 smithi145 podman[71372]: 2024-09-15 23:26:55.177346968 +0000 UTC m=+0.590089673 container died c5876e0d12c4ad0b5cb07dc173a741bcb2c3068270bc20774d7215959a8c670b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-15T23:26:55.783 INFO:journalctl@ceph.osd.11.smithi145.stdout:Sep 15 23:26:55 smithi145 podman[71395]: 2024-09-15 23:26:55.757516973 +0000 UTC m=+0.569989327 container remove c5876e0d12c4ad0b5cb07dc173a741bcb2c3068270bc20774d7215959a8c670b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-15T23:26:55.789 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@osd.11.service' 2024-09-15T23:26:55.828 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:26:55.829 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-15T23:26:55.829 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-15T23:26:55.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.a 2024-09-15T23:26:56.144 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:26:55 smithi002 systemd[1]: Stopping Ceph mds.a for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:26:56.558 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:26:56 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-a[69468]: 2024-09-15T23:26:56.142+0000 7fabccb50640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:26:56.558 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:26:56 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-a[69468]: 2024-09-15T23:26:56.142+0000 7fabccb50640 -1 mds.a *** got signal Terminated *** 2024-09-15T23:27:00.443 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:27:00 smithi002 podman[425716]: 2024-09-15 23:27:00.157390489 +0000 UTC m=+4.122934549 container died 6352e2a1cb3bb5c9cb9091e1aa6083eafc14a8990e0b5b5a393871a5d7a641bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-15T23:27:00.702 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:27:00 smithi002 podman[425716]: 2024-09-15 23:27:00.533781261 +0000 UTC m=+4.499325321 container cleanup 6352e2a1cb3bb5c9cb9091e1aa6083eafc14a8990e0b5b5a393871a5d7a641bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-15T23:27:00.702 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:27:00 smithi002 bash[425716]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-a 2024-09-15T23:27:00.957 INFO:journalctl@ceph.mds.a.smithi002.stdout:Sep 15 23:27:00 smithi002 podman[425729]: 2024-09-15 23:27:00.701988286 +0000 UTC m=+0.541948555 container remove 6352e2a1cb3bb5c9cb9091e1aa6083eafc14a8990e0b5b5a393871a5d7a641bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-a, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-15T23:27:00.962 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.a.service' 2024-09-15T23:27:00.997 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:27:00.998 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-15T23:27:00.998 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-15T23:27:00.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.d 2024-09-15T23:27:01.308 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:27:01 smithi002 systemd[1]: Stopping Ceph mds.d for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:27:01.808 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:27:01 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-d[68280]: 2024-09-15T23:27:01.324+0000 7fce5b656640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:27:01.808 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:27:01 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-d[68280]: 2024-09-15T23:27:01.324+0000 7fce5b656640 -1 mds.d *** got signal Terminated *** 2024-09-15T23:27:05.781 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:27:05 smithi002 podman[425836]: 2024-09-15 23:27:05.338306224 +0000 UTC m=+4.110076908 container died a2362a05268e9f71f3c3aadc0ae86848cb62403788229eaee2b5a46185e15218 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-d, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-15T23:27:06.047 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:27:05 smithi002 podman[425836]: 2024-09-15 23:27:05.854339183 +0000 UTC m=+4.626109867 container cleanup a2362a05268e9f71f3c3aadc0ae86848cb62403788229eaee2b5a46185e15218 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-8921c8e, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:27:06.047 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:27:05 smithi002 bash[425836]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-d 2024-09-15T23:27:06.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.d.service' 2024-09-15T23:27:06.307 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:27:06 smithi002 podman[425848]: 2024-09-15 23:27:06.047135219 +0000 UTC m=+0.709059523 container remove a2362a05268e9f71f3c3aadc0ae86848cb62403788229eaee2b5a46185e15218 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-15T23:27:06.308 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:27:06 smithi002 systemd[1]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.d.service: Deactivated successfully. 2024-09-15T23:27:06.308 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:27:06 smithi002 systemd[1]: Stopped Ceph mds.d for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:27:06.308 INFO:journalctl@ceph.mds.d.smithi002.stdout:Sep 15 23:27:06 smithi002 systemd[1]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.d.service: Consumed 1.085s CPU time. 2024-09-15T23:27:06.331 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:27:06.332 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-15T23:27:06.332 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-15T23:27:06.332 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.g 2024-09-15T23:27:06.684 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 15 23:27:06 smithi002 systemd[1]: Stopping Ceph mds.g for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:27:07.058 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 15 23:27:06 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-g[69149]: 2024-09-15T23:27:06.682+0000 7f59ce81c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:27:07.058 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 15 23:27:06 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-g[69149]: 2024-09-15T23:27:06.682+0000 7f59ce81c640 -1 mds.g *** got signal Terminated *** 2024-09-15T23:27:10.525 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 15 23:27:10 smithi002 podman[425957]: 2024-09-15 23:27:10.266474352 +0000 UTC m=+3.707163691 container died be5fc7f04906390c43282fa11c00e6ad44815450de737adf9243f9c99c6eec8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-g, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-15T23:27:10.808 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 15 23:27:10 smithi002 podman[425957]: 2024-09-15 23:27:10.624475115 +0000 UTC m=+4.065164454 container cleanup be5fc7f04906390c43282fa11c00e6ad44815450de737adf9243f9c99c6eec8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-15T23:27:10.808 INFO:journalctl@ceph.mds.g.smithi002.stdout:Sep 15 23:27:10 smithi002 bash[425957]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-g 2024-09-15T23:27:11.066 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.g.service' 2024-09-15T23:27:11.099 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:27:11.099 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-15T23:27:11.099 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-15T23:27:11.099 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.j 2024-09-15T23:27:11.437 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:27:11 smithi002 systemd[1]: Stopping Ceph mds.j for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:27:11.808 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:27:11 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-j[67875]: 2024-09-15T23:27:11.436+0000 7f72b6d87640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:27:11.808 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:27:11 smithi002 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-j[67875]: 2024-09-15T23:27:11.436+0000 7f72b6d87640 -1 mds.j *** got signal Terminated *** 2024-09-15T23:27:14.529 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:27:14 smithi002 podman[426078]: 2024-09-15 23:27:14.250354712 +0000 UTC m=+2.920814473 container died e7f4095fc8c9ff8fcdeb06802e43f0714fac25c346519cc105bba98b097019b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:27:14.808 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:27:14 smithi002 podman[426078]: 2024-09-15 23:27:14.61187874 +0000 UTC m=+3.282338491 container cleanup e7f4095fc8c9ff8fcdeb06802e43f0714fac25c346519cc105bba98b097019b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:27:14.808 INFO:journalctl@ceph.mds.j.smithi002.stdout:Sep 15 23:27:14 smithi002 bash[426078]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-j 2024-09-15T23:27:15.044 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.j.service' 2024-09-15T23:27:15.077 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:27:15.077 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-15T23:27:15.077 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-15T23:27:15.077 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.b 2024-09-15T23:27:15.401 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:27:15 smithi112 systemd[1]: Stopping Ceph mds.b for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:27:15.744 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:27:15 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b[64564]: 2024-09-15T23:27:15.399+0000 7fbca4844640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:27:15.744 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:27:15 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b[64564]: 2024-09-15T23:27:15.399+0000 7fbca4844640 -1 mds.b *** got signal Terminated *** 2024-09-15T23:27:17.899 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:27:17 smithi112 podman[70692]: 2024-09-15 23:27:17.559132839 +0000 UTC m=+2.287365715 container died ac2a7a3734e99d8fea723300704ddd4af28cae5a7557591d64ce32f906a349a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:27:17.899 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:27:17 smithi112 podman[70692]: 2024-09-15 23:27:17.899236399 +0000 UTC m=+2.627469271 container cleanup ac2a7a3734e99d8fea723300704ddd4af28cae5a7557591d64ce32f906a349a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:27:18.246 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:27:17 smithi112 bash[70692]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b 2024-09-15T23:27:18.246 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 15 23:27:18 smithi112 podman[70717]: 2024-09-15 23:27:18.10869637 +0000 UTC m=+0.544424253 container remove ac2a7a3734e99d8fea723300704ddd4af28cae5a7557591d64ce32f906a349a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-15T23:27:18.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.b.service' 2024-09-15T23:27:18.365 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:27:18.365 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-15T23:27:18.366 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-15T23:27:18.366 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.e 2024-09-15T23:27:18.687 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:27:18 smithi112 systemd[1]: Stopping Ceph mds.e for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:27:18.996 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:27:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-e[63944]: 2024-09-15T23:27:18.685+0000 7f273ed25640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:27:18.996 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:27:18 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-e[63944]: 2024-09-15T23:27:18.685+0000 7f273ed25640 -1 mds.e *** got signal Terminated *** 2024-09-15T23:27:20.912 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:27:20 smithi112 podman[70829]: 2024-09-15 23:27:20.622573811 +0000 UTC m=+2.039914697 container died 7b9493fdbe5f3f06eafd9c0caafa66d2e41e750ab568ed0a93239066c96a0331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:27:21.246 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:27:20 smithi112 podman[70829]: 2024-09-15 23:27:20.994320489 +0000 UTC m=+2.411661367 container cleanup 7b9493fdbe5f3f06eafd9c0caafa66d2e41e750ab568ed0a93239066c96a0331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-15T23:27:21.246 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 15 23:27:20 smithi112 bash[70829]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-e 2024-09-15T23:27:21.425 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.e.service' 2024-09-15T23:27:21.459 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:27:21.459 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-15T23:27:21.459 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-15T23:27:21.459 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.h 2024-09-15T23:27:21.996 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:27:21 smithi112 systemd[1]: Stopping Ceph mds.h for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:27:21.996 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:27:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-h[64250]: 2024-09-15T23:27:21.781+0000 7ff27d184640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:27:21.997 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:27:21 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-h[64250]: 2024-09-15T23:27:21.781+0000 7ff27d184640 -1 mds.h *** got signal Terminated *** 2024-09-15T23:27:24.899 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:27:24 smithi112 podman[70950]: 2024-09-15 23:27:24.624244014 +0000 UTC m=+2.951134355 container died 5d49d742211b81ea0a0f8ed618277363d8917c2b2ea3fdf4e2cdccebbc6a1471 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-15T23:27:25.246 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:27:24 smithi112 podman[70950]: 2024-09-15 23:27:24.981175014 +0000 UTC m=+3.308065282 container cleanup 5d49d742211b81ea0a0f8ed618277363d8917c2b2ea3fdf4e2cdccebbc6a1471 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-15T23:27:25.246 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 15 23:27:24 smithi112 bash[70950]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-h 2024-09-15T23:27:25.439 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.h.service' 2024-09-15T23:27:25.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:27:25.471 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-15T23:27:25.471 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-15T23:27:25.471 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.k 2024-09-15T23:27:25.996 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:27:25 smithi112 systemd[1]: Stopping Ceph mds.k for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:27:25.996 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:27:25 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-k[63631]: 2024-09-15T23:27:25.792+0000 7f7af48f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:27:25.996 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:27:25 smithi112 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-k[63631]: 2024-09-15T23:27:25.792+0000 7f7af48f7640 -1 mds.k *** got signal Terminated *** 2024-09-15T23:27:27.246 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:27:26 smithi112 podman[71069]: 2024-09-15 23:27:26.990445591 +0000 UTC m=+1.298653964 container died 73e6b6932b6cb60f53a6cd71fc7f5626e1e30a65ab3fa86538ce0f75ece1777d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-15T23:27:27.594 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:27:27 smithi112 podman[71069]: 2024-09-15 23:27:27.351386111 +0000 UTC m=+1.659594436 container cleanup 73e6b6932b6cb60f53a6cd71fc7f5626e1e30a65ab3fa86538ce0f75ece1777d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e) 2024-09-15T23:27:27.594 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 15 23:27:27 smithi112 bash[71069]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-k 2024-09-15T23:27:27.725 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.k.service' 2024-09-15T23:27:27.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:27:27.759 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-15T23:27:27.759 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-15T23:27:27.759 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.c 2024-09-15T23:27:28.124 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 15 23:27:27 smithi145 systemd[1]: Stopping Ceph mds.c for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:27:28.457 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 15 23:27:28 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-c[64573]: 2024-09-15T23:27:28.122+0000 7fbdf4a0c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:27:28.598 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 15 23:27:28 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-c[64573]: 2024-09-15T23:27:28.122+0000 7fbdf4a0c640 -1 mds.c *** got signal Terminated *** 2024-09-15T23:27:30.207 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 15 23:27:29 smithi145 podman[71488]: 2024-09-15 23:27:29.914870356 +0000 UTC m=+1.952564411 container died ca69f1760c07fc22a939e3d02075b946ee6f0407ecfe3e0de48eea5dc282cecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-c, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD) 2024-09-15T23:27:30.545 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 15 23:27:30 smithi145 podman[71488]: 2024-09-15 23:27:30.214266286 +0000 UTC m=+2.251960332 container cleanup ca69f1760c07fc22a939e3d02075b946ee6f0407ecfe3e0de48eea5dc282cecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-c, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-15T23:27:30.545 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 15 23:27:30 smithi145 bash[71488]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-c 2024-09-15T23:27:30.546 INFO:journalctl@ceph.mds.c.smithi145.stdout:Sep 15 23:27:30 smithi145 podman[71511]: 2024-09-15 23:27:30.432259261 +0000 UTC m=+0.513805495 container remove ca69f1760c07fc22a939e3d02075b946ee6f0407ecfe3e0de48eea5dc282cecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-c, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-15T23:27:30.559 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.c.service' 2024-09-15T23:27:30.595 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:27:30.596 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-15T23:27:30.596 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-15T23:27:30.596 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.f 2024-09-15T23:27:30.910 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:27:30 smithi145 systemd[1]: Stopping Ceph mds.f for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:27:31.207 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:27:30 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-f[64270]: 2024-09-15T23:27:30.909+0000 7f6c45d20640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:27:31.207 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:27:30 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-f[64270]: 2024-09-15T23:27:30.909+0000 7f6c45d20640 -1 mds.f *** got signal Terminated *** 2024-09-15T23:27:35.207 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:27:34 smithi145 podman[71622]: 2024-09-15 23:27:34.920671206 +0000 UTC m=+4.109382357 container died 585e2dda576f9465b4b39bfde44b63209be341245833e66ffdd5f5f9f0bcac18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-15T23:27:35.510 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:27:35 smithi145 podman[71622]: 2024-09-15 23:27:35.226037769 +0000 UTC m=+4.414748909 container cleanup 585e2dda576f9465b4b39bfde44b63209be341245833e66ffdd5f5f9f0bcac18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-15T23:27:35.510 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:27:35 smithi145 bash[71622]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-f 2024-09-15T23:27:35.780 INFO:journalctl@ceph.mds.f.smithi145.stdout:Sep 15 23:27:35 smithi145 podman[71635]: 2024-09-15 23:27:35.510251738 +0000 UTC m=+0.584697650 container remove 585e2dda576f9465b4b39bfde44b63209be341245833e66ffdd5f5f9f0bcac18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-15T23:27:35.791 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.f.service' 2024-09-15T23:27:35.824 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:27:35.825 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-15T23:27:35.825 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-15T23:27:35.825 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.i 2024-09-15T23:27:36.138 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:27:35 smithi145 systemd[1]: Stopping Ceph mds.i for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:27:36.457 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:27:36 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-i[64874]: 2024-09-15T23:27:36.137+0000 7f8acd8a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:27:36.457 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:27:36 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-i[64874]: 2024-09-15T23:27:36.137+0000 7f8acd8a3640 -1 mds.i *** got signal Terminated *** 2024-09-15T23:27:37.822 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:27:37 smithi145 podman[71743]: 2024-09-15 23:27:37.560358701 +0000 UTC m=+1.522169871 container died f9d47912584784ff41886c2d3c69028b955a07083e3804a0c31b9136b18b1b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-15T23:27:38.207 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:27:37 smithi145 podman[71743]: 2024-09-15 23:27:37.921020548 +0000 UTC m=+1.882831714 container cleanup f9d47912584784ff41886c2d3c69028b955a07083e3804a0c31b9136b18b1b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:27:38.207 INFO:journalctl@ceph.mds.i.smithi145.stdout:Sep 15 23:27:37 smithi145 bash[71743]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-i 2024-09-15T23:27:38.494 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.i.service' 2024-09-15T23:27:38.527 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:27:38.527 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-15T23:27:38.527 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-15T23:27:38.527 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.l 2024-09-15T23:27:38.958 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:27:38 smithi145 systemd[1]: Stopping Ceph mds.l for cb7ab3ae-73b6-11ef-bceb-c7b262605968... 2024-09-15T23:27:38.958 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:27:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-l[63970]: 2024-09-15T23:27:38.833+0000 7f9ef0775640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:27:38.958 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:27:38 smithi145 ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-l[63970]: 2024-09-15T23:27:38.833+0000 7f9ef0775640 -1 mds.l *** got signal Terminated *** 2024-09-15T23:27:40.707 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:27:40 smithi145 podman[71864]: 2024-09-15 23:27:40.22483576 +0000 UTC m=+1.480855263 container died 36dfc9e6f2e8d3946120ed60d224db31ec6b0eeae592a4ff24055391a11dc980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-15T23:27:41.043 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:27:40 smithi145 podman[71864]: 2024-09-15 23:27:40.858317696 +0000 UTC m=+2.114337196 container cleanup 36dfc9e6f2e8d3946120ed60d224db31ec6b0eeae592a4ff24055391a11dc980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-15T23:27:41.043 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:27:40 smithi145 bash[71864]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-l 2024-09-15T23:27:41.272 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.l.service' 2024-09-15T23:27:41.293 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:27:41 smithi145 podman[71876]: 2024-09-15 23:27:41.042776219 +0000 UTC m=+0.811035084 container remove 36dfc9e6f2e8d3946120ed60d224db31ec6b0eeae592a4ff24055391a11dc980 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:27:41.293 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:27:41 smithi145 systemd[1]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.l.service: Deactivated successfully. 2024-09-15T23:27:41.293 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:27:41 smithi145 systemd[1]: Stopped Ceph mds.l for cb7ab3ae-73b6-11ef-bceb-c7b262605968. 2024-09-15T23:27:41.293 INFO:journalctl@ceph.mds.l.smithi145.stdout:Sep 15 23:27:41 smithi145 systemd[1]: ceph-cb7ab3ae-73b6-11ef-bceb-c7b262605968@mds.l.service: Consumed 1.029s CPU time. 2024-09-15T23:27:41.303 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:27:41.304 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-15T23:27:41.304 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T23:27:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:27:44.141 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T23:27:44.344 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:27:46.823 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T23:27:47.022 INFO:teuthology.orchestra.run.smithi145.stdout:Deleting cluster with fsid: cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:27:49.412 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:27:49.447 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:27:49.475 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:27:49.502 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-15T23:27:49.504 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906293/remote/smithi002/crash 2024-09-15T23:27:49.505 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/crash -- . 2024-09-15T23:27:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T23:27:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2024-09-15T23:27:49.537 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906293/remote/smithi112/crash 2024-09-15T23:27:49.538 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/crash -- . 2024-09-15T23:27:49.575 INFO:teuthology.orchestra.run.smithi112.stderr:tar: /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T23:27:49.575 INFO:teuthology.orchestra.run.smithi112.stderr:tar: Error is not recoverable: exiting now 2024-09-15T23:27:49.577 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906293/remote/smithi145/crash 2024-09-15T23:27:49.578 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/crash -- . 2024-09-15T23:27:49.620 INFO:teuthology.orchestra.run.smithi145.stderr:tar: /var/lib/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T23:27:49.620 INFO:teuthology.orchestra.run.smithi145.stderr:tar: Error is not recoverable: exiting now 2024-09-15T23:27:49.621 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-15T23:27:49.621 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-15T23:27:49.668 INFO:tasks.cephadm:Compressing logs... 2024-09-15T23:27:49.668 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T23:27:49.670 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T23:27:49.673 DEBUG:teuthology.orchestra.run.smithi145:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T23:27:49.695 INFO:teuthology.orchestra.run.smithi112.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-15T23:27:49.695 INFO:teuthology.orchestra.run.smithi112.stderr:: No such file or directory 2024-09-15T23:27:49.695 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-15T23:27:49.695 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-15T23:27:49.700 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T23:27:49.700 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-15T23:27:49.700 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-15T23:27:49.700 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-15T23:27:49.700 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T23:27:49.700 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T23:27:49.712 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T23:27:49.712 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-15T23:27:49.713 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.cephadm.log: 94.5% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-15T23:27:49.713 INFO:teuthology.orchestra.run.smithi112.stderr: 81.4% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T23:27:49.713 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.log 2024-09-15T23:27:49.713 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-15T23:27:49.713 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.log: /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mgr.y.log: 87.1% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T23:27:49.713 INFO:teuthology.orchestra.run.smithi112.stderr: 90.9% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T23:27:49.713 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-15T23:27:49.713 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-15T23:27:49.720 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mon.b.log: 91.8% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-15T23:27:49.720 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T23:27:49.720 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.e.log: 94.5% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-15T23:27:49.720 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T23:27:49.720 INFO:teuthology.orchestra.run.smithi112.stderr: 94.5% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-15T23:27:49.721 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-15T23:27:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:: No such file or directory 2024-09-15T23:27:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-15T23:27:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T23:27:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.9.log: --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T23:27:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-15T23:27:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T23:27:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-15T23:27:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-15T23:27:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mon.a.log: 84.2% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.cephadm.log.gzgzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-15T23:27:49.723 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-15T23:27:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.log 2024-09-15T23:27:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.g.log: /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.3% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T23:27:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-15T23:27:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.log: 94.6% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-15T23:27:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-15T23:27:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.d.log: 87.0% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T23:27:49.724 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-15T23:27:49.724 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mgr.x.log: 94.6% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-15T23:27:49.724 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-15T23:27:49.724 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-15T23:27:49.724 INFO:teuthology.orchestra.run.smithi002.stderr: 94.7% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-15T23:27:49.724 INFO:teuthology.orchestra.run.smithi002.stderr: 90.9% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T23:27:49.724 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-15T23:27:49.724 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T23:27:49.724 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 93.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T23:27:49.726 INFO:teuthology.orchestra.run.smithi145.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T23:27:49.726 INFO:teuthology.orchestra.run.smithi145.stderr:: No such file or directory 2024-09-15T23:27:49.726 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T23:27:49.726 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-15T23:27:49.726 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-15T23:27:49.726 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T23:27:49.727 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-15T23:27:49.727 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-15T23:27:49.727 INFO:teuthology.orchestra.run.smithi145.stderr: 81.4% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T23:27:49.727 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-15T23:27:49.727 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.log 2024-09-15T23:27:49.727 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-15T23:27:49.727 INFO:teuthology.orchestra.run.smithi145.stderr: 90.5% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T23:27:49.727 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-15T23:27:49.727 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.l.log: 87.1% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T23:27:49.727 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-15T23:27:49.728 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.6% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-15T23:27:49.728 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-15T23:27:49.728 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T23:27:49.728 INFO:teuthology.orchestra.run.smithi145.stderr: 91.9% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-15T23:27:49.728 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-15T23:27:49.728 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T23:27:49.728 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.f.log: 94.6% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-15T23:27:49.729 INFO:teuthology.orchestra.run.smithi145.stderr: 94.5% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-15T23:27:49.730 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T23:27:49.969 INFO:teuthology.orchestra.run.smithi145.stderr: 92.0% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-15T23:27:50.062 INFO:teuthology.orchestra.run.smithi002.stderr: 90.2% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-15T23:27:50.111 INFO:teuthology.orchestra.run.smithi112.stderr: 91.9% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-15T23:27:50.815 INFO:teuthology.orchestra.run.smithi002.stderr: 90.3% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-15T23:27:52.872 INFO:teuthology.orchestra.run.smithi112.stderr: 91.3% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-15T23:27:53.641 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-15T23:27:53.921 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-15T23:27:54.171 INFO:teuthology.orchestra.run.smithi002.stderr: 91.1% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-15T23:27:54.341 INFO:teuthology.orchestra.run.smithi112.stderr: 91.3% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-15T23:27:54.356 INFO:teuthology.orchestra.run.smithi112.stderr: 91.3% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-15T23:27:54.583 INFO:teuthology.orchestra.run.smithi112.stderr: 91.0% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-15T23:27:54.625 INFO:teuthology.orchestra.run.smithi145.stderr: 91.2% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-15T23:27:54.631 INFO:teuthology.orchestra.run.smithi145.stderr: 91.0% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-15T23:27:54.637 INFO:teuthology.orchestra.run.smithi002.stderr: 90.9% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-15T23:27:54.710 INFO:teuthology.orchestra.run.smithi002.stderr: 91.3% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-15T23:27:54.965 INFO:teuthology.orchestra.run.smithi002.stderr: 91.3% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-15T23:27:57.535 INFO:teuthology.orchestra.run.smithi145.stderr: 93.5% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-15T23:27:57.537 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-15T23:27:57.537 INFO:teuthology.orchestra.run.smithi145.stderr:real 0m7.849s 2024-09-15T23:27:57.537 INFO:teuthology.orchestra.run.smithi145.stderr:user 0m25.354s 2024-09-15T23:27:57.537 INFO:teuthology.orchestra.run.smithi145.stderr:sys 0m0.790s 2024-09-15T23:29:15.634 INFO:teuthology.orchestra.run.smithi112.stderr: 94.3% -- replaced with /var/log/ceph/cb7ab3ae-73b6-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-15T23:29:15.635 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-15T23:29:15.636 INFO:teuthology.orchestra.run.smithi112.stderr:real 1m25.950s 2024-09-15T23:29:15.636 INFO:teuthology.orchestra.run.smithi112.stderr:user 1m40.208s 2024-09-15T23:29:15.636 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m3.315s 2024-09-15T23:30:16.046 INFO:teuthology.orchestra.run.smithi002.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-15T23:30:16.047 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-15T23:30:16.047 INFO:teuthology.orchestra.run.smithi002.stderr:real 2m26.363s 2024-09-15T23:30:16.047 INFO:teuthology.orchestra.run.smithi002.stderr:user 2m42.559s 2024-09-15T23:30:16.047 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m4.632s 2024-09-15T23:30:16.048 INFO:tasks.cephadm:Archiving logs... 2024-09-15T23:30:16.048 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906293/remote/smithi002/log 2024-09-15T23:30:16.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T23:30:42.534 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906293/remote/smithi112/log 2024-09-15T23:30:42.535 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T23:30:57.233 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906293/remote/smithi145/log 2024-09-15T23:30:57.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T23:31:01.120 INFO:tasks.cephadm:Removing cluster... 2024-09-15T23:31:01.121 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 --force 2024-09-15T23:31:01.333 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:31:01.626 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 --force 2024-09-15T23:31:01.828 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:31:02.192 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid cb7ab3ae-73b6-11ef-bceb-c7b262605968 --force 2024-09-15T23:31:02.397 INFO:teuthology.orchestra.run.smithi145.stdout:Deleting cluster with fsid: cb7ab3ae-73b6-11ef-bceb-c7b262605968 2024-09-15T23:31:02.681 INFO:tasks.cephadm:Removing cephadm ... 2024-09-15T23:31:02.681 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T23:31:02.698 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T23:31:02.714 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T23:31:02.730 INFO:tasks.cephadm:Teardown complete 2024-09-15T23:31:02.730 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T23:31:02.740 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T23:31:02.740 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T23:31:02.743 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T23:31:02.756 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T23:31:02.867 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T23:31:02.877 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T23:31:02.877 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:31:02.879 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:31:02.882 DEBUG:teuthology.orchestra.run.smithi145:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:31:02.892 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:31:02.894 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:31:02.896 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:31:02.897 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:31:02.897 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-15T23:31:02.897 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 44 +538us[ +531us] +/- 45ms 2024-09-15T23:31:02.897 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 -1305us[-1311us] +/- 72ms 2024-09-15T23:31:02.897 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +493us[ +487us] +/- 82ms 2024-09-15T23:31:02.897 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:31:02.898 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:31:02.898 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-15T23:31:02.898 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +551us[ +566us] +/- 45ms 2024-09-15T23:31:02.898 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -1366us[-1352us] +/- 72ms 2024-09-15T23:31:02.898 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +488us[ +503us] +/- 82ms 2024-09-15T23:31:02.898 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:31:02.901 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:31:02.901 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-09-15T23:31:02.901 INFO:teuthology.orchestra.run.smithi145.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 +528us[ +517us] +/- 45ms 2024-09-15T23:31:02.901 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -1379us[-1379us] +/- 72ms 2024-09-15T23:31:02.901 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +486us[ +476us] +/- 82ms 2024-09-15T23:31:02.901 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:31:02.902 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T23:31:02.912 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T23:31:02.912 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T23:31:02.922 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T23:31:03.014 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T23:31:03.081 DEBUG:teuthology.orchestra.run.smithi145:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T23:31:03.147 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:31:03.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:31:03.177 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:31:03.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:31:03.206 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:31:03.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:31:03.233 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T23:31:03.243 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T23:31:03.252 INFO:teuthology.task.internal:Duration was 1963.364993 seconds 2024-09-15T23:31:03.252 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T23:31:03.262 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T23:31:03.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T23:31:03.264 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T23:31:03.267 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T23:31:03.302 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:31:03.303 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:31:03.312 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:31:03.785 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T23:31:03.785 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-09-15T23:31:03.785 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T23:31:03.807 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-15T23:31:03.808 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T23:31:03.846 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi145.front.sepia.ceph.com 2024-09-15T23:31:03.846 DEBUG:teuthology.orchestra.run.smithi145:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T23:31:03.906 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T23:31:03.906 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T23:31:03.909 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T23:31:03.911 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T23:31:03.937 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T23:31:03.937 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T23:31:03.978 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T23:31:03.981 DEBUG:teuthology.orchestra.run.smithi145:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T23:31:04.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T23:31:04.450 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T23:31:04.451 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T23:31:04.476 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T23:31:04.502 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T23:31:04.528 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T23:31:04.538 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:31:04.541 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:31:04.545 DEBUG:teuthology.orchestra.run.smithi145:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:31:04.562 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-09-15T23:31:04.566 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-15T23:31:04.591 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = core 2024-09-15T23:31:04.613 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:31:04.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:31:04.631 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:31:04.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:31:04.651 DEBUG:teuthology.orchestra.run.smithi145:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:31:04.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:31:04.667 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T23:31:04.679 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T23:31:04.680 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906293/remote/smithi002 2024-09-15T23:31:04.680 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T23:31:04.727 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906293/remote/smithi112 2024-09-15T23:31:04.727 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T23:31:04.763 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906293/remote/smithi145 2024-09-15T23:31:04.764 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T23:31:04.800 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T23:31:04.800 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T23:31:04.802 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T23:31:04.805 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T23:31:04.849 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T23:31:04.861 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T23:31:04.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T23:31:04.871 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T23:31:04.872 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T23:31:04.874 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T23:31:04.876 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T23:31:04.887 INFO:teuthology.orchestra.run.smithi002.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 23:31 /home/ubuntu/cephtest 2024-09-15T23:31:04.889 INFO:teuthology.orchestra.run.smithi112.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 23:31 /home/ubuntu/cephtest 2024-09-15T23:31:04.904 INFO:teuthology.orchestra.run.smithi145.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 23:31 /home/ubuntu/cephtest 2024-09-15T23:31:04.905 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T23:31:04.916 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T23:31:04.940 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/blogbench}} duration: 1963.3649928569794 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-15T23:31:04.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T23:31:05.039 INFO:teuthology.run:pass